2023-09-30T16:34:06.436 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T16:34:06.437 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --name yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/orig.config.yaml 2023-09-30T16:34:06.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T16:34:06.555 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7407730' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1d10b71792f3be8887a7631e69851ac2df3585af ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1d10b71792f3be8887a7631e69851ac2df3585af thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1d10b71792f3be8887a7631e69851ac2df3585af owner: scheduled_yuriw@teuthology priority: 76 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6478 sha1: 1d10b71792f3be8887a7631e69851ac2df3585af sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1d10b71792f3be8887a7631e69851ac2df3585af syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGD436M5Ty9dDMIwQ7esDJkIQCZqPlzlGNDRUlgFNRa8D++SsX2sM3edKHZ/rVVXVSYtTTQgN7ZWXFbrLSD5XKM= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDn7UywDQ3uhw9l7ZD9Zdso+5lkx1klRS/WKecYsEZmvSmu4ZcGJuleqa0STMMV42lZn/Q7210K6VMk9PNaFbTo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_19:46:13 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T16:34:06.556 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa; will attempt to use it 2023-09-30T16:34:06.557 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks 2023-09-30T16:34:06.557 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T16:34:06.558 INFO:teuthology.task.internal:Checking packages... 2023-09-30T16:34:06.581 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1d10b71792f3be8887a7631e69851ac2df3585af' 2023-09-30T16:34:06.581 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T16:34:06.581 INFO:teuthology.packaging:ref: None 2023-09-30T16:34:06.581 INFO:teuthology.packaging:tag: None 2023-09-30T16:34:06.581 INFO:teuthology.packaging:branch: main 2023-09-30T16:34:06.581 INFO:teuthology.packaging:sha1: 1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:34:06.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-09-30T16:34:06.896 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6451-g8f071794-1jammy 2023-09-30T16:34:06.897 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T16:34:06.903 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T16:34:06.903 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T16:34:06.909 INFO:teuthology.task.internal:Saving configuration 2023-09-30T16:34:06.926 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T16:34:06.932 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T16:34:06.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:27:55.605929', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPAKd+dLZ0YwX6nDkIe0fGIcmMNDB+3VtKljfVoR7dUS'} 2023-09-30T16:34:06.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:27:55.603973', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJqVdMBzSYzV+I41ZZLWsuCAKIi5CogL8RhL4TESOUkq'} 2023-09-30T16:34:06.980 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T16:34:06.986 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-30T16:34:06.986 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-30T16:34:06.986 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T16:34:07.056 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0527979040>, signals=[15]) 2023-09-30T16:34:07.056 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T16:34:07.063 INFO:teuthology.task.internal:Opening connections... 2023-09-30T16:34:07.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:34:07.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:34:07.139 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:34:07.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:34:07.215 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T16:34:07.222 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-09-30T16:34:07.227 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-09-30T16:34:07.228 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04" 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2023-09-30T16:34:07.275 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-30T16:34:07.276 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-30T16:34:07.276 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-30T16:34:07.276 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-30T16:34:07.276 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy 2023-09-30T16:34:07.276 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-09-30T16:34:07.305 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-09-30T16:34:07.311 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-09-30T16:34:07.311 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-09-30T16:34:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-30T16:34:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2023-09-30T16:34:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="22.04" 2023-09-30T16:34:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-30T16:34:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=jammy 2023-09-30T16:34:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2023-09-30T16:34:07.360 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2023-09-30T16:34:07.360 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-30T16:34:07.360 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-30T16:34:07.360 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-30T16:34:07.360 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-30T16:34:07.360 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=jammy 2023-09-30T16:34:07.361 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-09-30T16:34:07.381 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T16:34:07.389 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T16:34:07.394 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T16:34:07.394 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2023-09-30T16:34:07.397 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2023-09-30T16:34:07.406 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T16:34:07.411 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T16:34:07.412 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2023-09-30T16:34:07.444 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2023-09-30T16:34:07.458 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T16:34:07.524 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T16:34:07.538 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T16:34:07.538 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T16:34:07.539 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T16:34:07.539 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T16:34:07.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:34:07.544 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-09-30T16:34:07.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:34:07.545 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2023-09-30T16:34:07.591 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-56-generic 2023-09-30T16:34:07.591 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.15.0-56-generic 2023-09-30T16:34:07.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2023-09-30T16:34:07.592 INFO:teuthology.orchestra.run.smithi186.stdout:5.15.0-56-generic 2023-09-30T16:34:07.593 INFO:teuthology.task.kernel:Running kernel on smithi186: 5.15.0-56-generic 2023-09-30T16:34:07.593 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-get clean 2023-09-30T16:34:07.704 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-get update 2023-09-30T16:34:07.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2023-09-30T16:34:07.914 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-30T16:34:07.916 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-09-30T16:34:07.934 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-09-30T16:34:08.006 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-09-30T16:34:08.030 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-30T16:34:08.030 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-09-30T16:34:08.111 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-09-30T16:34:08.127 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [804 kB] 2023-09-30T16:34:08.146 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [495 kB] 2023-09-30T16:34:08.213 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [328 kB] 2023-09-30T16:34:08.218 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [169 kB] 2023-09-30T16:34:08.221 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-09-30T16:34:08.221 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-09-30T16:34:08.222 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [889 kB] 2023-09-30T16:34:08.238 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [143 kB] 2023-09-30T16:34:08.240 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-09-30T16:34:08.240 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-09-30T16:34:08.242 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,014 kB] 2023-09-30T16:34:08.247 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-09-30T16:34:08.253 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [144 kB] 2023-09-30T16:34:08.254 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-09-30T16:34:08.256 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-09-30T16:34:08.256 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-09-30T16:34:08.273 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [227 kB] 2023-09-30T16:34:08.282 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-09-30T16:34:08.282 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.4 kB] 2023-09-30T16:34:08.282 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [905 kB] 2023-09-30T16:34:08.283 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-09-30T16:34:08.283 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-09-30T16:34:08.298 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [146 kB] 2023-09-30T16:34:08.302 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-09-30T16:34:08.302 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [987 kB] 2023-09-30T16:34:08.320 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [657 kB] 2023-09-30T16:34:08.325 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [215 kB] 2023-09-30T16:34:08.326 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.9 kB] 2023-09-30T16:34:08.327 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-09-30T16:34:08.327 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-09-30T16:34:08.327 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-09-30T16:34:08.334 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-09-30T16:34:08.334 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-09-30T16:34:08.335 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-09-30T16:34:08.347 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-09-30T16:34:08.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-09-30T16:34:08.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-09-30T16:34:08.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-09-30T16:34:08.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-09-30T16:34:08.354 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-09-30T16:34:08.460 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [804 kB] 2023-09-30T16:34:08.465 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-09-30T16:34:08.605 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,014 kB] 2023-09-30T16:34:08.812 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [328 kB] 2023-09-30T16:34:08.835 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [169 kB] 2023-09-30T16:34:08.846 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-09-30T16:34:08.847 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-09-30T16:34:08.849 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [889 kB] 2023-09-30T16:34:08.867 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [495 kB] 2023-09-30T16:34:08.909 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [227 kB] 2023-09-30T16:34:08.923 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-09-30T16:34:08.924 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.4 kB] 2023-09-30T16:34:08.927 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [905 kB] 2023-09-30T16:34:08.932 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [143 kB] 2023-09-30T16:34:08.942 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-09-30T16:34:08.942 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [559 kB] 2023-09-30T16:34:08.974 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [785 kB] 2023-09-30T16:34:08.977 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [146 kB] 2023-09-30T16:34:08.983 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-09-30T16:34:09.147 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [987 kB] 2023-09-30T16:34:09.164 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [144 kB] 2023-09-30T16:34:09.546 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-09-30T16:34:09.554 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-09-30T16:34:09.554 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-09-30T16:34:09.569 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-09-30T16:34:09.573 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-09-30T16:34:09.765 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [657 kB] 2023-09-30T16:34:09.803 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [215 kB] 2023-09-30T16:34:09.815 INFO:teuthology.orchestra.run.smithi186.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.9 kB] 2023-09-30T16:34:09.817 INFO:teuthology.orchestra.run.smithi186.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-09-30T16:34:09.819 INFO:teuthology.orchestra.run.smithi186.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-09-30T16:34:09.819 INFO:teuthology.orchestra.run.smithi186.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-09-30T16:34:09.820 INFO:teuthology.orchestra.run.smithi186.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-09-30T16:34:09.820 INFO:teuthology.orchestra.run.smithi186.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-09-30T16:34:09.845 INFO:teuthology.orchestra.run.smithi186.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-09-30T16:34:09.847 INFO:teuthology.orchestra.run.smithi186.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-09-30T16:34:10.012 INFO:teuthology.orchestra.run.smithi186.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-09-30T16:34:10.094 INFO:teuthology.orchestra.run.smithi186.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-09-30T16:34:10.190 INFO:teuthology.orchestra.run.smithi186.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-09-30T16:34:10.219 INFO:teuthology.orchestra.run.smithi186.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-09-30T16:34:10.270 INFO:teuthology.orchestra.run.smithi186.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-09-30T16:34:14.071 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 9,178 kB in 2s (5,194 kB/s) 2023-09-30T16:34:14.710 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 9,178 kB in 3s (3,664 kB/s) 2023-09-30T16:34:15.355 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:34:15.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T16:34:15.434 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:34:15.622 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2023-09-30T16:34:15.623 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout: python2.7-minimal 2023-09-30T16:34:15.787 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:34:15.788 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2023-09-30T16:34:15.788 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-09-30T16:34:15.788 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-09-30T16:34:15.788 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-09-30T16:34:15.789 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2023-09-30T16:34:15.789 INFO:teuthology.orchestra.run.smithi052.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-09-30T16:34:15.789 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2023-09-30T16:34:15.789 INFO:teuthology.orchestra.run.smithi052.stdout: thermald 2023-09-30T16:34:15.834 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2023-09-30T16:34:15.834 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-09-30T16:34:15.834 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-09-30T16:34:15.834 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-extra-5.15.0-84-generic 2023-09-30T16:34:15.835 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2023-09-30T16:34:15.836 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-30T16:34:15.892 INFO:teuthology.orchestra.run.smithi052.stdout:3 upgraded, 5 newly installed, 0 to remove and 265 not upgraded. 2023-09-30T16:34:15.892 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 113 MB of archives. 2023-09-30T16:34:15.892 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 582 MB of additional disk space will be used. 2023-09-30T16:34:15.892 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-09-30T16:34:16.106 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:34:16.123 DEBUG:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T16:34:16.177 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:34:16.352 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-09-30T16:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2023-09-30T16:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2023-09-30T16:34:16.488 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-09-30T16:34:16.514 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:34:16.514 INFO:teuthology.orchestra.run.smithi186.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:34:16.514 INFO:teuthology.orchestra.run.smithi186.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:34:16.514 INFO:teuthology.orchestra.run.smithi186.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:34:16.514 INFO:teuthology.orchestra.run.smithi186.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-09-30T16:34:16.515 INFO:teuthology.orchestra.run.smithi186.stdout: python2.7-minimal 2023-09-30T16:34:16.515 INFO:teuthology.orchestra.run.smithi186.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:34:16.516 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2023-09-30T16:34:16.516 INFO:teuthology.orchestra.run.smithi186.stdout: linux-generic linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-09-30T16:34:16.516 INFO:teuthology.orchestra.run.smithi186.stdout: linux-headers-generic linux-image-5.15.0-84-generic 2023-09-30T16:34:16.516 INFO:teuthology.orchestra.run.smithi186.stdout: linux-modules-5.15.0-84-generic linux-modules-extra-5.15.0-84-generic 2023-09-30T16:34:16.517 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2023-09-30T16:34:16.517 INFO:teuthology.orchestra.run.smithi186.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-09-30T16:34:16.517 INFO:teuthology.orchestra.run.smithi186.stdout:Recommended packages: 2023-09-30T16:34:16.517 INFO:teuthology.orchestra.run.smithi186.stdout: thermald 2023-09-30T16:34:16.567 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2023-09-30T16:34:16.568 INFO:teuthology.orchestra.run.smithi186.stdout: linux-headers-5.15.0-84 linux-headers-5.15.0-84-generic 2023-09-30T16:34:16.568 INFO:teuthology.orchestra.run.smithi186.stdout: linux-image-5.15.0-84-generic linux-modules-5.15.0-84-generic 2023-09-30T16:34:16.568 INFO:teuthology.orchestra.run.smithi186.stdout: linux-modules-extra-5.15.0-84-generic 2023-09-30T16:34:16.569 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages will be upgraded: 2023-09-30T16:34:16.569 INFO:teuthology.orchestra.run.smithi186.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-30T16:34:16.748 INFO:teuthology.orchestra.run.smithi186.stdout:3 upgraded, 5 newly installed, 0 to remove and 265 not upgraded. 2023-09-30T16:34:16.748 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 113 MB of archives. 2023-09-30T16:34:16.749 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 582 MB of additional disk space will be used. 2023-09-30T16:34:16.749 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-84-generic amd64 5.15.0-84.93 [22.5 MB] 2023-09-30T16:34:17.396 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-09-30T16:34:17.396 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-09-30T16:34:17.396 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-09-30T16:34:17.543 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-09-30T16:34:17.585 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-09-30T16:34:17.991 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 113 MB in 2s (64.9 MB/s) 2023-09-30T16:34:18.151 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-84-generic amd64 5.15.0-84.93 [11.5 MB] 2023-09-30T16:34:18.155 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-09-30T16:34:18.499 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-84-generic amd64 5.15.0-84.93 [63.9 MB] 2023-09-30T16:34:20.133 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-09-30T16:34:20.137 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:20.202 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:20.616 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.84.81 [1,698 B] 2023-09-30T16:34:20.617 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.84.81 [2,476 B] 2023-09-30T16:34:20.617 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84 all 5.15.0-84.93 [12.3 MB] 2023-09-30T16:34:21.377 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-84-generic amd64 5.15.0-84.93 [2,853 kB] 2023-09-30T16:34:21.500 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.84.81 [2,330 B] 2023-09-30T16:34:21.894 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 113 MB in 5s (23.0 MB/s) 2023-09-30T16:34:22.107 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-modules-5.15.0-84-generic. 2023-09-30T16:34:22.603 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-09-30T16:34:22.625 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:22.706 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:23.165 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-09-30T16:34:23.186 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:23.223 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:24.135 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-09-30T16:34:24.139 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../0-linux-modules-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:24.278 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:26.946 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-image-5.15.0-84-generic. 2023-09-30T16:34:26.967 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../1-linux-image-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:27.059 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:27.549 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-84-generic. 2023-09-30T16:34:27.569 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:27.607 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:29.397 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-09-30T16:34:29.502 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-30T16:34:29.853 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-09-30T16:34:29.981 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-30T16:34:30.267 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-09-30T16:34:30.290 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-09-30T16:34:30.334 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-09-30T16:34:34.204 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../3-linux-generic_5.15.0.84.81_amd64.deb ... 2023-09-30T16:34:34.356 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-30T16:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.84.81_amd64.deb ... 2023-09-30T16:34:34.876 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-image-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-30T16:34:35.188 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-headers-5.15.0-84. 2023-09-30T16:34:35.210 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../5-linux-headers-5.15.0-84_5.15.0-84.93_all.deb ... 2023-09-30T16:34:35.254 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-09-30T16:34:35.985 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-09-30T16:34:36.023 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:36.060 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:38.833 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-09-30T16:34:38.955 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-30T16:34:39.322 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-09-30T16:34:39.443 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:39.569 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-09-30T16:34:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:41.044 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-09-30T16:34:41.044 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-09-30T16:34:41.044 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-09-30T16:34:41.044 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-09-30T16:34:41.201 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:41.534 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-headers-5.15.0-84-generic. 2023-09-30T16:34:41.571 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../6-linux-headers-5.15.0-84-generic_5.15.0-84.93_amd64.deb ... 2023-09-30T16:34:41.609 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:42.619 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:44.237 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-09-30T16:34:44.355 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-09-30T16:34:44.456 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:44.514 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-30T16:34:44.514 INFO:teuthology.orchestra.run.smithi052.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-09-30T16:34:45.039 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.84.81_amd64.deb ... 2023-09-30T16:34:45.186 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-headers-generic (5.15.0.84.81) over (5.15.0.56.54) ... 2023-09-30T16:34:45.561 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-headers-5.15.0-84 (5.15.0-84.93) ... 2023-09-30T16:34:45.708 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-headers-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:45.834 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-headers-generic (5.15.0.84.81) ... 2023-09-30T16:34:45.988 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:47.324 INFO:teuthology.orchestra.run.smithi186.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-09-30T16:34:47.324 INFO:teuthology.orchestra.run.smithi186.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-09-30T16:34:47.324 INFO:teuthology.orchestra.run.smithi186.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-84-generic 2023-09-30T16:34:47.324 INFO:teuthology.orchestra.run.smithi186.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-84-generic 2023-09-30T16:34:47.514 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-modules-extra-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:48.899 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-modules-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:51.101 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-image-generic (5.15.0.84.81) ... 2023-09-30T16:34:51.227 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-generic (5.15.0.84.81) ... 2023-09-30T16:34:51.378 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for linux-image-5.15.0-84-generic (5.15.0-84.93) ... 2023-09-30T16:34:51.440 INFO:teuthology.orchestra.run.smithi186.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-30T16:34:51.440 INFO:teuthology.orchestra.run.smithi186.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-84-generic 2023-09-30T16:34:59.761 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-30T16:34:59.761 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub' 2023-09-30T16:34:59.772 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T16:34:59.802 INFO:teuthology.orchestra.run.smithi052.stdout:Generating grub configuration file ... 2023-09-30T16:35:00.165 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-09-30T16:35:00.197 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-09-30T16:35:00.842 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-30T16:35:00.848 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-30T16:35:00.925 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-30T16:35:00.931 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-30T16:35:01.088 INFO:teuthology.orchestra.run.smithi052.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-30T16:35:01.088 INFO:teuthology.orchestra.run.smithi052.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-09-30T16:35:01.088 INFO:teuthology.orchestra.run.smithi052.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-30T16:35:01.134 INFO:teuthology.orchestra.run.smithi052.stdout:done 2023-09-30T16:35:01.602 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2023-09-30T16:35:01.623 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 20 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.84.81 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-30T16:35:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T16:35:01.625 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2023-09-30T16:35:01.625 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2023-09-30T16:35:01.625 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2023-09-30T16:35:01.625 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2023-09-30T16:35:01.626 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-09-30T16:35:01.626 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T16:35:01.626 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T16:35:01.627 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-30T16:35:01.627 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T16:35:01.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2023-09-30T16:35:01.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2023-09-30T16:35:01.925 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-30T16:35:01.925 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-30T16:35:01.937 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-30T16:35:01.957 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-30T16:35:03.177 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:35:03.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T16:35:03.246 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:35:03.428 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2023-09-30T16:35:03.429 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-30T16:35:03.577 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:35:03.612 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 0 newly installed, 0 to remove and 265 not upgraded. 2023-09-30T16:35:03.614 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2023-09-30T16:35:03.673 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2023-09-30T16:35:03.673 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2023-09-30T16:35:03.673 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 20 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.84.81 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2023-09-30T16:35:03.674 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2023-09-30T16:35:03.675 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2023-09-30T16:35:03.675 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2023-09-30T16:35:03.719 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.FREFypXea6 2023-09-30T16:35:03.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub/grub.cfg /tmp/tmp.FREFypXea6 2023-09-30T16:35:03.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.FREFypXea6 2023-09-30T16:35:03.889 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.FREFypXea6 is 10KB 2023-09-30T16:35:03.900 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.FREFypXea6 2023-09-30T16:35:03.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-30T16:35:03.962 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:35:03.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-30T16:35:03.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-30T16:35:04.031 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-09-30T16:35:04.031 DEBUG:teuthology.orchestra.run.smithi052:> sudo update-grub 2023-09-30T16:35:05.181 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub' 2023-09-30T16:35:05.182 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T16:35:05.185 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2023-09-30T16:35:05.476 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-09-30T16:35:05.483 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-09-30T16:35:05.684 INFO:teuthology.orchestra.run.smithi186.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-30T16:35:05.684 INFO:teuthology.orchestra.run.smithi186.stdout:Sourcing file `/etc/default/grub' 2023-09-30T16:35:05.707 INFO:teuthology.orchestra.run.smithi186.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T16:35:05.737 INFO:teuthology.orchestra.run.smithi186.stdout:Generating grub configuration file ... 2023-09-30T16:35:05.777 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-30T16:35:05.782 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-30T16:35:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-30T16:35:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-30T16:35:05.960 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-30T16:35:05.960 INFO:teuthology.orchestra.run.smithi052.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-30T16:35:05.960 INFO:teuthology.orchestra.run.smithi052.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-30T16:35:05.976 INFO:teuthology.orchestra.run.smithi052.stderr:done 2023-09-30T16:35:05.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2023-09-30T16:35:06.055 INFO:teuthology.orchestra.run.smithi186.stdout:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-09-30T16:35:06.076 INFO:teuthology.orchestra.run.smithi186.stdout:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-09-30T16:35:06.405 INFO:teuthology.orchestra.run.smithi186.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-30T16:35:06.411 INFO:teuthology.orchestra.run.smithi186.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-30T16:35:06.482 INFO:teuthology.orchestra.run.smithi186.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-30T16:35:06.487 INFO:teuthology.orchestra.run.smithi186.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-30T16:35:06.651 INFO:teuthology.orchestra.run.smithi186.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-30T16:35:06.651 INFO:teuthology.orchestra.run.smithi186.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-09-30T16:35:06.651 INFO:teuthology.orchestra.run.smithi186.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-30T16:35:06.685 INFO:teuthology.orchestra.run.smithi186.stdout:done 2023-09-30T16:35:07.221 DEBUG:teuthology.orchestra.run.smithi186:> dpkg -s linux-image-generic 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Package: linux-image-generic 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Status: install ok installed 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Priority: optional 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Section: kernel 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Installed-Size: 20 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: amd64 2023-09-30T16:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Source: linux-meta 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout:Version: 5.15.0.84.81 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout:Recommends: thermald 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout:Description: Generic Linux kernel image 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout: This package will always depend on the latest generic kernel image 2023-09-30T16:35:07.284 INFO:teuthology.orchestra.run.smithi186.stdout: available. 2023-09-30T16:35:07.284 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-84-generic 2023-09-30T16:35:07.284 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T16:35:07.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T16:35:07.285 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-09-30T16:35:07.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T16:35:07.285 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-get clean 2023-09-30T16:35:07.476 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-get update 2023-09-30T16:35:07.588 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-30T16:35:07.598 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-30T16:35:07.614 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-30T16:35:07.711 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-30T16:35:08.834 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:35:08.852 DEBUG:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T16:35:08.903 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2023-09-30T16:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout:linux-image-generic is already the newest version (5.15.0.84.81). 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-30T16:35:09.225 INFO:teuthology.orchestra.run.smithi186.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-30T16:35:09.226 INFO:teuthology.orchestra.run.smithi186.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:35:09.261 INFO:teuthology.orchestra.run.smithi186.stdout:0 upgraded, 0 newly installed, 0 to remove and 265 not upgraded. 2023-09-30T16:35:09.263 DEBUG:teuthology.orchestra.run.smithi186:> dpkg -s linux-image-generic 2023-09-30T16:35:09.321 INFO:teuthology.orchestra.run.smithi186.stdout:Package: linux-image-generic 2023-09-30T16:35:09.321 INFO:teuthology.orchestra.run.smithi186.stdout:Status: install ok installed 2023-09-30T16:35:09.321 INFO:teuthology.orchestra.run.smithi186.stdout:Priority: optional 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Section: kernel 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Installed-Size: 20 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: amd64 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Source: linux-meta 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Version: 5.15.0.84.81 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-84), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Depends: linux-image-5.15.0-84-generic, linux-modules-extra-5.15.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Recommends: thermald 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout:Description: Generic Linux kernel image 2023-09-30T16:35:09.322 INFO:teuthology.orchestra.run.smithi186.stdout: This package will always depend on the latest generic kernel image 2023-09-30T16:35:09.323 INFO:teuthology.orchestra.run.smithi186.stdout: available. 2023-09-30T16:35:09.323 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2023-09-30T16:35:09.367 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.y6ivxIjdQE 2023-09-30T16:35:09.367 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub/grub.cfg /tmp/tmp.y6ivxIjdQE 2023-09-30T16:35:09.423 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.y6ivxIjdQE 2023-09-30T16:35:09.536 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.y6ivxIjdQE is 10KB 2023-09-30T16:35:09.549 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.y6ivxIjdQE 2023-09-30T16:35:09.554 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-30T16:35:09.610 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:35:09.611 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-30T16:35:09.611 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-30T16:35:09.698 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-84-generic 2023-09-30T16:35:09.698 DEBUG:teuthology.orchestra.run.smithi186:> sudo update-grub 2023-09-30T16:35:10.947 INFO:teuthology.orchestra.run.smithi186.stderr:Sourcing file `/etc/default/grub' 2023-09-30T16:35:10.949 INFO:teuthology.orchestra.run.smithi186.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T16:35:10.959 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2023-09-30T16:35:11.171 INFO:teuthology.orchestra.run.smithi186.stderr:Found linux image: /boot/vmlinuz-5.15.0-84-generic 2023-09-30T16:35:11.176 INFO:teuthology.orchestra.run.smithi186.stderr:Found initrd image: /boot/initrd.img-5.15.0-84-generic 2023-09-30T16:35:11.449 INFO:teuthology.orchestra.run.smithi186.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-30T16:35:11.454 INFO:teuthology.orchestra.run.smithi186.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-30T16:35:11.495 INFO:teuthology.orchestra.run.smithi186.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-30T16:35:11.500 INFO:teuthology.orchestra.run.smithi186.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-30T16:35:11.620 INFO:teuthology.orchestra.run.smithi186.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-30T16:35:11.620 INFO:teuthology.orchestra.run.smithi186.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-30T16:35:11.620 INFO:teuthology.orchestra.run.smithi186.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-30T16:35:11.630 INFO:teuthology.orchestra.run.smithi186.stderr:done 2023-09-30T16:35:11.633 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2023-09-30T16:35:36.010 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-30T16:35:36.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-09-30T16:35:36.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:35:41.638 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-09-30T16:35:41.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:35:41.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:35:54.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-09-30T16:35:59.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-30T16:36:03.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-09-30T16:36:03.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:36:08.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:36:08.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:36:12.058 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-09-30T16:36:24.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:36:24.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:37:03.411 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T16:37:15.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-09-30T16:37:15.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:37:15.715 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-09-30T16:37:16.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-09-30T16:37:16.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-84-generic"... 2023-09-30T16:37:16.355 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-09-30T16:37:16.400 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-84-generic 2023-09-30T16:37:16.401 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-09-30T16:37:16.401 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T16:37:16.401 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-30T16:37:17.401 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-30T16:37:17.402 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T16:37:17.487 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2023-09-30T16:37:17.518 DEBUG:teuthology.parallel:result is None 2023-09-30T16:37:24.072 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T16:37:39.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:37:39.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:37:39.300 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-09-30T16:37:39.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:37:39.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-84-generic"... 2023-09-30T16:37:39.949 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2023-09-30T16:37:39.995 INFO:teuthology.orchestra.run.smithi186.stdout:5.15.0-84-generic 2023-09-30T16:37:39.996 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-84-generic vs 5.15.0-84-generic 2023-09-30T16:37:39.996 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T16:37:39.996 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-30T16:37:40.997 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-09-30T16:37:40.997 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T16:37:41.346 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2023-09-30T16:37:41.373 DEBUG:teuthology.parallel:result is None 2023-09-30T16:37:41.373 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T16:37:41.380 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T16:37:41.380 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T16:37:41.383 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T16:37:41.388 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T16:37:41.428 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T16:37:41.440 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T16:37:41.440 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T16:37:41.442 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T16:37:41.469 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T16:37:41.477 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T16:37:41.477 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T16:37:41.501 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T16:37:41.525 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:37:41.529 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:37:41.534 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:37:41.537 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:37:41.539 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T16:37:41.545 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T16:37:41.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T16:37:41.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T16:37:41.604 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T16:37:41.611 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T16:37:41.612 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T16:37:41.637 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T16:37:41.651 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:37:41.689 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:37:41.737 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:37:41.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T16:37:41.796 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:37:41.803 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:37:41.852 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:37:41.853 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T16:37:41.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2023-09-30T16:37:41.925 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2023-09-30T16:37:42.030 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T16:37:42.038 INFO:teuthology.task.internal:Starting timer... 2023-09-30T16:37:42.038 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T16:37:42.047 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T16:37:42.055 DEBUG:teuthology.task.selinux:Excluding smithi052: OS 'ubuntu' does not support SELinux 2023-09-30T16:37:42.055 DEBUG:teuthology.task.selinux:Excluding smithi186: OS 'ubuntu' does not support SELinux 2023-09-30T16:37:42.055 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T16:37:42.055 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-09-30T16:37:42.056 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T16:37:42.056 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T16:37:42.065 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-30T16:37:42.070 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-30T16:37:42.183 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T16:37:42.212 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T16:37:42.213 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T16:45:28.394 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2023-09-30T16:45:28.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-09-30T16:45:28.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:45:28.475 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-09-30T16:45:28.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-09-30T16:45:28.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:45:28.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:45:28.650 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-09-30T16:45:28.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-09-30T16:45:28.767 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T16:45:28.779 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T16:45:28.779 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T16:45:28.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T16:45:28.782 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T16:45:28.782 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T16:45:28.810 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-30T16:45:28.810 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Command line: ntpd -gq 2023-09-30T16:45:28.810 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: ---------------------------------------------------- 2023-09-30T16:45:28.810 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: ntp-4 is maintained by Network Time Foundation, 2023-09-30T16:45:28.811 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-30T16:45:28.811 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: corporation. Support and training for ntp-4 are 2023-09-30T16:45:28.811 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: available at https://www.nwtime.org/support 2023-09-30T16:45:28.811 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: ---------------------------------------------------- 2023-09-30T16:45:28.812 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: proto: precision = 0.062 usec (-24) 2023-09-30T16:45:28.812 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: basedate set to 2022-02-04 2023-09-30T16:45:28.812 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: gps base set to 2022-02-06 (week 2196) 2023-09-30T16:45:28.812 INFO:teuthology.orchestra.run.smithi052.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T16:45:28.812 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T16:45:28.813 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: restrict ::: KOD does nothing without LIMITED. 2023-09-30T16:45:28.813 INFO:teuthology.orchestra.run.smithi052.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listen and drop on 0 v6wildcard [::]:123 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listen normally on 2 lo 127.0.0.1:123 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listen normally on 3 ens1f0 172.21.15.52:123 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listen normally on 4 lo [::1]:123 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15de%4]:123 2023-09-30T16:45:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:28 ntpd[27729]: Listening on routing socket on fd #22 for interface updates 2023-09-30T16:45:28.839 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-30T16:45:28.839 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Command line: ntpd -gq 2023-09-30T16:45:28.839 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: ---------------------------------------------------- 2023-09-30T16:45:28.839 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: ntp-4 is maintained by Network Time Foundation, 2023-09-30T16:45:28.839 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-30T16:45:28.839 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: corporation. Support and training for ntp-4 are 2023-09-30T16:45:28.840 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: available at https://www.nwtime.org/support 2023-09-30T16:45:28.840 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: ---------------------------------------------------- 2023-09-30T16:45:28.840 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: proto: precision = 0.045 usec (-24) 2023-09-30T16:45:28.840 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: basedate set to 2022-02-04 2023-09-30T16:45:28.841 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: gps base set to 2022-02-06 (week 2196) 2023-09-30T16:45:28.841 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T16:45:28.841 INFO:teuthology.orchestra.run.smithi186.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T16:45:28.841 INFO:teuthology.orchestra.run.smithi186.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: restrict ::: KOD does nothing without LIMITED. 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listen and drop on 0 v6wildcard [::]:123 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listen normally on 2 lo 127.0.0.1:123 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listen normally on 3 enp3s0f1 172.21.15.186:123 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listen normally on 4 lo [::1]:123 2023-09-30T16:45:28.842 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df5%5]:123 2023-09-30T16:45:28.843 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:28 ntpd[27815]: Listening on routing socket on fd #22 for interface updates 2023-09-30T16:45:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:29 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:29 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:29 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:29 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:29 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:29 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:29.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:29 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:29.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:29 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:29.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:29 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:29.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:29 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:29.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:29 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:29.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:29 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:30.810 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:30 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:30.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:30 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:31 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:31.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:31 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:31 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:31.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:31 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:31 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:31.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:31 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:31.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:31.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:31.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:31 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:32 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:32 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:32 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:32 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:32 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:32 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:33.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:33 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:33.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:33 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:34 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:34 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:34 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:34 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:34 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:34 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:35.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.811 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:35.812 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:35.813 INFO:teuthology.orchestra.run.smithi052.stdout:30 Sep 16:45:35 ntpd[27729]: ntpd: time slew -0.000502 s 2023-09-30T16:45:35.813 INFO:teuthology.orchestra.run.smithi052.stdout:ntpd: time slew -0.000502s 2023-09-30T16:45:35.813 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-30T16:45:35.813 INFO:teuthology.orchestra.run.smithi052.stderr:30 Sep 16:45:35 ntpd[27729]: can't open /var/log/ntpstats/loopstats.20230930: Permission denied 2023-09-30T16:45:35.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.840 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T16:45:35.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T16:45:35.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T16:45:35.841 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T16:45:35.841 INFO:teuthology.orchestra.run.smithi186.stdout:30 Sep 16:45:35 ntpd[27815]: ntpd: time slew -0.001408 s 2023-09-30T16:45:35.841 INFO:teuthology.orchestra.run.smithi186.stdout:ntpd: time slew -0.001408s 2023-09-30T16:45:35.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-30T16:45:35.842 INFO:teuthology.orchestra.run.smithi186.stderr:30 Sep 16:45:35 ntpd[27815]: can't open /var/log/ntpstats/loopstats.20230930: Permission denied 2023-09-30T16:45:35.910 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2023-09-30T16:45:35.910 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2023-09-30T16:45:35.910 INFO:teuthology.orchestra.run.smithi052.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.910 INFO:teuthology.orchestra.run.smithi052.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.910 INFO:teuthology.orchestra.run.smithi052.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.910 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.917 INFO:teuthology.orchestra.run.smithi186.stdout: remote refid st t when poll reach delay offset jitter 2023-09-30T16:45:35.917 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================== 2023-09-30T16:45:35.917 INFO:teuthology.orchestra.run.smithi186.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.917 INFO:teuthology.orchestra.run.smithi186.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.917 INFO:teuthology.orchestra.run.smithi186.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.918 INFO:teuthology.orchestra.run.smithi186.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-30T16:45:35.919 INFO:teuthology.run_tasks:Running task install... 2023-09-30T16:45:35.931 DEBUG:teuthology.task.install:project ceph 2023-09-30T16:45:35.931 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}} 2023-09-30T16:45:35.931 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'} 2023-09-30T16:45:35.931 INFO:teuthology.task.install:Using flavor: default 2023-09-30T16:45:35.937 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T16:45:35.937 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-30T16:45:35.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-key list | grep Ceph 2023-09-30T16:45:35.938 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-key list | grep Ceph 2023-09-30T16:45:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-30T16:45:36.015 INFO:teuthology.orchestra.run.smithi186.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-30T16:45:36.042 INFO:teuthology.orchestra.run.smithi186.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-30T16:45:36.042 INFO:teuthology.orchestra.run.smithi186.stdout:uid [ unknown] Ceph.com (release key) 2023-09-30T16:45:36.042 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-09-30T16:45:36.043 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-09-30T16:45:36.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:45:36.047 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-30T16:45:36.047 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph.com (release key) 2023-09-30T16:45:36.048 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-09-30T16:45:36.048 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-09-30T16:45:36.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:45:36.198 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default/ 2023-09-30T16:45:36.198 INFO:teuthology.task.install.deb:Package version is 18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:45:36.263 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default/ 2023-09-30T16:45:36.264 INFO:teuthology.task.install.deb:Package version is 18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:45:36.313 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:45:36.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-30T16:45:36.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2023-09-30T16:45:36.438 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:45:36.438 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-30T16:45:36.452 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-get update 2023-09-30T16:45:36.502 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-30T16:45:36.515 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-30T16:45:36.534 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-30T16:45:36.614 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy InRelease 2023-09-30T16:45:36.619 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-30T16:45:36.641 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-30T16:45:36.651 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-09-30T16:45:36.671 INFO:teuthology.orchestra.run.smithi186.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy InRelease 2023-09-30T16:45:36.692 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-09-30T16:45:36.697 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-30T16:45:36.714 INFO:teuthology.orchestra.run.smithi186.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-30T16:45:36.736 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,424 B] 2023-09-30T16:45:36.742 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-30T16:45:36.742 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-30T16:45:36.764 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-30T16:45:36.785 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,424 B] 2023-09-30T16:45:36.818 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-30T16:45:36.876 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 27.9 kB in 0s (75.6 kB/s) 2023-09-30T16:45:36.899 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-30T16:45:37.037 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 27.9 kB in 0s (68.5 kB/s) 2023-09-30T16:45:37.768 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:45:37.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6447-g1d10b717-1jammy cephadm=18.0.0-6447-g1d10b717-1jammy ceph-mds=18.0.0-6447-g1d10b717-1jammy ceph-mgr=18.0.0-6447-g1d10b717-1jammy ceph-common=18.0.0-6447-g1d10b717-1jammy ceph-fuse=18.0.0-6447-g1d10b717-1jammy ceph-test=18.0.0-6447-g1d10b717-1jammy ceph-volume=18.0.0-6447-g1d10b717-1jammy radosgw=18.0.0-6447-g1d10b717-1jammy python3-rados=18.0.0-6447-g1d10b717-1jammy python3-rgw=18.0.0-6447-g1d10b717-1jammy python3-cephfs=18.0.0-6447-g1d10b717-1jammy python3-rbd=18.0.0-6447-g1d10b717-1jammy libcephfs2=18.0.0-6447-g1d10b717-1jammy libcephfs-dev=18.0.0-6447-g1d10b717-1jammy librados2=18.0.0-6447-g1d10b717-1jammy librbd1=18.0.0-6447-g1d10b717-1jammy rbd-fuse=18.0.0-6447-g1d10b717-1jammy python3-cephfs=18.0.0-6447-g1d10b717-1jammy cephfs-shell=18.0.0-6447-g1d10b717-1jammy cephfs-top=18.0.0-6447-g1d10b717-1jammy cephfs-mirror=18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:45:37.843 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:45:37.910 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:45:37.927 DEBUG:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6447-g1d10b717-1jammy cephadm=18.0.0-6447-g1d10b717-1jammy ceph-mds=18.0.0-6447-g1d10b717-1jammy ceph-mgr=18.0.0-6447-g1d10b717-1jammy ceph-common=18.0.0-6447-g1d10b717-1jammy ceph-fuse=18.0.0-6447-g1d10b717-1jammy ceph-test=18.0.0-6447-g1d10b717-1jammy ceph-volume=18.0.0-6447-g1d10b717-1jammy radosgw=18.0.0-6447-g1d10b717-1jammy python3-rados=18.0.0-6447-g1d10b717-1jammy python3-rgw=18.0.0-6447-g1d10b717-1jammy python3-cephfs=18.0.0-6447-g1d10b717-1jammy python3-rbd=18.0.0-6447-g1d10b717-1jammy libcephfs2=18.0.0-6447-g1d10b717-1jammy libcephfs-dev=18.0.0-6447-g1d10b717-1jammy librados2=18.0.0-6447-g1d10b717-1jammy librbd1=18.0.0-6447-g1d10b717-1jammy rbd-fuse=18.0.0-6447-g1d10b717-1jammy python3-cephfs=18.0.0-6447-g1d10b717-1jammy cephfs-shell=18.0.0-6447-g1d10b717-1jammy cephfs-top=18.0.0-6447-g1d10b717-1jammy cephfs-mirror=18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:45:37.985 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:45:38.028 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2023-09-30T16:45:38.029 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2023-09-30T16:45:38.167 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2023-09-30T16:45:38.167 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2023-09-30T16:45:38.200 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:45:38.200 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:45:38.200 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:45:38.200 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:45:38.200 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-30T16:45:38.201 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-30T16:45:38.201 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:45:38.202 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2023-09-30T16:45:38.202 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-30T16:45:38.202 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-30T16:45:38.202 INFO:teuthology.orchestra.run.smithi052.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-30T16:45:38.202 INFO:teuthology.orchestra.run.smithi052.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-30T16:45:38.203 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout: qttranslations5-l10n socat xmlstarlet 2023-09-30T16:45:38.204 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: python3-watchdog 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2023-09-30T16:45:38.205 INFO:teuthology.orchestra.run.smithi052.stdout: btrfs-tools 2023-09-30T16:45:38.310 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-09-30T16:45:38.311 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-30T16:45:38.312 INFO:teuthology.orchestra.run.smithi052.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-30T16:45:38.312 INFO:teuthology.orchestra.run.smithi052.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-30T16:45:38.312 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-30T16:45:38.312 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-30T16:45:38.313 INFO:teuthology.orchestra.run.smithi052.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-30T16:45:38.314 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-30T16:45:38.314 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-30T16:45:38.314 INFO:teuthology.orchestra.run.smithi052.stdout: socat xmlstarlet 2023-09-30T16:45:38.324 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:45:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:45:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:45:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:45:38.325 INFO:teuthology.orchestra.run.smithi186.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-30T16:45:38.325 INFO:teuthology.orchestra.run.smithi186.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-30T16:45:38.325 INFO:teuthology.orchestra.run.smithi186.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:45:38.325 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2023-09-30T16:45:38.325 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-30T16:45:38.326 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-30T16:45:38.326 INFO:teuthology.orchestra.run.smithi186.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-30T16:45:38.326 INFO:teuthology.orchestra.run.smithi186.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-30T16:45:38.327 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-30T16:45:38.327 INFO:teuthology.orchestra.run.smithi186.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-30T16:45:38.327 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-09-30T16:45:38.328 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: qttranslations5-l10n socat xmlstarlet 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-30T16:45:38.329 INFO:teuthology.orchestra.run.smithi186.stdout: python3-watchdog 2023-09-30T16:45:38.330 INFO:teuthology.orchestra.run.smithi186.stdout:Recommended packages: 2023-09-30T16:45:38.330 INFO:teuthology.orchestra.run.smithi186.stdout: btrfs-tools 2023-09-30T16:45:38.376 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 115 newly installed, 0 to remove and 253 not upgraded. 2023-09-30T16:45:38.376 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 184 MB of archives. 2023-09-30T16:45:38.376 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 825 MB of additional disk space will be used. 2023-09-30T16:45:38.376 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-09-30T16:45:38.396 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-30T16:45:38.407 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-09-30T16:45:38.426 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2023-09-30T16:45:38.426 INFO:teuthology.orchestra.run.smithi186.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-30T16:45:38.426 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-30T16:45:38.426 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-30T16:45:38.427 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-09-30T16:45:38.428 INFO:teuthology.orchestra.run.smithi186.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-30T16:45:38.428 INFO:teuthology.orchestra.run.smithi186.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-30T16:45:38.429 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-30T16:45:38.430 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-30T16:45:38.431 INFO:teuthology.orchestra.run.smithi186.stdout: socat xmlstarlet 2023-09-30T16:45:38.453 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-30T16:45:38.465 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-30T16:45:38.482 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-30T16:45:38.484 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-30T16:45:38.490 INFO:teuthology.orchestra.run.smithi186.stdout:0 upgraded, 115 newly installed, 0 to remove and 253 not upgraded. 2023-09-30T16:45:38.490 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 184 MB of archives. 2023-09-30T16:45:38.490 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 825 MB of additional disk space will be used. 2023-09-30T16:45:38.490 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-09-30T16:45:38.496 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-30T16:45:38.511 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-30T16:45:38.522 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-09-30T16:45:38.531 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6447-g1d10b717-1jammy [3,444 kB] 2023-09-30T16:45:38.549 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-30T16:45:38.554 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-30T16:45:38.566 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-30T16:45:38.569 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-30T16:45:38.570 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-30T16:45:38.571 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-30T16:45:38.579 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-30T16:45:38.580 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-30T16:45:38.580 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-30T16:45:38.580 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-30T16:45:38.581 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-30T16:45:38.582 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-30T16:45:38.592 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-30T16:45:38.593 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-30T16:45:38.593 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-30T16:45:38.598 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-30T16:45:38.601 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-30T16:45:38.611 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-30T16:45:38.612 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-30T16:45:38.615 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-30T16:45:38.615 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-30T16:45:38.615 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-30T16:45:38.616 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-30T16:45:38.616 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-30T16:45:38.617 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-30T16:45:38.631 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-30T16:45:38.632 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-30T16:45:38.632 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-30T16:45:38.646 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6447-g1d10b717-1jammy [3,444 kB] 2023-09-30T16:45:38.651 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-30T16:45:38.651 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-30T16:45:38.657 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-30T16:45:38.657 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-30T16:45:38.658 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-30T16:45:38.659 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-30T16:45:38.660 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-30T16:45:38.664 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-30T16:45:38.668 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-30T16:45:38.675 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-30T16:45:38.676 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-30T16:45:38.678 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-30T16:45:38.680 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-30T16:45:38.684 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-30T16:45:38.685 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-30T16:45:38.693 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-30T16:45:38.694 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-30T16:45:38.694 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-30T16:45:38.695 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-30T16:45:38.695 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-30T16:45:38.696 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-30T16:45:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-30T16:45:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-30T16:45:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-30T16:45:38.722 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-30T16:45:38.722 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-30T16:45:38.723 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-30T16:45:38.749 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-30T16:45:38.750 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-30T16:45:38.752 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-30T16:45:38.753 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-30T16:45:38.753 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-30T16:45:38.754 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-30T16:45:38.755 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-30T16:45:38.755 INFO:teuthology.orchestra.run.smithi052.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-30T16:45:38.756 INFO:teuthology.orchestra.run.smithi052.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-30T16:45:38.758 INFO:teuthology.orchestra.run.smithi052.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-30T16:45:38.758 INFO:teuthology.orchestra.run.smithi052.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-30T16:45:38.758 INFO:teuthology.orchestra.run.smithi052.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-30T16:45:38.760 INFO:teuthology.orchestra.run.smithi052.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-30T16:45:38.778 INFO:teuthology.orchestra.run.smithi052.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-30T16:45:38.779 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-30T16:45:38.780 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-30T16:45:38.780 INFO:teuthology.orchestra.run.smithi052.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-30T16:45:38.781 INFO:teuthology.orchestra.run.smithi052.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-30T16:45:38.781 INFO:teuthology.orchestra.run.smithi186.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-30T16:45:38.795 INFO:teuthology.orchestra.run.smithi052.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-30T16:45:38.799 INFO:teuthology.orchestra.run.smithi186.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-30T16:45:38.799 INFO:teuthology.orchestra.run.smithi186.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-30T16:45:38.805 INFO:teuthology.orchestra.run.smithi052.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-30T16:45:38.805 INFO:teuthology.orchestra.run.smithi186.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-30T16:45:38.805 INFO:teuthology.orchestra.run.smithi186.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-30T16:45:38.806 INFO:teuthology.orchestra.run.smithi186.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-30T16:45:38.806 INFO:teuthology.orchestra.run.smithi052.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-30T16:45:38.806 INFO:teuthology.orchestra.run.smithi052.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-30T16:45:38.807 INFO:teuthology.orchestra.run.smithi186.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-30T16:45:38.807 INFO:teuthology.orchestra.run.smithi052.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-30T16:45:38.808 INFO:teuthology.orchestra.run.smithi186.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-30T16:45:38.808 INFO:teuthology.orchestra.run.smithi052.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-30T16:45:38.808 INFO:teuthology.orchestra.run.smithi052.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-30T16:45:38.809 INFO:teuthology.orchestra.run.smithi052.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-30T16:45:38.813 INFO:teuthology.orchestra.run.smithi052.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-30T16:45:38.818 INFO:teuthology.orchestra.run.smithi186.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-30T16:45:38.819 INFO:teuthology.orchestra.run.smithi186.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-30T16:45:38.820 INFO:teuthology.orchestra.run.smithi186.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-30T16:45:38.832 INFO:teuthology.orchestra.run.smithi052.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-30T16:45:38.833 INFO:teuthology.orchestra.run.smithi052.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-30T16:45:38.834 INFO:teuthology.orchestra.run.smithi052.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-30T16:45:38.837 INFO:teuthology.orchestra.run.smithi052.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-30T16:45:38.839 INFO:teuthology.orchestra.run.smithi052.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-09-30T16:45:38.839 INFO:teuthology.orchestra.run.smithi052.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-30T16:45:38.843 INFO:teuthology.orchestra.run.smithi052.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-30T16:45:38.846 INFO:teuthology.orchestra.run.smithi052.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-30T16:45:38.846 INFO:teuthology.orchestra.run.smithi052.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-30T16:45:38.847 INFO:teuthology.orchestra.run.smithi186.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-30T16:45:38.851 INFO:teuthology.orchestra.run.smithi186.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-30T16:45:38.852 INFO:teuthology.orchestra.run.smithi186.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-30T16:45:38.857 INFO:teuthology.orchestra.run.smithi186.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-30T16:45:38.879 INFO:teuthology.orchestra.run.smithi052.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-30T16:45:38.879 INFO:teuthology.orchestra.run.smithi052.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-30T16:45:38.881 INFO:teuthology.orchestra.run.smithi052.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-30T16:45:38.898 INFO:teuthology.orchestra.run.smithi052.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-30T16:45:38.907 INFO:teuthology.orchestra.run.smithi052.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-30T16:45:38.907 INFO:teuthology.orchestra.run.smithi052.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-30T16:45:38.908 INFO:teuthology.orchestra.run.smithi052.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-30T16:45:38.910 INFO:teuthology.orchestra.run.smithi052.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-30T16:45:38.911 INFO:teuthology.orchestra.run.smithi052.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-30T16:45:38.929 INFO:teuthology.orchestra.run.smithi186.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-30T16:45:38.930 INFO:teuthology.orchestra.run.smithi186.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-30T16:45:38.932 INFO:teuthology.orchestra.run.smithi186.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-30T16:45:38.959 INFO:teuthology.orchestra.run.smithi186.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-30T16:45:38.960 INFO:teuthology.orchestra.run.smithi186.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-30T16:45:38.961 INFO:teuthology.orchestra.run.smithi186.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-30T16:45:38.983 INFO:teuthology.orchestra.run.smithi186.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-30T16:45:38.985 INFO:teuthology.orchestra.run.smithi186.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-30T16:45:38.986 INFO:teuthology.orchestra.run.smithi186.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-30T16:45:38.988 INFO:teuthology.orchestra.run.smithi052.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6447-g1d10b717-1jammy [3,129 kB] 2023-09-30T16:45:39.023 INFO:teuthology.orchestra.run.smithi186.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-30T16:45:39.023 INFO:teuthology.orchestra.run.smithi186.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-30T16:45:39.023 INFO:teuthology.orchestra.run.smithi186.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-30T16:45:39.024 INFO:teuthology.orchestra.run.smithi186.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-30T16:45:39.024 INFO:teuthology.orchestra.run.smithi186.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-30T16:45:39.025 INFO:teuthology.orchestra.run.smithi186.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-30T16:45:39.025 INFO:teuthology.orchestra.run.smithi186.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-30T16:45:39.026 INFO:teuthology.orchestra.run.smithi186.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-30T16:45:39.039 INFO:teuthology.orchestra.run.smithi186.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-30T16:45:39.043 INFO:teuthology.orchestra.run.smithi186.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-30T16:45:39.045 INFO:teuthology.orchestra.run.smithi186.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-30T16:45:39.063 INFO:teuthology.orchestra.run.smithi186.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-30T16:45:39.068 INFO:teuthology.orchestra.run.smithi186.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-30T16:45:39.071 INFO:teuthology.orchestra.run.smithi186.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-09-30T16:45:39.071 INFO:teuthology.orchestra.run.smithi186.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-30T16:45:39.077 INFO:teuthology.orchestra.run.smithi186.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-30T16:45:39.080 INFO:teuthology.orchestra.run.smithi186.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-30T16:45:39.081 INFO:teuthology.orchestra.run.smithi186.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-30T16:45:39.081 INFO:teuthology.orchestra.run.smithi186.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-30T16:45:39.082 INFO:teuthology.orchestra.run.smithi186.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-30T16:45:39.085 INFO:teuthology.orchestra.run.smithi186.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-30T16:45:39.102 INFO:teuthology.orchestra.run.smithi186.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-30T16:45:39.111 INFO:teuthology.orchestra.run.smithi186.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-30T16:45:39.111 INFO:teuthology.orchestra.run.smithi186.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-30T16:45:39.111 INFO:teuthology.orchestra.run.smithi186.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-30T16:45:39.114 INFO:teuthology.orchestra.run.smithi186.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-30T16:45:39.114 INFO:teuthology.orchestra.run.smithi186.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-30T16:45:39.164 INFO:teuthology.orchestra.run.smithi052.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6447-g1d10b717-1jammy [688 kB] 2023-09-30T16:45:39.179 INFO:teuthology.orchestra.run.smithi052.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6447-g1d10b717-1jammy [356 kB] 2023-09-30T16:45:39.207 INFO:teuthology.orchestra.run.smithi052.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6447-g1d10b717-1jammy [32.8 kB] 2023-09-30T16:45:39.208 INFO:teuthology.orchestra.run.smithi052.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6447-g1d10b717-1jammy [180 kB] 2023-09-30T16:45:39.212 INFO:teuthology.orchestra.run.smithi052.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6447-g1d10b717-1jammy [62.4 kB] 2023-09-30T16:45:39.214 INFO:teuthology.orchestra.run.smithi052.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6447-g1d10b717-1jammy [329 kB] 2023-09-30T16:45:39.239 INFO:teuthology.orchestra.run.smithi052.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6447-g1d10b717-1jammy [6,209 kB] 2023-09-30T16:45:39.415 INFO:teuthology.orchestra.run.smithi186.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6447-g1d10b717-1jammy [3,129 kB] 2023-09-30T16:45:39.491 INFO:teuthology.orchestra.run.smithi052.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6447-g1d10b717-1jammy [112 kB] 2023-09-30T16:45:39.493 INFO:teuthology.orchestra.run.smithi052.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6447-g1d10b717-1jammy [439 kB] 2023-09-30T16:45:39.517 INFO:teuthology.orchestra.run.smithi052.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6447-g1d10b717-1jammy [22.5 MB] 2023-09-30T16:45:39.882 INFO:teuthology.orchestra.run.smithi186.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6447-g1d10b717-1jammy [688 kB] 2023-09-30T16:45:39.958 INFO:teuthology.orchestra.run.smithi186.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6447-g1d10b717-1jammy [356 kB] 2023-09-30T16:45:40.025 INFO:teuthology.orchestra.run.smithi186.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6447-g1d10b717-1jammy [32.8 kB] 2023-09-30T16:45:40.026 INFO:teuthology.orchestra.run.smithi186.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6447-g1d10b717-1jammy [180 kB] 2023-09-30T16:45:40.032 INFO:teuthology.orchestra.run.smithi186.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6447-g1d10b717-1jammy [62.4 kB] 2023-09-30T16:45:40.034 INFO:teuthology.orchestra.run.smithi186.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6447-g1d10b717-1jammy [329 kB] 2023-09-30T16:45:40.103 INFO:teuthology.orchestra.run.smithi186.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6447-g1d10b717-1jammy [6,209 kB] 2023-09-30T16:45:40.601 INFO:teuthology.orchestra.run.smithi052.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6447-g1d10b717-1jammy [6,852 kB] 2023-09-30T16:45:40.843 INFO:teuthology.orchestra.run.smithi052.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6447-g1d10b717-1jammy [238 kB] 2023-09-30T16:45:40.850 INFO:teuthology.orchestra.run.smithi052.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6447-g1d10b717-1jammy [128 kB] 2023-09-30T16:45:40.869 INFO:teuthology.orchestra.run.smithi052.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6447-g1d10b717-1jammy [1,497 kB] 2023-09-30T16:45:40.920 INFO:teuthology.orchestra.run.smithi052.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6447-g1d10b717-1jammy [9,860 kB] 2023-09-30T16:45:41.051 INFO:teuthology.orchestra.run.smithi186.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6447-g1d10b717-1jammy [112 kB] 2023-09-30T16:45:41.053 INFO:teuthology.orchestra.run.smithi186.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6447-g1d10b717-1jammy [439 kB] 2023-09-30T16:45:41.117 INFO:teuthology.orchestra.run.smithi186.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6447-g1d10b717-1jammy [22.5 MB] 2023-09-30T16:45:41.321 INFO:teuthology.orchestra.run.smithi052.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6447-g1d10b717-1jammy [31.7 MB] 2023-09-30T16:45:42.768 INFO:teuthology.orchestra.run.smithi052.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6447-g1d10b717-1jammy [14.1 kB] 2023-09-30T16:45:42.769 INFO:teuthology.orchestra.run.smithi052.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6447-g1d10b717-1jammy [839 kB] 2023-09-30T16:45:42.785 INFO:teuthology.orchestra.run.smithi052.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6447-g1d10b717-1jammy [2,146 kB] 2023-09-30T16:45:42.824 INFO:teuthology.orchestra.run.smithi052.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6447-g1d10b717-1jammy [267 kB] 2023-09-30T16:45:42.828 INFO:teuthology.orchestra.run.smithi052.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6447-g1d10b717-1jammy [138 kB] 2023-09-30T16:45:42.830 INFO:teuthology.orchestra.run.smithi052.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6447-g1d10b717-1jammy [1,905 kB] 2023-09-30T16:45:42.901 INFO:teuthology.orchestra.run.smithi052.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6447-g1d10b717-1jammy [8,625 kB] 2023-09-30T16:45:43.267 INFO:teuthology.orchestra.run.smithi052.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6447-g1d10b717-1jammy [14.2 kB] 2023-09-30T16:45:43.267 INFO:teuthology.orchestra.run.smithi052.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6447-g1d10b717-1jammy [47.7 MB] 2023-09-30T16:45:44.395 INFO:teuthology.orchestra.run.smithi186.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6447-g1d10b717-1jammy [6,852 kB] 2023-09-30T16:45:45.318 INFO:teuthology.orchestra.run.smithi186.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6447-g1d10b717-1jammy [238 kB] 2023-09-30T16:45:45.368 INFO:teuthology.orchestra.run.smithi186.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6447-g1d10b717-1jammy [128 kB] 2023-09-30T16:45:45.397 INFO:teuthology.orchestra.run.smithi186.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6447-g1d10b717-1jammy [1,497 kB] 2023-09-30T16:45:45.475 INFO:teuthology.orchestra.run.smithi052.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6447-g1d10b717-1jammy [120 kB] 2023-09-30T16:45:45.535 INFO:teuthology.orchestra.run.smithi186.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6447-g1d10b717-1jammy [9,860 kB] 2023-09-30T16:45:45.550 INFO:teuthology.orchestra.run.smithi052.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6447-g1d10b717-1jammy [227 kB] 2023-09-30T16:45:45.555 INFO:teuthology.orchestra.run.smithi052.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6447-g1d10b717-1jammy [34.0 kB] 2023-09-30T16:45:45.556 INFO:teuthology.orchestra.run.smithi052.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6447-g1d10b717-1jammy [23.4 kB] 2023-09-30T16:45:45.557 INFO:teuthology.orchestra.run.smithi052.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6447-g1d10b717-1jammy [38.4 kB] 2023-09-30T16:45:45.558 INFO:teuthology.orchestra.run.smithi052.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6447-g1d10b717-1jammy [12.3 MB] 2023-09-30T16:45:46.078 INFO:teuthology.orchestra.run.smithi052.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6447-g1d10b717-1jammy [91.6 kB] 2023-09-30T16:45:46.655 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 184 MB in 8s (23.7 MB/s) 2023-09-30T16:45:46.795 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyperclip. 2023-09-30T16:45:46.824 INFO:teuthology.orchestra.run.smithi186.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6447-g1d10b717-1jammy [31.7 MB] 2023-09-30T16:45:46.896 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-09-30T16:45:46.901 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-09-30T16:45:46.943 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-09-30T16:45:47.170 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-30T16:45:47.186 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-30T16:45:47.220 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-30T16:45:47.548 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cmd2. 2023-09-30T16:45:47.575 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-09-30T16:45:47.614 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-09-30T16:45:47.959 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-30T16:45:47.986 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-30T16:45:48.067 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-30T16:45:48.412 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-30T16:45:48.439 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-30T16:45:48.478 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-30T16:45:48.840 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-30T16:45:48.867 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-30T16:45:48.907 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-30T16:45:49.168 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-30T16:45:49.195 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-30T16:45:49.234 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-30T16:45:49.688 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-30T16:45:49.715 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-30T16:45:49.763 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:45:50.124 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-30T16:45:50.151 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-30T16:45:50.182 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:45:50.527 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-30T16:45:50.554 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-30T16:45:50.594 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:45:50.947 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-30T16:45:50.973 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-30T16:45:51.013 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-30T16:45:51.299 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librados2. 2023-09-30T16:45:51.326 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../011-librados2_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:51.366 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librados2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:51.819 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librbd1. 2023-09-30T16:45:51.846 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../012-librbd1_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:51.885 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librbd1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:52.330 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs2. 2023-09-30T16:45:52.330 INFO:teuthology.orchestra.run.smithi186.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6447-g1d10b717-1jammy [14.1 kB] 2023-09-30T16:45:52.330 INFO:teuthology.orchestra.run.smithi186.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6447-g1d10b717-1jammy [839 kB] 2023-09-30T16:45:52.357 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:52.369 INFO:teuthology.orchestra.run.smithi186.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6447-g1d10b717-1jammy [2,146 kB] 2023-09-30T16:45:52.396 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:52.619 INFO:teuthology.orchestra.run.smithi186.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6447-g1d10b717-1jammy [267 kB] 2023-09-30T16:45:52.652 INFO:teuthology.orchestra.run.smithi186.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6447-g1d10b717-1jammy [138 kB] 2023-09-30T16:45:52.659 INFO:teuthology.orchestra.run.smithi186.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6447-g1d10b717-1jammy [1,905 kB] 2023-09-30T16:45:52.682 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rados. 2023-09-30T16:45:52.709 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:52.748 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rados (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:52.870 INFO:teuthology.orchestra.run.smithi186.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6447-g1d10b717-1jammy [8,625 kB] 2023-09-30T16:45:53.026 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-30T16:45:53.042 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:45:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-argparse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:53.295 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cephfs. 2023-09-30T16:45:53.322 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:53.362 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cephfs (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:53.664 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-30T16:45:53.692 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:45:53.731 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:53.785 INFO:teuthology.orchestra.run.smithi186.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6447-g1d10b717-1jammy [14.2 kB] 2023-09-30T16:45:53.787 INFO:teuthology.orchestra.run.smithi186.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6447-g1d10b717-1jammy [47.7 MB] 2023-09-30T16:45:54.067 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-prettytable. 2023-09-30T16:45:54.094 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-09-30T16:45:54.134 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-30T16:45:54.394 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rbd. 2023-09-30T16:45:54.421 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:54.461 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rbd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:54.756 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-30T16:45:54.772 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-30T16:45:54.805 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-30T16:45:55.142 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librgw2. 2023-09-30T16:45:55.168 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../021-librgw2_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:55.208 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librgw2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:55.736 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rgw. 2023-09-30T16:45:55.752 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:55.794 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:56.105 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-30T16:45:56.132 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-30T16:45:56.171 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-30T16:45:56.457 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libradosstriper1. 2023-09-30T16:45:56.484 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:56.524 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libradosstriper1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:56.978 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-common. 2023-09-30T16:45:57.004 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:57.044 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:58.366 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-base. 2023-09-30T16:45:58.393 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:45:58.442 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-base (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:45:58.784 INFO:teuthology.orchestra.run.smithi186.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6447-g1d10b717-1jammy [120 kB] 2023-09-30T16:45:58.787 INFO:teuthology.orchestra.run.smithi186.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6447-g1d10b717-1jammy [227 kB] 2023-09-30T16:45:58.791 INFO:teuthology.orchestra.run.smithi186.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6447-g1d10b717-1jammy [34.0 kB] 2023-09-30T16:45:58.792 INFO:teuthology.orchestra.run.smithi186.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6447-g1d10b717-1jammy [23.4 kB] 2023-09-30T16:45:58.793 INFO:teuthology.orchestra.run.smithi186.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6447-g1d10b717-1jammy [38.4 kB] 2023-09-30T16:45:58.794 INFO:teuthology.orchestra.run.smithi186.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6447-g1d10b717-1jammy [12.3 MB] 2023-09-30T16:45:59.195 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-30T16:45:59.222 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-30T16:45:59.261 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-30T16:45:59.564 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cheroot. 2023-09-30T16:45:59.591 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-30T16:45:59.631 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-30T16:45:59.748 INFO:teuthology.orchestra.run.smithi186.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6447-g1d10b717-1jammy [91.6 kB] 2023-09-30T16:45:59.958 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-30T16:45:59.985 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-30T16:46:00.025 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-30T16:46:00.301 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 184 MB in 21s (8,632 kB/s) 2023-09-30T16:46:00.311 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-30T16:46:00.338 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-30T16:46:00.378 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-30T16:46:00.440 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyperclip. 2023-09-30T16:46:00.535 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-09-30T16:46:00.542 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-09-30T16:46:00.596 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-09-30T16:46:00.664 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-30T16:46:00.691 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-30T16:46:00.730 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-30T16:46:00.891 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-30T16:46:00.918 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-30T16:46:00.958 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-30T16:46:01.033 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempora. 2023-09-30T16:46:01.060 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-09-30T16:46:01.100 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-30T16:46:01.252 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cmd2. 2023-09-30T16:46:01.267 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-09-30T16:46:01.302 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-09-30T16:46:01.378 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-portend. 2023-09-30T16:46:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-09-30T16:46:01.444 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-30T16:46:01.572 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-30T16:46:01.594 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-30T16:46:01.663 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-30T16:46:01.722 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-30T16:46:01.749 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-30T16:46:01.788 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-30T16:46:01.991 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-30T16:46:02.018 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-30T16:46:02.058 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-30T16:46:02.116 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-30T16:46:02.143 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-30T16:46:02.182 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-30T16:46:02.437 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-30T16:46:02.463 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-30T16:46:02.503 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-30T16:46:02.786 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-natsort. 2023-09-30T16:46:02.806 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-30T16:46:02.813 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-09-30T16:46:02.832 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-30T16:46:02.852 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-30T16:46:02.873 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-30T16:46:03.164 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-logutils. 2023-09-30T16:46:03.191 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-09-30T16:46:03.230 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-30T16:46:03.268 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-30T16:46:03.294 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-30T16:46:03.342 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:46:03.533 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-30T16:46:03.560 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-30T16:46:03.599 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-30T16:46:03.738 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-30T16:46:03.764 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-30T16:46:03.804 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:46:03.886 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-mako. 2023-09-30T16:46:03.913 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-30T16:46:03.952 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-30T16:46:04.107 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-30T16:46:04.134 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-30T16:46:04.174 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:46:04.255 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-30T16:46:04.283 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-30T16:46:04.322 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-30T16:46:04.519 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-30T16:46:04.545 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-30T16:46:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-30T16:46:04.585 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-30T16:46:04.609 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-30T16:46:04.641 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-30T16:46:04.913 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librados2. 2023-09-30T16:46:04.919 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webob. 2023-09-30T16:46:04.940 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../011-librados2_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:04.946 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-30T16:46:04.980 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librados2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:04.985 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-30T16:46:05.330 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-waitress. 2023-09-30T16:46:05.357 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-30T16:46:05.391 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-30T16:46:05.574 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librbd1. 2023-09-30T16:46:05.589 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../012-librbd1_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:05.624 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librbd1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:05.633 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempita. 2023-09-30T16:46:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-30T16:46:05.699 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-30T16:46:06.010 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-paste. 2023-09-30T16:46:06.037 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-30T16:46:06.077 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-30T16:46:06.077 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libcephfs2. 2023-09-30T16:46:06.104 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:06.144 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libcephfs2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:06.405 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-30T16:46:06.422 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rados. 2023-09-30T16:46:06.432 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-30T16:46:06.448 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:06.471 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-30T16:46:06.488 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rados (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:06.757 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-30T16:46:06.784 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-30T16:46:06.799 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-30T16:46:06.824 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-30T16:46:06.825 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:06.865 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-ceph-argparse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:07.068 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cephfs. 2023-09-30T16:46:07.083 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:07.118 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cephfs (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:07.135 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webtest. 2023-09-30T16:46:07.162 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-09-30T16:46:07.202 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-30T16:46:07.440 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-30T16:46:07.466 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:07.496 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pecan. 2023-09-30T16:46:07.506 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:07.523 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-30T16:46:07.562 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-30T16:46:07.809 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-prettytable. 2023-09-30T16:46:07.836 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-09-30T16:46:07.876 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-30T16:46:07.925 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-certifi. 2023-09-30T16:46:07.952 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-09-30T16:46:07.992 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-30T16:46:08.145 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rbd. 2023-09-30T16:46:08.160 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:08.203 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rbd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:08.353 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-idna. 2023-09-30T16:46:08.380 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-09-30T16:46:08.428 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-30T16:46:08.565 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-30T16:46:08.591 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-30T16:46:08.631 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-30T16:46:08.822 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-urllib3. 2023-09-30T16:46:08.849 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-30T16:46:08.897 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-30T16:46:08.934 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librgw2. 2023-09-30T16:46:08.949 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../021-librgw2_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:08.984 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librgw2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:09.284 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests. 2023-09-30T16:46:09.311 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-30T16:46:09.358 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-30T16:46:09.469 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rgw. 2023-09-30T16:46:09.485 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:09.528 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:09.745 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-30T16:46:09.772 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-30T16:46:09.820 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-30T16:46:09.898 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-30T16:46:09.924 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-30T16:46:09.964 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-30T16:46:10.164 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-30T16:46:10.180 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:10.231 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:10.417 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libradosstriper1. 2023-09-30T16:46:10.444 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:10.484 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libradosstriper1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:10.629 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-30T16:46:10.656 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:10.696 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:10.829 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-common. 2023-09-30T16:46:10.856 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:10.887 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:11.007 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-openssl. 2023-09-30T16:46:11.034 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-09-30T16:46:11.073 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-30T16:46:11.418 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr. 2023-09-30T16:46:11.445 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:11.484 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:12.639 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mon. 2023-09-30T16:46:12.666 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:12.705 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mon (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-base. 2023-09-30T16:46:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-base (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:13.634 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-osd. 2023-09-30T16:46:13.637 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-30T16:46:13.661 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:13.664 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-30T16:46:13.700 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-osd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:13.705 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-30T16:46:14.008 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cheroot. 2023-09-30T16:46:14.035 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-30T16:46:14.075 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-30T16:46:14.403 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-30T16:46:14.430 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-30T16:46:14.469 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-30T16:46:14.722 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-30T16:46:14.749 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-30T16:46:14.781 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-30T16:46:15.058 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-30T16:46:15.085 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-30T16:46:15.125 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-30T16:46:15.447 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tempora. 2023-09-30T16:46:15.474 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-09-30T16:46:15.645 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph. 2023-09-30T16:46:15.669 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-30T16:46:15.672 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../061-ceph_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:15.712 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:15.972 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-portend. 2023-09-30T16:46:15.999 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-09-30T16:46:16.031 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-fuse. 2023-09-30T16:46:16.039 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-30T16:46:16.059 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:16.283 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-30T16:46:16.310 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-30T16:46:16.342 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-30T16:46:16.460 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mds. 2023-09-30T16:46:16.487 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:16.526 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mds (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:16.644 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-30T16:46:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-30T16:46:16.711 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-30T16:46:16.863 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephadm. 2023-09-30T16:46:16.890 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../064-cephadm_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:16.921 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:17.031 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-natsort. 2023-09-30T16:46:17.047 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-09-30T16:46:17.081 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-30T16:46:17.232 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-30T16:46:17.260 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-30T16:46:17.298 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-30T16:46:17.368 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-logutils. 2023-09-30T16:46:17.394 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-09-30T16:46:17.434 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-30T16:46:17.754 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-30T16:46:17.781 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-30T16:46:17.802 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-30T16:46:17.820 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-30T16:46:17.829 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-30T16:46:17.868 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-30T16:46:18.123 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-mako. 2023-09-30T16:46:18.150 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-30T16:46:18.190 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-30T16:46:18.485 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-30T16:46:18.511 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-30T16:46:18.543 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-30T16:46:18.812 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-30T16:46:18.839 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-30T16:46:18.879 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-30T16:46:18.924 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-babel. 2023-09-30T16:46:18.951 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-30T16:46:18.990 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-30T16:46:19.182 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webob. 2023-09-30T16:46:19.208 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-30T16:46:19.248 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-30T16:46:19.318 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jinja2. 2023-09-30T16:46:19.345 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-09-30T16:46:19.384 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-30T16:46:19.610 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-waitress. 2023-09-30T16:46:19.636 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-30T16:46:19.680 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-30T16:46:19.755 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-30T16:46:19.782 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:19.971 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tempita. 2023-09-30T16:46:19.998 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-30T16:46:20.037 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-30T16:46:20.167 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-30T16:46:20.194 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-30T16:46:20.233 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-30T16:46:20.341 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-paste. 2023-09-30T16:46:20.367 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-30T16:46:20.407 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-30T16:46:20.494 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-30T16:46:20.521 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-09-30T16:46:20.552 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-30T16:46:20.860 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-30T16:46:20.864 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-routes. 2023-09-30T16:46:20.886 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-30T16:46:20.891 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-30T16:46:20.926 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-30T16:46:20.930 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-30T16:46:21.229 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-30T16:46:21.256 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-30T16:46:21.275 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-30T16:46:21.302 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:21.321 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-30T16:46:21.342 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:21.608 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webtest. 2023-09-30T16:46:21.634 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-09-30T16:46:21.674 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-30T16:46:21.753 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-30T16:46:21.770 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-30T16:46:21.803 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-30T16:46:21.977 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pecan. 2023-09-30T16:46:22.003 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-30T16:46:22.043 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-30T16:46:22.316 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-joblib. 2023-09-30T16:46:22.343 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-30T16:46:22.382 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-30T16:46:22.398 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-certifi. 2023-09-30T16:46:22.425 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-09-30T16:46:22.465 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-30T16:46:22.736 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-30T16:46:22.764 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-30T16:46:22.793 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-idna. 2023-09-30T16:46:22.802 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-30T16:46:22.819 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-09-30T16:46:22.859 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-30T16:46:23.112 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-urllib3. 2023-09-30T16:46:23.114 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn. 2023-09-30T16:46:23.127 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-30T16:46:23.142 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-30T16:46:23.162 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-30T16:46:23.180 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-30T16:46:23.440 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-requests. 2023-09-30T16:46:23.467 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-30T16:46:23.498 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-30T16:46:23.793 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-30T16:46:23.820 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-30T16:46:23.859 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-30T16:46:23.956 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-30T16:46:23.984 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:24.022 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:24.137 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-30T16:46:24.153 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:24.187 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:24.551 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-30T16:46:24.577 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:24.617 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:24.895 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-openssl. 2023-09-30T16:46:24.910 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-09-30T16:46:24.925 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cachetools. 2023-09-30T16:46:24.945 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-30T16:46:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-09-30T16:46:24.991 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-30T16:46:25.236 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-30T16:46:25.252 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-30T16:46:25.294 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-30T16:46:25.316 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr. 2023-09-30T16:46:25.342 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:25.381 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:25.589 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-30T16:46:25.617 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-30T16:46:25.647 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-30T16:46:25.784 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mon. 2023-09-30T16:46:25.811 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:25.851 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mon (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:25.917 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rsa. 2023-09-30T16:46:25.945 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-09-30T16:46:25.983 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-30T16:46:26.397 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-google-auth. 2023-09-30T16:46:26.425 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-09-30T16:46:26.463 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-30T16:46:26.663 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-osd. 2023-09-30T16:46:26.690 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:26.729 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-osd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:26.784 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-30T16:46:26.812 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-30T16:46:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-30T16:46:27.120 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-websocket. 2023-09-30T16:46:27.136 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-09-30T16:46:27.170 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-30T16:46:27.481 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-30T16:46:27.509 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-30T16:46:27.548 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-30T16:46:28.179 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-30T16:46:28.195 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:28.228 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:28.531 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-30T16:46:28.559 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-30T16:46:28.599 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph. 2023-09-30T16:46:28.612 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../061-ceph_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:28.623 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-30T16:46:28.649 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:28.984 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-30T16:46:28.986 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-fuse. 2023-09-30T16:46:29.012 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-30T16:46:29.013 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:29.051 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-30T16:46:29.060 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:29.279 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package jq. 2023-09-30T16:46:29.295 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-30T16:46:29.329 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-30T16:46:29.397 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mds. 2023-09-30T16:46:29.424 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:29.464 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mds (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:29.540 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package socat. 2023-09-30T16:46:29.556 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-30T16:46:29.598 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-30T16:46:29.850 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephadm. 2023-09-30T16:46:29.877 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../064-cephadm_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:29.909 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package xmlstarlet. 2023-09-30T16:46:29.916 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:29.937 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-30T16:46:29.976 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-30T16:46:30.236 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-30T16:46:30.263 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-30T16:46:30.297 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-test. 2023-09-30T16:46:30.302 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-30T16:46:30.314 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:30.347 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-test (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:30.605 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-30T16:46:30.621 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-30T16:46:30.664 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-30T16:46:31.711 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-babel. 2023-09-30T16:46:31.738 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-30T16:46:31.777 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-30T16:46:32.105 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jinja2. 2023-09-30T16:46:32.132 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-09-30T16:46:32.172 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-30T16:46:32.508 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-30T16:46:32.535 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:32.575 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:32.684 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-volume. 2023-09-30T16:46:32.712 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:32.751 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-volume (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:32.953 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-30T16:46:32.980 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-30T16:46:33.020 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-30T16:46:33.172 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephfs-mirror. 2023-09-30T16:46:33.200 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:33.298 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-30T16:46:33.325 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-09-30T16:46:33.439 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-30T16:46:33.521 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephfs-mirror (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:33.759 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-routes. 2023-09-30T16:46:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-30T16:46:33.825 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-30T16:46:33.833 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-colorama. 2023-09-30T16:46:33.861 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-09-30T16:46:33.899 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-09-30T16:46:34.171 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-30T16:46:34.197 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:34.202 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephfs-shell. 2023-09-30T16:46:34.230 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:34.237 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:34.277 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephfs-shell (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:34.580 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephfs-top. 2023-09-30T16:46:34.608 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:34.624 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-30T16:46:34.651 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-30T16:46:34.655 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephfs-top (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:34.682 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-30T16:46:34.924 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-30T16:46:34.953 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:34.991 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs-dev (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:35.169 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-joblib. 2023-09-30T16:46:35.197 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-30T16:46:35.235 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-30T16:46:35.386 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package nvme-cli. 2023-09-30T16:46:35.414 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-30T16:46:35.452 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-30T16:46:35.589 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-30T16:46:35.616 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-30T16:46:35.656 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-30T16:46:35.790 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-30T16:46:35.807 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-30T16:46:35.849 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-30T16:46:35.950 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sklearn. 2023-09-30T16:46:35.977 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-30T16:46:36.017 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-30T16:46:36.260 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-30T16:46:36.289 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-30T16:46:36.327 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-30T16:46:36.571 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastescript. 2023-09-30T16:46:36.600 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-09-30T16:46:36.617 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-30T16:46:36.630 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:36.637 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-30T16:46:36.849 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:36.958 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pluggy. 2023-09-30T16:46:36.986 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-30T16:46:37.024 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-30T16:46:37.336 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-psutil. 2023-09-30T16:46:37.364 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-30T16:46:37.402 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-30T16:46:37.781 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-py. 2023-09-30T16:46:37.809 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-09-30T16:46:37.820 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cachetools. 2023-09-30T16:46:37.847 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-30T16:46:37.847 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-09-30T16:46:37.878 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-30T16:46:38.156 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-30T16:46:38.175 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pygments. 2023-09-30T16:46:38.183 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-30T16:46:38.204 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-30T16:46:38.223 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-30T16:46:38.242 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-30T16:46:38.551 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-30T16:46:38.578 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-30T16:46:38.617 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-30T16:46:38.730 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-30T16:46:38.758 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-30T16:46:38.787 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-30T16:46:38.929 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rsa. 2023-09-30T16:46:38.956 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-09-30T16:46:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-30T16:46:39.107 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-toml. 2023-09-30T16:46:39.136 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-09-30T16:46:39.173 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-30T16:46:39.375 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-google-auth. 2023-09-30T16:46:39.402 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-09-30T16:46:39.442 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-30T16:46:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pytest. 2023-09-30T16:46:39.513 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-30T16:46:39.551 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-30T16:46:39.712 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-30T16:46:39.739 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-30T16:46:39.770 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-30T16:46:39.871 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplejson. 2023-09-30T16:46:39.900 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-30T16:46:39.938 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-30T16:46:40.065 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-websocket. 2023-09-30T16:46:40.092 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-09-30T16:46:40.131 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-30T16:46:40.207 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-30T16:46:40.224 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-30T16:46:40.265 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-30T16:46:40.451 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-30T16:46:40.467 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-30T16:46:40.526 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-30T16:46:41.028 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package radosgw. 2023-09-30T16:46:41.057 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../113-radosgw_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:41.094 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking radosgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:41.190 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-30T16:46:41.206 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:41.248 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:41.576 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-30T16:46:41.603 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-30T16:46:41.642 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-30T16:46:41.856 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package rbd-fuse. 2023-09-30T16:46:41.873 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:41.931 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking rbd-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:41.962 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-30T16:46:41.989 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-30T16:46:42.046 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-30T16:46:42.244 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-30T16:46:42.273 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package jq. 2023-09-30T16:46:42.289 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-30T16:46:42.331 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-30T16:46:42.502 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-30T16:46:42.600 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package socat. 2023-09-30T16:46:42.616 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-30T16:46:42.628 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-30T16:46:42.659 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-30T16:46:42.886 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-30T16:46:42.979 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package xmlstarlet. 2023-09-30T16:46:42.995 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-30T16:46:43.037 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-30T16:46:43.240 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-30T16:46:43.401 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-test. 2023-09-30T16:46:43.427 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:43.466 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-test (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:43.695 INFO:teuthology.orchestra.run.smithi052.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-30T16:46:43.805 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:44.315 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user cephadm....done 2023-09-30T16:46:44.445 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-30T16:46:44.721 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-30T16:46:44.972 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-30T16:46:45.098 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-30T16:46:45.349 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-30T16:46:45.601 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-30T16:46:45.727 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-30T16:46:45.745 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-volume. 2023-09-30T16:46:45.772 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:45.811 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-volume (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:46.053 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-30T16:46:46.160 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-mirror. 2023-09-30T16:46:46.187 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:46.226 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-mirror (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:46.414 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-30T16:46:46.487 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-colorama. 2023-09-30T16:46:46.503 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-09-30T16:46:46.546 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-09-30T16:46:46.673 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-09-30T16:46:46.807 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-shell. 2023-09-30T16:46:46.822 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:46.865 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-shell (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:46.933 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-30T16:46:47.126 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-top. 2023-09-30T16:46:47.142 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6447-g1d10b717-1jammy_all.deb ... 2023-09-30T16:46:47.218 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-30T16:46:47.393 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-top (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:47.477 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-30T16:46:47.637 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-30T16:46:47.653 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:47.687 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libcephfs-dev (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:47.736 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-30T16:46:47.990 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package nvme-cli. 2023-09-30T16:46:47.995 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-argparse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:48.017 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-30T16:46:48.056 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-30T16:46:48.255 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-30T16:46:48.381 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-09-30T16:46:48.411 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-30T16:46:48.427 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-30T16:46:48.461 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-30T16:46:48.624 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-30T16:46:48.839 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-30T16:46:48.863 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-30T16:46:48.875 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-30T16:46:48.897 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-30T16:46:48.993 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-30T16:46:49.184 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pastescript. 2023-09-30T16:46:49.211 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-09-30T16:46:49.250 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-30T16:46:49.360 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-30T16:46:49.486 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-30T16:46:49.579 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pluggy. 2023-09-30T16:46:49.606 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-30T16:46:49.645 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-30T16:46:49.762 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-30T16:46:49.957 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-psutil. 2023-09-30T16:46:49.984 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-30T16:46:50.023 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-30T16:46:50.030 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-30T16:46:50.332 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-30T16:46:50.360 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-py. 2023-09-30T16:46:50.387 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-09-30T16:46:50.426 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-30T16:46:50.713 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pygments. 2023-09-30T16:46:50.741 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-30T16:46:50.771 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-30T16:46:51.000 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-30T16:46:51.192 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-30T16:46:51.220 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-30T16:46:51.249 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-30T16:46:51.259 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-30T16:46:51.386 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-30T16:46:51.511 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-30T16:46:51.569 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-toml. 2023-09-30T16:46:51.597 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-09-30T16:46:51.635 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-30T16:46:51.804 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-30T16:46:51.947 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pytest. 2023-09-30T16:46:51.975 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-30T16:46:52.032 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-30T16:46:52.197 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-30T16:46:52.375 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-simplejson. 2023-09-30T16:46:52.403 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-30T16:46:52.440 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-30T16:46:52.441 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-30T16:46:52.736 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-30T16:46:52.752 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-30T16:46:52.794 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-30T16:46:52.834 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-30T16:46:53.151 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-09-30T16:46:53.486 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-30T16:46:53.498 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package radosgw. 2023-09-30T16:46:53.526 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../113-radosgw_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:53.556 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking radosgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:53.854 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-30T16:46:54.105 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-30T16:46:54.231 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:54.301 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package rbd-fuse. 2023-09-30T16:46:54.317 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6447-g1d10b717-1jammy_amd64.deb ... 2023-09-30T16:46:54.351 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking rbd-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:54.524 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-idna (3.3-1) ... 2023-09-30T16:46:54.630 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-30T16:46:54.858 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-30T16:46:54.881 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-30T16:46:54.982 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-30T16:46:55.234 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-30T16:46:55.611 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-30T16:46:56.091 INFO:teuthology.orchestra.run.smithi186.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-30T16:46:56.108 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:46:56.168 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:46:56.242 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-30T16:46:56.526 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-30T16:46:56.669 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-30T16:46:56.795 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-30T16:46:56.804 INFO:teuthology.orchestra.run.smithi186.stdout:Adding system user cephadm....done 2023-09-30T16:46:57.097 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-30T16:46:57.177 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-30T16:46:57.339 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-30T16:46:57.590 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-30T16:46:57.599 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:46:57.725 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-30T16:46:57.851 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-30T16:46:57.931 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-30T16:46:58.062 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-30T16:46:58.160 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-30T16:46:58.329 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-30T16:46:58.420 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-30T16:46:58.581 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-30T16:46:58.679 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-30T16:46:58.706 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-30T16:46:58.922 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-30T16:46:59.017 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-30T16:46:59.165 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-30T16:46:59.377 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-30T16:46:59.449 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-30T16:46:59.575 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-30T16:46:59.662 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-09-30T16:46:59.868 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-30T16:46:59.954 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-30T16:46:59.994 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-30T16:47:00.239 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-30T16:47:00.304 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-30T16:47:00.491 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-30T16:47:00.605 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-30T16:47:00.741 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-30T16:47:00.839 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-30T16:47:01.001 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-ceph-argparse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:01.203 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-30T16:47:01.268 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-30T16:47:01.394 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-09-30T16:47:01.484 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-30T16:47:01.610 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-30T16:47:01.670 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-30T16:47:01.930 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-30T16:47:02.031 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-30T16:47:02.036 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-30T16:47:02.296 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-30T16:47:02.390 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-30T16:47:02.533 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-30T16:47:02.547 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:47:02.648 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-30T16:47:02.949 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-30T16:47:03.076 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-30T16:47:03.250 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-30T16:47:03.385 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-30T16:47:03.526 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-30T16:47:03.652 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-30T16:47:03.720 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-30T16:47:03.936 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-30T16:47:04.371 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-30T16:47:04.538 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-30T16:47:04.614 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-30T16:47:04.740 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-30T16:47:04.780 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-30T16:47:04.866 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-30T16:47:05.149 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-30T16:47:05.193 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-30T16:47:05.458 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-30T16:47:05.585 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-30T16:47:05.819 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-30T16:47:05.853 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-30T16:47:05.945 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librados2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:06.071 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librgw2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:06.221 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-30T16:47:06.274 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:06.400 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:06.514 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-09-30T16:47:06.526 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libradosstriper1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:06.652 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-30T16:47:06.807 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-30T16:47:06.929 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librbd1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:07.030 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-modules-core (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:07.150 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-30T16:47:07.156 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:07.407 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T16:47:07.407 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T16:47:07.426 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-30T16:47:07.577 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:07.912 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-idna (3.3-1) ... 2023-09-30T16:47:07.933 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs-dev (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:08.059 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rados (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:08.185 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephfs-top (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:08.221 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-30T16:47:08.369 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-30T16:47:09.486 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:47:09.582 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rbd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:09.645 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-30T16:47:09.709 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up rbd-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:09.835 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:09.921 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-30T16:47:09.961 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cephfs (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:10.022 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-30T16:47:10.078 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephfs-shell (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:10.123 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-30T16:47:10.188 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:10.424 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-30T16:47:10.692 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-30T16:47:10.739 INFO:teuthology.orchestra.run.smithi052.stdout:Adding group ceph....done 2023-09-30T16:47:10.960 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:47:11.111 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-30T16:47:11.124 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user ceph....done 2023-09-30T16:47:11.275 INFO:teuthology.orchestra.run.smithi052.stdout:Setting system user ceph properties....done 2023-09-30T16:47:11.287 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-30T16:47:11.288 INFO:teuthology.orchestra.run.smithi052.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-30T16:47:11.436 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-30T16:47:11.580 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-30T16:47:11.772 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-30T16:47:11.823 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-30T16:47:12.082 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-30T16:47:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephfs-mirror (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:12.333 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-30T16:47:12.518 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-30T16:47:12.518 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-30T16:47:12.610 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-30T16:47:12.894 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-30T16:47:13.020 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-30T16:47:13.032 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-test (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:13.166 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up radosgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:13.305 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-30T16:47:13.430 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-30T16:47:13.674 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T16:47:13.674 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T16:47:13.723 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-30T16:47:14.049 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-30T16:47:14.168 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-base (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:14.309 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-30T16:47:14.516 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-30T16:47:14.717 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-30T16:47:14.962 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-30T16:47:15.070 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mds (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:15.105 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-30T16:47:15.335 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T16:47:15.335 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T16:47:15.497 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-30T16:47:15.749 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-30T16:47:15.872 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:16.008 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-30T16:47:16.140 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T16:47:16.140 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T16:47:16.143 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-30T16:47:16.494 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-30T16:47:16.665 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-osd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:16.795 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-30T16:47:16.985 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T16:47:16.985 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T16:47:17.079 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-30T16:47:17.197 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-30T16:47:17.473 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-30T16:47:17.533 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:17.659 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:17.749 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-30T16:47:17.810 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mon (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:18.009 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-30T16:47:18.029 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T16:47:18.029 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T16:47:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:18.575 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-30T16:47:18.696 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-dashboard (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:18.923 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-volume (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:18.945 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-30T16:47:19.284 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-30T16:47:19.297 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-30T16:47:19.423 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librados2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:19.532 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librgw2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:19.744 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:19.870 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libcephfs2 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:19.996 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libradosstriper1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:20.122 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-30T16:47:20.378 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-30T16:47:20.407 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librbd1 (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:20.533 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-modules-core (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:20.676 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:20.842 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-30T16:47:20.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-09-30T16:47:20.901 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:47:20.905 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T16:47:20.905 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T16:47:21.090 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2023-09-30T16:47:21.091 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:47:21.259 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:47:21.260 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-30T16:47:21.260 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-30T16:47:21.260 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:47:21.260 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2023-09-30T16:47:21.260 INFO:teuthology.orchestra.run.smithi052.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-09-30T16:47:21.261 INFO:teuthology.orchestra.run.smithi052.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-09-30T16:47:21.261 INFO:teuthology.orchestra.run.smithi052.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-09-30T16:47:21.261 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-09-30T16:47:21.261 INFO:teuthology.orchestra.run.smithi052.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-30T16:47:21.262 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2023-09-30T16:47:21.262 INFO:teuthology.orchestra.run.smithi052.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-09-30T16:47:21.262 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-09-30T16:47:21.263 INFO:teuthology.orchestra.run.smithi052.stdout: libengine-pkcs11-openssl 2023-09-30T16:47:21.301 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2023-09-30T16:47:21.302 INFO:teuthology.orchestra.run.smithi052.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-09-30T16:47:21.302 INFO:teuthology.orchestra.run.smithi052.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-09-30T16:47:21.303 INFO:teuthology.orchestra.run.smithi052.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-09-30T16:47:21.303 INFO:teuthology.orchestra.run.smithi052.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-09-30T16:47:21.303 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-09-30T16:47:21.303 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-09-30T16:47:21.303 INFO:teuthology.orchestra.run.smithi052.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-30T16:47:21.304 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2023-09-30T16:47:21.305 INFO:teuthology.orchestra.run.smithi052.stdout: libssl3 2023-09-30T16:47:21.356 INFO:teuthology.orchestra.run.smithi052.stdout:1 upgraded, 39 newly installed, 0 to remove and 252 not upgraded. 2023-09-30T16:47:21.356 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 54.6 MB of archives. 2023-09-30T16:47:21.357 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 202 MB of additional disk space will be used. 2023-09-30T16:47:21.357 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-09-30T16:47:21.411 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libcephfs-dev (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:21.454 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-09-30T16:47:21.514 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-09-30T16:47:21.530 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-09-30T16:47:21.530 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-09-30T16:47:21.532 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-09-30T16:47:21.534 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-09-30T16:47:21.535 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-09-30T16:47:21.536 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-09-30T16:47:21.537 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rados (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:21.538 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-09-30T16:47:21.538 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-09-30T16:47:21.539 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-09-30T16:47:21.552 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-09-30T16:47:21.671 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-top (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:21.797 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-30T16:47:21.872 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-09-30T16:47:21.874 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-09-30T16:47:21.874 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-09-30T16:47:21.877 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-09-30T16:47:21.877 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-09-30T16:47:21.882 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-09-30T16:47:21.883 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-09-30T16:47:21.892 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-09-30T16:47:21.892 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-09-30T16:47:21.915 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-09-30T16:47:21.915 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-09-30T16:47:21.926 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-09-30T16:47:21.946 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-09-30T16:47:21.949 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-09-30T16:47:21.950 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-09-30T16:47:21.950 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-09-30T16:47:21.951 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-09-30T16:47:21.961 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-09-30T16:47:21.962 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-09-30T16:47:22.158 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-09-30T16:47:22.159 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-09-30T16:47:22.159 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-09-30T16:47:22.159 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-09-30T16:47:22.159 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-09-30T16:47:22.159 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-09-30T16:47:22.170 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-09-30T16:47:22.170 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-09-30T16:47:22.580 INFO:teuthology.orchestra.run.smithi052.stdout:Preconfiguring packages ... 2023-09-30T16:47:22.738 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 54.6 MB in 1s (63.6 MB/s) 2023-09-30T16:47:22.877 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package flex. 2023-09-30T16:47:22.981 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172928 files and directories currently installed.) 2023-09-30T16:47:22.987 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-09-30T16:47:23.033 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking flex (2.6.4-8build2) ... 2023-09-30T16:47:23.043 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rbd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:23.169 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up rbd-fuse (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:23.295 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:23.421 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cephfs (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:23.556 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-shell (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:23.617 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-30T16:47:23.682 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-common (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:23.797 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-09-30T16:47:24.208 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-30T16:47:24.208 INFO:teuthology.orchestra.run.smithi186.stdout:Adding group ceph....done 2023-09-30T16:47:24.593 INFO:teuthology.orchestra.run.smithi186.stdout:Adding system user ceph....done 2023-09-30T16:47:24.749 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package bison. 2023-09-30T16:47:24.770 INFO:teuthology.orchestra.run.smithi186.stdout:Setting system user ceph properties....done 2023-09-30T16:47:24.788 INFO:teuthology.orchestra.run.smithi186.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-30T16:47:24.855 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173001 files and directories currently installed.) 2023-09-30T16:47:24.861 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-09-30T16:47:24.928 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-30T16:47:25.036 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-09-30T16:47:25.309 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-30T16:47:25.726 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-09-30T16:47:25.727 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-09-30T16:47:25.727 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-09-30T16:47:25.814 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package dump. 2023-09-30T16:47:25.842 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-mirror (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:25.843 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-09-30T16:47:25.881 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking dump (0.4b47-3) ... 2023-09-30T16:47:26.176 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package indent. 2023-09-30T16:47:26.204 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:26.243 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-09-30T16:47:26.292 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-30T16:47:26.293 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-30T16:47:26.512 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-09-30T16:47:26.541 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-09-30T16:47:26.578 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-30T16:47:26.827 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-test (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:26.907 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-09-30T16:47:26.935 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-09-30T16:47:26.974 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-30T16:47:26.978 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up radosgw (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:27.193 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-09-30T16:47:27.210 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-09-30T16:47:27.243 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-09-30T16:47:27.469 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T16:47:27.470 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T16:47:27.580 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libfl2:amd64. 2023-09-30T16:47:27.608 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-09-30T16:47:27.646 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:27.907 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-09-30T16:47:27.923 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-09-30T16:47:27.965 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:28.022 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-base (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:28.226 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjson-perl. 2023-09-30T16:47:28.243 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-09-30T16:47:28.284 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-09-30T16:47:28.376 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-30T16:47:28.571 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libllvm14:amd64. 2023-09-30T16:47:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-09-30T16:47:28.637 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-30T16:47:29.153 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mds (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:29.394 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T16:47:29.395 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T16:47:29.955 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:30.183 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T16:47:30.183 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T16:47:30.442 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-09-30T16:47:30.469 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-30T16:47:30.507 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:47:30.756 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-osd (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:30.777 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libmbim-proxy. 2023-09-30T16:47:30.794 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-30T16:47:30.835 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:47:31.077 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T16:47:31.077 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T16:47:31.104 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-09-30T16:47:31.133 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-30T16:47:31.171 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:47:31.632 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libndp0:amd64. 2023-09-30T16:47:31.633 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:31.660 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-09-30T16:47:31.699 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-30T16:47:31.776 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:31.943 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mon (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:32.043 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libnm0:amd64. 2023-09-30T16:47:32.071 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-09-30T16:47:32.110 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-30T16:47:32.170 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T16:47:32.170 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T16:47:32.421 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpq5:amd64. 2023-09-30T16:47:32.438 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:32.471 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:32.678 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-cephadm (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:32.807 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-09-30T16:47:32.829 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:32.835 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:32.873 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:47:32.955 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-dashboard (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:33.106 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-volume (18.0.0-6447-g1d10b717-1jammy) ... 2023-09-30T16:47:33.185 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqmi-proxy. 2023-09-30T16:47:33.201 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:33.243 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:47:33.476 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-30T16:47:33.486 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-09-30T16:47:33.503 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-30T16:47:33.545 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-30T16:47:34.073 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-09-30T16:47:34.102 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-09-30T16:47:34.140 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-09-30T16:47:34.342 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-30T16:47:34.418 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package modemmanager. 2023-09-30T16:47:34.434 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-30T16:47:34.468 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:47:34.825 INFO:teuthology.orchestra.run.smithi186.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-30T16:47:34.828 DEBUG:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-09-30T16:47:34.882 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2023-09-30T16:47:35.066 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2023-09-30T16:47:35.067 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2023-09-30T16:47:35.074 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package network-manager. 2023-09-30T16:47:35.102 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-09-30T16:47:35.230 INFO:teuthology.orchestra.run.smithi186.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-09-30T16:47:35.230 INFO:teuthology.orchestra.run.smithi186.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-30T16:47:35.231 INFO:teuthology.orchestra.run.smithi186.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-30T16:47:35.232 INFO:teuthology.orchestra.run.smithi186.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-09-30T16:47:35.233 INFO:teuthology.orchestra.run.smithi186.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-30T16:47:35.234 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2023-09-30T16:47:35.234 INFO:teuthology.orchestra.run.smithi186.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-09-30T16:47:35.234 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-09-30T16:47:35.234 INFO:teuthology.orchestra.run.smithi186.stdout: libengine-pkcs11-openssl 2023-09-30T16:47:35.272 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2023-09-30T16:47:35.273 INFO:teuthology.orchestra.run.smithi186.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-09-30T16:47:35.273 INFO:teuthology.orchestra.run.smithi186.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-09-30T16:47:35.273 INFO:teuthology.orchestra.run.smithi186.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-09-30T16:47:35.273 INFO:teuthology.orchestra.run.smithi186.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-09-30T16:47:35.273 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-09-30T16:47:35.274 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-09-30T16:47:35.274 INFO:teuthology.orchestra.run.smithi186.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-30T16:47:35.275 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages will be upgraded: 2023-09-30T16:47:35.275 INFO:teuthology.orchestra.run.smithi186.stdout: libssl3 2023-09-30T16:47:35.275 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-09-30T16:47:35.345 INFO:teuthology.orchestra.run.smithi186.stdout:1 upgraded, 39 newly installed, 0 to remove and 252 not upgraded. 2023-09-30T16:47:35.345 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 54.6 MB of archives. 2023-09-30T16:47:35.345 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 202 MB of additional disk space will be used. 2023-09-30T16:47:35.345 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-09-30T16:47:35.459 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-09-30T16:47:35.525 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-09-30T16:47:35.539 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-09-30T16:47:35.540 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-09-30T16:47:35.542 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-09-30T16:47:35.544 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-09-30T16:47:35.545 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-09-30T16:47:35.546 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-09-30T16:47:35.548 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-09-30T16:47:35.548 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-09-30T16:47:35.549 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-09-30T16:47:35.568 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-09-30T16:47:35.900 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-09-30T16:47:35.902 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-09-30T16:47:35.902 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-09-30T16:47:35.905 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-09-30T16:47:35.905 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-09-30T16:47:35.909 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-09-30T16:47:35.911 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-09-30T16:47:35.918 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-09-30T16:47:35.931 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-09-30T16:47:35.953 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-09-30T16:47:35.953 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-09-30T16:47:35.963 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-09-30T16:47:35.983 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-09-30T16:47:35.986 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-09-30T16:47:35.986 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-09-30T16:47:35.987 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-09-30T16:47:35.987 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-09-30T16:47:35.997 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-09-30T16:47:35.998 INFO:teuthology.orchestra.run.smithi186.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-09-30T16:47:36.157 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ppp. 2023-09-30T16:47:36.185 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-09-30T16:47:36.186 INFO:teuthology.orchestra.run.smithi186.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-09-30T16:47:36.225 INFO:teuthology.orchestra.run.smithi186.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-09-30T16:47:36.225 INFO:teuthology.orchestra.run.smithi186.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-09-30T16:47:36.225 INFO:teuthology.orchestra.run.smithi186.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-09-30T16:47:36.226 INFO:teuthology.orchestra.run.smithi186.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-09-30T16:47:36.226 INFO:teuthology.orchestra.run.smithi186.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-09-30T16:47:36.237 INFO:teuthology.orchestra.run.smithi186.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-09-30T16:47:36.238 INFO:teuthology.orchestra.run.smithi186.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-09-30T16:47:36.485 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-09-30T16:47:36.642 INFO:teuthology.orchestra.run.smithi186.stdout:Preconfiguring packages ... 2023-09-30T16:47:36.784 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 54.6 MB in 1s (57.0 MB/s) 2023-09-30T16:47:36.811 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package pptp-linux. 2023-09-30T16:47:36.840 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-09-30T16:47:36.878 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-09-30T16:47:36.925 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package flex. 2023-09-30T16:47:37.026 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172928 files and directories currently installed.) 2023-09-30T16:47:37.032 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-09-30T16:47:37.073 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking flex (2.6.4-8build2) ... 2023-09-30T16:47:37.130 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package network-manager-pptp. 2023-09-30T16:47:37.147 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-09-30T16:47:37.189 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-09-30T16:47:37.458 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql-client-common. 2023-09-30T16:47:37.475 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-09-30T16:47:37.508 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql-client-common (238) ... 2023-09-30T16:47:37.648 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-30T16:47:37.804 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql-client-14. 2023-09-30T16:47:37.820 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-09-30T16:47:37.832 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:37.870 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:38.254 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-30T16:47:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql-common. 2023-09-30T16:47:38.570 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-09-30T16:47:38.627 INFO:teuthology.orchestra.run.smithi052.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-09-30T16:47:38.657 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql-common (238) ... 2023-09-30T16:47:38.757 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package bison. 2023-09-30T16:47:38.858 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173001 files and directories currently installed.) 2023-09-30T16:47:38.864 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-09-30T16:47:38.908 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-09-30T16:47:39.099 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql-14. 2023-09-30T16:47:39.127 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:39.169 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:39.277 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-09-30T16:47:39.303 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-09-30T16:47:39.342 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-09-30T16:47:39.637 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package dump. 2023-09-30T16:47:39.664 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-09-30T16:47:39.703 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking dump (0.4b47-3) ... 2023-09-30T16:47:39.990 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package indent. 2023-09-30T16:47:40.006 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:40.048 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-09-30T16:47:40.309 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-09-30T16:47:40.337 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-09-30T16:47:40.376 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-30T16:47:40.671 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql. 2023-09-30T16:47:40.700 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-09-30T16:47:40.713 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-09-30T16:47:40.737 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql (14+238) ... 2023-09-30T16:47:40.740 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-09-30T16:47:40.779 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-30T16:47:40.981 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql-client. 2023-09-30T16:47:40.998 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-09-30T16:47:41.048 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-09-30T16:47:41.056 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql-client (14+238) ... 2023-09-30T16:47:41.064 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-09-30T16:47:41.106 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-09-30T16:47:41.300 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package postgresql-contrib. 2023-09-30T16:47:41.328 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-09-30T16:47:41.366 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking postgresql-contrib (14+238) ... 2023-09-30T16:47:41.368 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfl2:amd64. 2023-09-30T16:47:41.395 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-09-30T16:47:41.434 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:41.644 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package tcl8.6. 2023-09-30T16:47:41.673 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-09-30T16:47:41.687 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-09-30T16:47:41.702 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-30T16:47:41.703 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-09-30T16:47:41.745 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:42.005 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package tcl. 2023-09-30T16:47:42.031 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libjson-perl. 2023-09-30T16:47:42.034 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-09-30T16:47:42.058 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-09-30T16:47:42.077 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-09-30T16:47:42.097 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-09-30T16:47:42.425 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package wpasupplicant. 2023-09-30T16:47:42.425 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libllvm14:amd64. 2023-09-30T16:47:42.453 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-09-30T16:47:42.453 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-09-30T16:47:42.491 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-30T16:47:42.492 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-30T16:47:42.847 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-09-30T16:47:42.861 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-09-30T16:47:42.906 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-09-30T16:47:43.267 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package usb-modeswitch. 2023-09-30T16:47:43.296 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-09-30T16:47:43.359 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-30T16:47:43.646 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql-client-common (238) ... 2023-09-30T16:47:43.856 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up flex (2.6.4-8build2) ... 2023-09-30T16:47:43.982 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-30T16:47:44.028 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-09-30T16:47:44.056 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-30T16:47:44.094 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:47:44.108 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:44.218 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-09-30T16:47:44.319 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-30T16:47:44.355 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmbim-proxy. 2023-09-30T16:47:44.371 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-30T16:47:44.413 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:47:44.445 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:44.741 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-09-30T16:47:44.769 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-30T16:47:44.808 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:47:44.960 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-09-30T16:47:45.050 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-30T16:47:45.127 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libndp0:amd64. 2023-09-30T16:47:45.154 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-09-30T16:47:45.193 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-30T16:47:45.448 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-30T16:47:45.449 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-30T16:47:45.530 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libnm0:amd64. 2023-09-30T16:47:45.557 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-09-30T16:47:45.596 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-30T16:47:45.953 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-09-30T16:47:45.974 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libpq5:amd64. 2023-09-30T16:47:46.001 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:46.040 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:46.080 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-30T16:47:46.231 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-09-30T16:47:46.357 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-09-30T16:47:46.385 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-09-30T16:47:46.412 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:46.451 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:47:46.483 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:46.609 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-30T16:47:46.718 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-09-30T16:47:46.746 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqmi-proxy. 2023-09-30T16:47:46.773 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:46.804 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:47:47.014 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-09-30T16:47:47.030 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-30T16:47:47.072 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-30T16:47:47.340 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-30T16:47:47.466 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up dump (0.4b47-3) ... 2023-09-30T16:47:47.560 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-09-30T16:47:47.601 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-09-30T16:47:47.626 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:47:47.628 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-09-30T16:47:47.667 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-09-30T16:47:47.752 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-30T16:47:47.878 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up tcl (8.6.11+1build2) ... 2023-09-30T16:47:47.970 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package modemmanager. 2023-09-30T16:47:47.986 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-30T16:47:48.004 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjson-perl (4.04000-1) ... 2023-09-30T16:47:48.020 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:47:48.130 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-09-30T16:47:48.220 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-09-30T16:47:48.273 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-09-30T16:47:48.391 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-30T16:47:48.584 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-30T16:47:48.642 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package network-manager. 2023-09-30T16:47:48.670 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-09-30T16:47:48.710 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:47:48.717 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-09-30T16:47:48.836 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-09-30T16:47:49.012 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql-client (14+238) ... 2023-09-30T16:47:49.130 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-09-30T16:47:49.274 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ppp. 2023-09-30T16:47:49.302 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-09-30T16:47:49.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:47:49.584 INFO:teuthology.orchestra.run.smithi052.stdout:The following network interfaces were found in /etc/network/interfaces 2023-09-30T16:47:49.584 INFO:teuthology.orchestra.run.smithi052.stdout:which means they are currently configured by ifupdown: 2023-09-30T16:47:49.584 INFO:teuthology.orchestra.run.smithi052.stdout:- ens1f0 2023-09-30T16:47:49.584 INFO:teuthology.orchestra.run.smithi052.stdout:If you want to manage those interfaces with NetworkManager instead 2023-09-30T16:47:49.584 INFO:teuthology.orchestra.run.smithi052.stdout:remove their configuration from /etc/network/interfaces. 2023-09-30T16:47:49.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:47:49.585 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-09-30T16:47:49.704 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-09-30T16:47:49.929 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package pptp-linux. 2023-09-30T16:47:49.957 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-09-30T16:47:49.995 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-09-30T16:47:50.020 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-09-30T16:47:50.248 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package network-manager-pptp. 2023-09-30T16:47:50.264 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-09-30T16:47:50.306 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-09-30T16:47:50.367 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-09-30T16:47:50.567 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-client-common. 2023-09-30T16:47:50.583 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-09-30T16:47:50.618 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-client-common (238) ... 2023-09-30T16:47:50.887 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-client-14. 2023-09-30T16:47:50.915 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:50.932 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:47:50.954 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:51.067 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:51.177 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-09-30T16:47:51.533 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-common. 2023-09-30T16:47:51.536 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql-common (238) ... 2023-09-30T16:47:51.561 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-09-30T16:47:51.619 INFO:teuthology.orchestra.run.smithi186.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-09-30T16:47:51.648 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-common (238) ... 2023-09-30T16:47:52.141 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-14. 2023-09-30T16:47:52.168 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-30T16:47:52.211 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:52.533 INFO:teuthology.orchestra.run.smithi052.stdout:Adding user postgres to group ssl-cert 2023-09-30T16:47:52.738 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:47:52.738 INFO:teuthology.orchestra.run.smithi052.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-09-30T16:47:53.002 INFO:teuthology.orchestra.run.smithi052.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-09-30T16:47:53.003 INFO:teuthology.orchestra.run.smithi052.stdout:Removing obsolete dictionary files: 2023-09-30T16:47:53.485 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql. 2023-09-30T16:47:53.514 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-09-30T16:47:53.559 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql (14+238) ... 2023-09-30T16:47:53.572 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-09-30T16:47:53.829 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-client. 2023-09-30T16:47:53.857 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-09-30T16:47:53.895 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-client (14+238) ... 2023-09-30T16:47:53.980 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:54.139 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-contrib. 2023-09-30T16:47:54.167 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-09-30T16:47:54.214 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-contrib (14+238) ... 2023-09-30T16:47:54.314 INFO:teuthology.orchestra.run.smithi052.stdout:Creating new PostgreSQL cluster 14/main ... 2023-09-30T16:47:54.327 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-09-30T16:47:54.372 INFO:teuthology.orchestra.run.smithi052.stdout:The files belonging to this database system will be owned by user "postgres". 2023-09-30T16:47:54.372 INFO:teuthology.orchestra.run.smithi052.stdout:This user must also own the server process. 2023-09-30T16:47:54.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:The database cluster will be initialized with locale "en_US". 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:The default text search configuration will be set to "english". 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:Data page checksums are disabled. 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:creating subdirectories ... ok 2023-09-30T16:47:54.373 INFO:teuthology.orchestra.run.smithi052.stdout:selecting dynamic shared memory implementation ... posix 2023-09-30T16:47:54.389 INFO:teuthology.orchestra.run.smithi052.stdout:selecting default max_connections ... 100 2023-09-30T16:47:54.411 INFO:teuthology.orchestra.run.smithi052.stdout:selecting default shared_buffers ... 128MB 2023-09-30T16:47:54.420 INFO:teuthology.orchestra.run.smithi052.stdout:selecting default time zone ... Etc/UTC 2023-09-30T16:47:54.421 INFO:teuthology.orchestra.run.smithi052.stdout:creating configuration files ... ok 2023-09-30T16:47:54.533 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package tcl8.6. 2023-09-30T16:47:54.539 INFO:teuthology.orchestra.run.smithi052.stdout:running bootstrap script ... ok 2023-09-30T16:47:54.561 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-09-30T16:47:54.600 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-30T16:47:54.944 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package tcl. 2023-09-30T16:47:54.972 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-09-30T16:47:55.023 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-09-30T16:47:55.182 INFO:teuthology.orchestra.run.smithi052.stdout:performing post-bootstrap initialization ... ok 2023-09-30T16:47:55.372 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package wpasupplicant. 2023-09-30T16:47:55.400 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-09-30T16:47:55.438 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-30T16:47:55.792 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-09-30T16:47:55.821 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-09-30T16:47:55.859 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-09-30T16:47:55.874 INFO:teuthology.orchestra.run.smithi052.stdout:syncing data to disk ... ok 2023-09-30T16:47:56.265 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-09-30T16:47:56.321 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package usb-modeswitch. 2023-09-30T16:47:56.349 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-09-30T16:47:56.404 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-30T16:47:56.715 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-client-common (238) ... 2023-09-30T16:47:56.901 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up flex (2.6.4-8build2) ... 2023-09-30T16:47:57.027 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-30T16:47:57.261 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:57.413 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-09-30T16:47:57.539 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-30T16:47:57.665 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:47:58.135 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-09-30T16:47:58.220 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-30T16:47:58.589 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-30T16:47:58.589 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-30T16:47:59.045 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:47:59.106 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-09-30T16:47:59.213 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql-contrib (14+238) ... 2023-09-30T16:47:59.232 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-30T16:47:59.339 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up postgresql (14+238) ... 2023-09-30T16:47:59.358 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-09-30T16:47:59.465 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:47:59.484 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-09-30T16:47:59.591 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:47:59.713 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-09-30T16:47:59.851 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-09-30T16:47:59.851 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-09-30T16:48:00.127 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-30T16:48:00.229 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-09-30T16:48:00.460 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-09-30T16:48:00.763 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-30T16:48:00.867 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-30T16:48:00.906 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-30T16:48:00.993 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up dump (0.4b47-3) ... 2023-09-30T16:48:01.087 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-09-30T16:48:01.161 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:48:01.262 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-30T16:48:01.373 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up tcl (8.6.11+1build2) ... 2023-09-30T16:48:01.497 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libjson-perl (4.04000-1) ... 2023-09-30T16:48:01.624 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-09-30T16:48:01.713 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-09-30T16:48:01.783 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-09-30T16:48:01.909 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-30T16:48:02.085 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-30T16:48:02.195 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:48:02.296 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-09-30T16:48:02.447 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-client (14+238) ... 2023-09-30T16:48:02.573 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-09-30T16:48:02.617 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-09-30T16:48:02.717 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-30T16:48:03.073 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:03.073 INFO:teuthology.orchestra.run.smithi186.stdout:The following network interfaces were found in /etc/network/interfaces 2023-09-30T16:48:03.073 INFO:teuthology.orchestra.run.smithi186.stdout:which means they are currently configured by ifupdown: 2023-09-30T16:48:03.073 INFO:teuthology.orchestra.run.smithi186.stdout:- enp3s0f1 2023-09-30T16:48:03.073 INFO:teuthology.orchestra.run.smithi186.stdout:If you want to manage those interfaces with NetworkManager instead 2023-09-30T16:48:03.073 INFO:teuthology.orchestra.run.smithi186.stdout:remove their configuration from /etc/network/interfaces. 2023-09-30T16:48:03.074 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:03.196 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-09-30T16:48:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-30T16:48:03.370 DEBUG:teuthology.parallel:result is None 2023-09-30T16:48:03.509 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-09-30T16:48:03.836 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-09-30T16:48:04.375 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-30T16:48:04.518 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-30T16:48:04.636 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-09-30T16:48:04.746 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-common (238) ... 2023-09-30T16:48:05.878 INFO:teuthology.orchestra.run.smithi186.stdout:Adding user postgres to group ssl-cert 2023-09-30T16:48:06.108 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:06.108 INFO:teuthology.orchestra.run.smithi186.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-09-30T16:48:06.303 INFO:teuthology.orchestra.run.smithi186.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-09-30T16:48:06.303 INFO:teuthology.orchestra.run.smithi186.stdout:Removing obsolete dictionary files: 2023-09-30T16:48:06.902 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-09-30T16:48:07.297 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-30T16:48:07.622 INFO:teuthology.orchestra.run.smithi186.stdout:Creating new PostgreSQL cluster 14/main ... 2023-09-30T16:48:07.655 INFO:teuthology.orchestra.run.smithi186.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-09-30T16:48:07.700 INFO:teuthology.orchestra.run.smithi186.stdout:The files belonging to this database system will be owned by user "postgres". 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout:This user must also own the server process. 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout:The database cluster will be initialized with locale "en_US". 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout:The default text search configuration will be set to "english". 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout:Data page checksums are disabled. 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:07.701 INFO:teuthology.orchestra.run.smithi186.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-09-30T16:48:07.702 INFO:teuthology.orchestra.run.smithi186.stdout:creating subdirectories ... ok 2023-09-30T16:48:07.702 INFO:teuthology.orchestra.run.smithi186.stdout:selecting dynamic shared memory implementation ... posix 2023-09-30T16:48:07.713 INFO:teuthology.orchestra.run.smithi186.stdout:selecting default max_connections ... 100 2023-09-30T16:48:07.733 INFO:teuthology.orchestra.run.smithi186.stdout:selecting default shared_buffers ... 128MB 2023-09-30T16:48:07.742 INFO:teuthology.orchestra.run.smithi186.stdout:selecting default time zone ... Etc/UTC 2023-09-30T16:48:07.744 INFO:teuthology.orchestra.run.smithi186.stdout:creating configuration files ... ok 2023-09-30T16:48:07.854 INFO:teuthology.orchestra.run.smithi186.stdout:running bootstrap script ... ok 2023-09-30T16:48:08.498 INFO:teuthology.orchestra.run.smithi186.stdout:performing post-bootstrap initialization ... ok 2023-09-30T16:48:09.194 INFO:teuthology.orchestra.run.smithi186.stdout:syncing data to disk ... ok 2023-09-30T16:48:09.597 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-09-30T16:48:12.470 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:48:12.571 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-contrib (14+238) ... 2023-09-30T16:48:12.705 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql (14+238) ... 2023-09-30T16:48:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-30T16:48:12.957 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-30T16:48:13.208 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-09-30T16:48:13.209 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-09-30T16:48:13.784 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-09-30T16:48:14.103 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-30T16:48:14.246 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-30T16:48:15.583 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-09-30T16:48:15.674 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-30T16:48:16.299 INFO:teuthology.orchestra.run.smithi186.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-30T16:48:16.302 DEBUG:teuthology.parallel:result is None 2023-09-30T16:48:16.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:48:16.530 DEBUG:teuthology.orchestra.run.smithi052:> dpkg-query -W -f '${Version}' ceph 2023-09-30T16:48:16.551 INFO:teuthology.orchestra.run.smithi052.stdout:18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:48:16.551 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:48:16.552 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447-g1d10b717-1jammy is installed. 2023-09-30T16:48:16.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:48:16.773 DEBUG:teuthology.orchestra.run.smithi186:> dpkg-query -W -f '${Version}' ceph 2023-09-30T16:48:16.792 INFO:teuthology.orchestra.run.smithi186.stdout:18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:48:16.793 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447-g1d10b717-1jammy 2023-09-30T16:48:16.793 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447-g1d10b717-1jammy is installed. 2023-09-30T16:48:16.793 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T16:48:16.793 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:16.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T16:48:16.809 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:16.809 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T16:48:16.847 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T16:48:16.848 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:16.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T16:48:16.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T16:48:16.917 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:16.917 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T16:48:16.929 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T16:48:16.981 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T16:48:16.981 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:16.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T16:48:16.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T16:48:17.049 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:17.049 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T16:48:17.062 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T16:48:17.117 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T16:48:17.118 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:17.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T16:48:17.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T16:48:17.185 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:17.185 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T16:48:17.198 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T16:48:17.254 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T16:48:17.320 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T16:48:17.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2023-09-30T16:48:17.323 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2023-09-30T16:48:17.335 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T16:48:17.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T16:48:17.379 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T16:48:17.391 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T16:48:17.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T16:48:17.435 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T16:48:17.453 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-30T16:48:17.453 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-30T16:48:17.453 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-30T16:48:17.453 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:17.453 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T16:48:17.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T16:48:17.574 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:17.575 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T16:48:17.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T16:48:17.658 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T16:48:17.658 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T16:48:17.659 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7407730', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 76, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6478, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGD436M5Ty9dDMIwQ7esDJkIQCZqPlzlGNDRUlgFNRa8D++SsX2sM3edKHZ/rVVXVSYtTTQgN7ZWXFbrLSD5XKM=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDn7UywDQ3uhw9l7ZD9Zdso+5lkx1klRS/WKecYsEZmvSmu4ZcGJuleqa0STMMV42lZn/Q7210K6VMk9PNaFbTo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_19:46:13', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T16:48:17.659 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T16:48:17.662 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T16:48:17.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T16:48:17.711 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T16:48:17.754 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:17.754 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T16:48:17.774 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T16:48:17.774 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2023-09-30T16:48:17.822 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T16:48:17.822 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:17.822 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 882 Links: 1 2023-09-30T16:48:17.822 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:17.823 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-09-30 16:42:03.903576172 +0000 2023-09-30T16:48:17.823 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-09-30 16:42:03.503579745 +0000 2023-09-30T16:48:17.823 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-09-30 16:42:03.503579745 +0000 2023-09-30T16:48:17.823 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-09-30T16:48:17.823 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T16:48:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-09-30T16:48:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-09-30T16:48:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000325048 s, 1.6 MB/s 2023-09-30T16:48:17.878 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T16:48:17.927 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2023-09-30T16:48:17.978 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T16:48:17.978 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:17.978 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-09-30T16:48:17.978 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:17.978 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-09-30 16:42:04.139574064 +0000 2023-09-30T16:48:17.978 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-09-30 16:42:04.135574100 +0000 2023-09-30T16:48:17.979 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-09-30 16:42:04.135574100 +0000 2023-09-30T16:48:17.979 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-09-30T16:48:17.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T16:48:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-09-30T16:48:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-09-30T16:48:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000205155 s, 2.5 MB/s 2023-09-30T16:48:18.034 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T16:48:18.083 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-09-30 16:42:05.155564989 +0000 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-09-30 16:42:04.747568633 +0000 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-09-30 16:42:04.747568633 +0000 2023-09-30T16:48:18.130 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-09-30T16:48:18.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T16:48:18.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-09-30T16:48:18.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-09-30T16:48:18.185 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000294608 s, 1.7 MB/s 2023-09-30T16:48:18.186 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T16:48:18.235 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2023-09-30T16:48:18.282 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T16:48:18.282 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:18.282 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 933 Links: 1 2023-09-30T16:48:18.283 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:18.283 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-09-30 16:42:05.763559558 +0000 2023-09-30T16:48:18.283 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-09-30 16:42:05.387562915 +0000 2023-09-30T16:48:18.283 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-09-30 16:42:05.387562915 +0000 2023-09-30T16:48:18.283 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-09-30T16:48:18.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T16:48:18.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-09-30T16:48:18.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-09-30T16:48:18.337 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000304915 s, 1.7 MB/s 2023-09-30T16:48:18.338 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T16:48:18.387 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:18.387 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:18.387 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T16:48:18.393 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T16:48:18.393 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2023-09-30T16:48:18.439 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T16:48:18.439 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:18.439 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 870 Links: 1 2023-09-30T16:48:18.439 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:18.439 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-09-30 16:41:59.652407950 +0000 2023-09-30T16:48:18.439 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-09-30 16:41:59.312410983 +0000 2023-09-30T16:48:18.440 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-09-30 16:41:59.312410983 +0000 2023-09-30T16:48:18.440 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-09-30T16:48:18.440 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T16:48:18.493 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-09-30T16:48:18.493 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-09-30T16:48:18.493 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000442546 s, 1.2 MB/s 2023-09-30T16:48:18.494 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T16:48:18.544 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2023-09-30T16:48:18.594 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T16:48:18.594 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:18.594 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 893 Links: 1 2023-09-30T16:48:18.595 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:18.595 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-09-30 16:42:00.244402669 +0000 2023-09-30T16:48:18.595 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-09-30 16:41:59.892405808 +0000 2023-09-30T16:48:18.595 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-09-30 16:41:59.892405808 +0000 2023-09-30T16:48:18.595 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-09-30T16:48:18.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T16:48:18.649 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-09-30T16:48:18.650 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-09-30T16:48:18.650 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000418531 s, 1.2 MB/s 2023-09-30T16:48:18.651 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T16:48:18.699 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2023-09-30T16:48:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-09-30 16:42:00.816397566 +0000 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-09-30 16:42:00.476400599 +0000 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-09-30 16:42:00.476400599 +0000 2023-09-30T16:48:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-09-30T16:48:18.747 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T16:48:18.801 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-09-30T16:48:18.801 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-09-30T16:48:18.801 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000404833 s, 1.3 MB/s 2023-09-30T16:48:18.802 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T16:48:18.851 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2023-09-30T16:48:18.899 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T16:48:18.899 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T16:48:18.899 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 925 Links: 1 2023-09-30T16:48:18.899 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T16:48:18.900 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-09-30 16:42:01.388392463 +0000 2023-09-30T16:48:18.900 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-09-30 16:42:01.048395496 +0000 2023-09-30T16:48:18.900 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-09-30 16:42:01.048395496 +0000 2023-09-30T16:48:18.900 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-09-30T16:48:18.900 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T16:48:18.952 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-09-30T16:48:18.952 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-09-30T16:48:18.952 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000273055 s, 1.9 MB/s 2023-09-30T16:48:18.953 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T16:48:19.000 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:19.000 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-30T16:48:19.000 INFO:tasks.ceph:Generating config... 2023-09-30T16:48:19.001 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T16:48:19.001 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T16:48:19.001 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T16:48:19.001 INFO:tasks.ceph:[client] pid file = 2023-09-30T16:48:19.001 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T16:48:19.001 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T16:48:19.002 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T16:48:19.003 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T16:48:19.003 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T16:48:19.003 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T16:48:19.003 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T16:48:19.003 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T16:48:19.003 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-30T16:48:19.003 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T16:48:19.004 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T16:48:19.004 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T16:48:19.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T16:48:19.039 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T16:48:19.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T16:48:19.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T16:48:19.194 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '172.21.15.186'), ('mon.c', '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]')] 2023-09-30T16:48:19.194 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T16:48:19.195 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:19.195 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T16:48:19.242 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --add b 172.21.15.186 --addv c '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:19.329 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:19.329 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid a2b00988-da85-4e26-9767-73ee6224a074 2023-09-30T16:48:19.329 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = pacific 2023-09-30T16:48:19.329 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:fsid a2b00988-da85-4e26-9767-73ee6224a074 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2023-09-30T16:48:19.330750+0000 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:created 2023-09-30T16:48:19.330750+0000 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 16 (pacific) 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] mon.c 2023-09-30T16:48:19.330 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T16:48:19.331 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T16:48:19.378 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a2b00988-da85-4e26-9767-73ee6224a074... 2023-09-30T16:48:19.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T16:48:19.423 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T16:48:19.451 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.452 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.453 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2023-09-30T16:48:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2023-09-30T16:48:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = a2b00988-da85-4e26-9767-73ee6224a074 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2023-09-30T16:48:19.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2023-09-30T16:48:19.457 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.458 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2023-09-30T16:48:19.459 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2023-09-30T16:48:19.460 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-09-30T16:48:19.461 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2023-09-30T16:48:19.462 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.463 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2023-09-30T16:48:19.464 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = "" 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2023-09-30T16:48:19.465 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2023-09-30T16:48:19.466 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2023-09-30T16:48:19.467 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2023-09-30T16:48:19.467 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2023-09-30T16:48:19.467 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2023-09-30T16:48:19.468 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2023-09-30T16:48:19.468 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2023-09-30T16:48:19.468 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2023-09-30T16:48:19.469 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2023-09-30T16:48:19.470 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.471 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.52,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = a2b00988-da85-4e26-9767-73ee6224a074 2023-09-30T16:48:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2023-09-30T16:48:19.473 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2023-09-30T16:48:19.474 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: bdev async discard = True 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: bdev enable discard = True 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore allocator = bitmap 2023-09-30T16:48:19.475 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 1/20 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 1/20 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 4/10 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2023-09-30T16:48:19.476 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.477 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2023-09-30T16:48:19.478 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2023-09-30T16:48:19.479 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: mon op complaint time = 120 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: client mount timeout = 600 2023-09-30T16:48:19.480 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = "" 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2023-09-30T16:48:19.481 INFO:teuthology.orchestra.run.smithi186.stdout:[mds] 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds = 20 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds balancer = 20 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug frag = True 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug scatterstat = True 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: mds op complaint time = 180 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: mds verify scatter = True 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2023-09-30T16:48:19.482 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2023-09-30T16:48:19.483 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T16:48:19.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T16:48:19.558 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T16:48:19.559 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:19.559 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T16:48:19.565 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:19.565 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T16:48:19.609 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:48:19.609 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:19.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T16:48:19.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T16:48:19.677 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:19.677 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:19.730 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:48:19.730 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:19.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T16:48:19.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T16:48:19.753 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:19.754 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:19.803 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T16:48:19.803 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T16:48:19.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T16:48:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T16:48:19.852 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T16:48:19.895 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T16:48:19.907 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T16:48:19.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T16:48:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T16:48:19.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T16:48:20.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T16:48:20.086 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T16:48:20.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-30T16:48:20.140 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T16:48:20.184 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T16:48:20.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-30T16:48:20.242 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-30T16:48:20.329 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-30T16:48:20.330 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-30T16:48:20.385 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T16:48:20.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T16:48:20.423 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T16:48:20.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-30T16:48:20.510 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-30T16:48:20.520 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-30T16:48:20.556 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-30T16:48:20.567 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-30T16:48:20.645 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-30T16:48:20.655 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T16:48:20.655 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-30T16:48:20.655 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T16:48:20.670 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:20.670 INFO:tasks.ceph:role: osd.0 2023-09-30T16:48:20.670 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:48:20.670 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:20.727 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:20.750 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-09-30T16:48:20.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-09-30T16:48:20.752 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T16:48:20.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T16:48:20.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:20.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T16:48:20.919 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:20.920 INFO:tasks.ceph:role: osd.1 2023-09-30T16:48:20.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:48:20.920 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T16:48:20.978 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:20.978 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:20.978 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:20.978 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:20.978 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:20.979 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:20.979 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:20.979 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:20.979 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:20.979 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:21.001 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-09-30T16:48:21.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-09-30T16:48:21.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T16:48:21.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T16:48:21.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:21.116 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T16:48:21.169 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:21.169 INFO:tasks.ceph:role: osd.2 2023-09-30T16:48:21.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:48:21.170 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:21.226 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:21.227 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:21.249 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-09-30T16:48:21.251 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-09-30T16:48:21.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T16:48:21.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T16:48:21.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:21.366 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:21.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T16:48:21.419 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:21.419 INFO:tasks.ceph:role: osd.3 2023-09-30T16:48:21.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:48:21.419 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T16:48:21.472 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:21.472 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:21.472 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:21.472 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:21.473 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:21.473 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:21.473 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:21.473 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:21.473 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:21.473 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:21.496 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-09-30T16:48:21.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-09-30T16:48:21.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T16:48:21.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T16:48:21.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:21.607 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:21.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:21.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:21.708+0000 7fb7926ea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T16:48:21.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:21.708+0000 7fb7926ea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T16:48:21.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:21.708+0000 7fb7926ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T16:48:21.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:21.708+0000 7fb7926ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T16:48:21.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:21.708+0000 7fb7926ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T16:48:21.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:21.708+0000 7fb7926ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T16:48:24.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T16:48:24.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:24.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:24.812+0000 7fe7f77f3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T16:48:24.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:24.812+0000 7fe7f77f3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T16:48:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:24.812+0000 7fe7f77f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T16:48:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:24.812+0000 7fe7f77f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T16:48:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:24.812+0000 7fe7f77f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T16:48:24.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:24.812+0000 7fe7f77f3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T16:48:27.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T16:48:27.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:27.976+0000 7f7a2db1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T16:48:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:27.976+0000 7f7a2db1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T16:48:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:27.976+0000 7f7a2db1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T16:48:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:27.976+0000 7f7a2db1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T16:48:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:27.976+0000 7f7a2db1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T16:48:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:27.976+0000 7f7a2db1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T16:48:30.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T16:48:31.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:31.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:31.120+0000 7f74d0784640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T16:48:31.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:31.120+0000 7f74d0784640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T16:48:31.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:31.120+0000 7f74d0784640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T16:48:31.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:31.120+0000 7f74d0784640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T16:48:31.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:31.120+0000 7f74d0784640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T16:48:31.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:31.120+0000 7f74d0784640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T16:48:34.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T16:48:34.183 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-30T16:48:34.197 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:34.197 INFO:tasks.ceph:role: osd.4 2023-09-30T16:48:34.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:48:34.198 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T16:48:34.261 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:34.262 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:34.717 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-09-30T16:48:34.720 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-09-30T16:48:34.720 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-30T16:48:34.824 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-30T16:48:34.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:34.834 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:34.834 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-30T16:48:34.887 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:34.888 INFO:tasks.ceph:role: osd.5 2023-09-30T16:48:34.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:48:34.888 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T16:48:34.949 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:34.949 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:34.949 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:34.949 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:34.949 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:34.950 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:34.950 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:34.950 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:34.950 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:34.950 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:35.409 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-09-30T16:48:35.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-09-30T16:48:35.411 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-30T16:48:35.535 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-30T16:48:35.546 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:35.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:35.547 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-30T16:48:35.601 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:35.601 INFO:tasks.ceph:role: osd.6 2023-09-30T16:48:35.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:48:35.601 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T16:48:35.661 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:35.661 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:35.661 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:35.661 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:35.662 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:35.662 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:35.662 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:35.662 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:35.662 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:35.662 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:36.144 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-09-30T16:48:36.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-09-30T16:48:36.146 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-30T16:48:36.307 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-30T16:48:36.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:36.319 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:36.320 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-30T16:48:36.373 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T16:48:36.373 INFO:tasks.ceph:role: osd.7 2023-09-30T16:48:36.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:48:36.373 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T16:48:36.441 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T16:48:36.891 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2023-09-30T16:48:36.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2023-09-30T16:48:36.894 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-30T16:48:37.001 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-30T16:48:37.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:48:37.011 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T16:48:37.012 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:37.143 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:37.140+0000 7f6cd3c90640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-30T16:48:37.146 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:37.140+0000 7f6cd3c90640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-30T16:48:37.146 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:37.140+0000 7f6cd3c90640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-30T16:48:37.146 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:37.144+0000 7f6cd3c90640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-30T16:48:37.146 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:37.144+0000 7f6cd3c90640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-30T16:48:37.148 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:37.144+0000 7f6cd3c90640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-30T16:48:40.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-30T16:48:40.163 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:40.250 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:40.248+0000 7f4f5f720640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-30T16:48:40.250 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:40.248+0000 7f4f5f720640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-30T16:48:40.251 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:40.248+0000 7f4f5f720640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-30T16:48:40.251 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:40.248+0000 7f4f5f720640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-30T16:48:40.251 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:40.248+0000 7f4f5f720640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-30T16:48:40.251 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:40.248+0000 7f4f5f720640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-30T16:48:43.256 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-30T16:48:43.311 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:43.394 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:43.392+0000 7f995ccde640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-30T16:48:43.395 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:43.392+0000 7f995ccde640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-30T16:48:43.395 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:43.392+0000 7f995ccde640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-30T16:48:43.395 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:43.392+0000 7f995ccde640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-30T16:48:43.395 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:43.392+0000 7f995ccde640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-30T16:48:43.395 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:43.392+0000 7f995ccde640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-30T16:48:46.398 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-30T16:48:46.455 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:46.538 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:46.536+0000 7f1948b0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-30T16:48:46.539 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:46.536+0000 7f1948b0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-30T16:48:46.539 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:46.536+0000 7f1948b0e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-30T16:48:46.539 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:46.536+0000 7f1948b0e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-30T16:48:46.539 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:46.536+0000 7f1948b0e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-30T16:48:46.540 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:46.536+0000 7f1948b0e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-30T16:48:47.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:48:47.663 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:48:49.530 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-30T16:48:49.543 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T16:48:49.543 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-30T16:48:49.558 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T16:48:49.614 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-30T16:48:49.670 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T16:48:49.729 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T16:48:49.785 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T16:48:49.841 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:49.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T16:48:49.897 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:49.897 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T16:48:49.911 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:49.911 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-30T16:48:49.965 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:49.965 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-30T16:48:50.018 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:50.019 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-30T16:48:50.073 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:50.073 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-30T16:48:50.124 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:50.125 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-30T16:48:50.177 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:50.178 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-30T16:48:50.232 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:50.233 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T16:48:50.239 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:50.239 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-30T16:48:50.286 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:50.286 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-30T16:48:50.291 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:50.291 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-30T16:48:50.338 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T16:48:50.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T16:48:50.341 DEBUG:teuthology.orchestra.run.smithi186:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T16:48:50.384 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2023-09-30T16:48:50.384 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBTURhl3LKvMhAAaPbgkLUy0hbxMYBmQzNvLw== 2023-09-30T16:48:50.384 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2023-09-30T16:48:50.384 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBTURhlXRaoOBAA4OsdcwfzQ6TRgKnkPFw8fg== 2023-09-30T16:48:50.384 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlYhQ6BRAAjcxNocgMeO2At3dDSmHoJA== 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBVURhliVpuKhAAhqJT0C8OjiFRXJ3WHLdj8g== 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBYURhlB/2ZMBAAFR0D+2WKjvpnnk8/t91Afg== 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBbURhlah56OhAA7myUoXVTQuAjLRcVKNv6TA== 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBfURhlmapXBxAADalkrnvqRAuZoB7PZofd7g== 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBTURhlCT9mNRAAVG0MiOh7eFxk2dzgAqmK7A== 2023-09-30T16:48:50.385 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlLSkJCxAAekDf4/3rIF068rsj4bAQBQ== 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlYxGUExAAmDxOY0ir/1zk8GkVuTx5RA== 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBlURhl4S+QCBAASbBYsh8ah+NLx8Y8/r9s/g== 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBoURhlmzH0DhAANPlmSxwwPWBPV51OCp2gAA== 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBrURhlgHmNFxAAoAo/AtD5BOEigPk0bBy4Tw== 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBuURhlXwMpIBAANy3nHQkGr5uM5NyhEThJtg== 2023-09-30T16:48:50.386 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlmBlVGRAAbcs+tyuczQOq3IgP2hhLGQ== 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout:[client.2] 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlwX+CHhAA8F7r+ECFV7p57Y5HITGhlw== 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlnpc1IRAAnHCP3xCaYWs2EbcChdHl7A== 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout:[client.3] 2023-09-30T16:48:50.387 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlukCBJhAANMDGVTlYTvMDcJ6dbYgSDg== 2023-09-30T16:48:50.393 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.y] 2023-09-30T16:48:50.393 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBTURhl3LKvMhAAaPbgkLUy0hbxMYBmQzNvLw== 2023-09-30T16:48:50.393 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2023-09-30T16:48:50.393 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBTURhlXRaoOBAA4OsdcwfzQ6TRgKnkPFw8fg== 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlYhQ6BRAAjcxNocgMeO2At3dDSmHoJA== 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.0] 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBVURhliVpuKhAAhqJT0C8OjiFRXJ3WHLdj8g== 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.1] 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBYURhlB/2ZMBAAFR0D+2WKjvpnnk8/t91Afg== 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.2] 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBbURhlah56OhAA7myUoXVTQuAjLRcVKNv6TA== 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.3] 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBfURhlmapXBxAADalkrnvqRAuZoB7PZofd7g== 2023-09-30T16:48:50.394 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBTURhlCT9mNRAAVG0MiOh7eFxk2dzgAqmK7A== 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlLSkJCxAAekDf4/3rIF068rsj4bAQBQ== 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlYxGUExAAmDxOY0ir/1zk8GkVuTx5RA== 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBlURhl4S+QCBAASbBYsh8ah+NLx8Y8/r9s/g== 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBoURhlmzH0DhAANPlmSxwwPWBPV51OCp2gAA== 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBrURhlgHmNFxAAoAo/AtD5BOEigPk0bBy4Tw== 2023-09-30T16:48:50.395 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBuURhlXwMpIBAANy3nHQkGr5uM5NyhEThJtg== 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlmBlVGRAAbcs+tyuczQOq3IgP2hhLGQ== 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout:[client.2] 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlwX+CHhAA8F7r+ECFV7p57Y5HITGhlw== 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout:[client.1] 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlnpc1IRAAnHCP3xCaYWs2EbcChdHl7A== 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout:[client.3] 2023-09-30T16:48:50.396 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBUURhlukCBJhAANMDGVTlYTvMDcJ6dbYgSDg== 2023-09-30T16:48:50.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T16:48:50.431 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T16:48:50.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:50.490 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:50.535 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:50.537 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:50.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.626 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.705 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.714 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.786 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:50.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T16:48:50.958 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T16:48:51.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:51.043 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:51.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:51.119 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T16:48:51.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.207 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.291 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.375 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.421 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T16:48:51.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.506 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.594 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.683 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.728 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T16:48:51.816 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T16:48:51.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T16:48:51.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T16:48:51.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T16:48:51.934 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T16:48:51.948 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T16:48:52.044 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T16:48:52.055 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T16:48:52.107 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T16:48:52.204 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T16:48:52.214 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:52.217 DEBUG:teuthology.orchestra.run.smithi186:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T16:48:52.261 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T16:48:52.262 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T16:48:52.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T16:48:52.264 INFO:tasks.ceph.mon.a:Started 2023-09-30T16:48:52.265 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T16:48:52.265 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T16:48:52.307 INFO:tasks.ceph.mon.b:Started 2023-09-30T16:48:52.307 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T16:48:52.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T16:48:52.310 INFO:tasks.ceph.mon.c:Started 2023-09-30T16:48:52.310 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T16:48:52.310 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-30T16:48:52.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-30T16:48:52.313 INFO:tasks.ceph.mgr.y:Started 2023-09-30T16:48:52.313 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T16:48:52.313 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T16:48:52.315 INFO:tasks.ceph.mgr.x:Started 2023-09-30T16:48:52.315 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T16:48:52.316 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T16:48:52.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b57b47640 1 Processor -- start 2023-09-30T16:48:52.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b57b47640 1 -- start start 2023-09-30T16:48:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b57b47640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b57b47640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5015d0b0 con 0x7f0b5006f750 2023-09-30T16:48:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b57b47640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b50071450 con 0x7f0b5015ccd0 2023-09-30T16:48:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b57b47640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500cbbc0 con 0x7f0b5006a510 2023-09-30T16:48:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b550e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b560e4640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0b5006f750 0x7f0b500cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41854/0 (socket says 172.21.15.52:41854) 2023-09-30T16:48:52.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b550e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45740/0 (socket says 172.21.15.52:45740) 2023-09-30T16:48:52.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b560e4640 1 -- 172.21.15.52:0/1452716048 learned_addr learned my addr 172.21.15.52:0/1452716048 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:48:52.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b550e2640 1 -- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 msgr2=0x7f0b5006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T16:48:52.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b550e2640 1 -- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 msgr2=0x7f0b5006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T16:48:52.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b550e2640 1 --2- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T16:48:52.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.428+0000 7f0b550e2640 1 --2- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T16:48:52.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.632+0000 7f0b550e2640 1 --2- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.632+0000 7f0b550e2640 1 -- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 msgr2=0x7f0b5006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T16:48:52.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.632+0000 7f0b550e2640 1 -- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 msgr2=0x7f0b5006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T16:48:52.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.632+0000 7f0b550e2640 1 --2- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T16:48:52.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.632+0000 7f0b550e2640 1 --2- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T16:48:52.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.700+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088884342 0 0) 0x7f0b5015d0b0 con 0x7f0b5006f750 2023-09-30T16:48:52.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.700+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b3c003530 con 0x7f0b5006f750 2023-09-30T16:48:52.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.700+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432451392 0 0) 0x7f0b50071450 con 0x7f0b5015ccd0 2023-09-30T16:48:52.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.700+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b5015d0b0 con 0x7f0b5015ccd0 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.700+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479897782 0 0) 0x7f0b5015d0b0 con 0x7f0b5015ccd0 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 msgr2=0x7f0b5006ef90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 --2- 172.21.15.52:0/1452716048 >> v2:172.21.15.52:3300/0 conn(0x7f0b5006a510 0x7f0b5006ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 >> v1:172.21.15.52:6789/0 conn(0x7f0b5006f750 legacy=0x7f0b500cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50071730 con 0x7f0b5015ccd0 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f0b4c001680 con 0x7f0b5015ccd0 2023-09-30T16:48:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 >> v1:172.21.15.186:6789/0 conn(0x7f0b5015ccd0 legacy=0x7f0b50069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b3c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b3c0047d0 0x7f0b3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b3c005200 0x7f0b3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b558e3640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b3c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b550e2640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b3c0047d0 0x7f0b3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b560e4640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b3c005200 0x7f0b3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b480015c0 con 0x7f0b3c003b10 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500cbbc0 con 0x7f0b3c005200 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c00c1e0 con 0x7f0b3c0047d0 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b558e3640 1 -- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b3c0047d0 msgr2=0x7f0b3c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b558e3640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b3c0047d0 0x7f0b3c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b558e3640 1 -- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b3c005200 msgr2=0x7f0b3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b558e3640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b3c005200 0x7f0b3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b558e3640 1 -- 172.21.15.52:0/1452716048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5015d0b0 con 0x7f0b3c003b10 2023-09-30T16:48:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.704+0000 7f0b560e4640 1 -- 172.21.15.52:0/1452716048 reap_dead start 2023-09-30T16:48:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b558e3640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b3c003ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007f00 tx=0x7f0b4c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b758d4b7756a0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0a6630 con 0x7f0b3c003b10 2023-09-30T16:48:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0a67b0 con 0x7f0b3c003b10 2023-09-30T16:48:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b548e1640 1 -- 172.21.15.52:0/1452716048 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0a6b60 con 0x7f0b3c003b10 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 -- 172.21.15.52:0/1452716048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 msgr2=0x7f0b3c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b3c003ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007f00 tx=0x7f0b4c01c980 comp rx=0 tx=0).stop 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 -- 172.21.15.52:0/1452716048 shutdown_connections 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 --2- 172.21.15.52:0/1452716048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b3c003ef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 -- 172.21.15.52:0/1452716048 >> 172.21.15.52:0/1452716048 conn(0x7f0b5006d320 msgr2=0x7f0b5006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 -- 172.21.15.52:0/1452716048 shutdown_connections 2023-09-30T16:48:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.708+0000 7f0b57b47640 1 -- 172.21.15.52:0/1452716048 wait complete. 2023-09-30T16:48:52.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.712+0000 7f0b57b47640 1 Processor -- start 2023-09-30T16:48:52.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 -- start start 2023-09-30T16:48:52.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b501483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b500acdd0 0x7f0b50155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b500ad250 0x7f0b500c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:52.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5015f1f0 con 0x7f0b3c003b10 2023-09-30T16:48:52.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50156470 con 0x7f0b500ad250 2023-09-30T16:48:52.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b501483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b57b47640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5015e920 con 0x7f0b500acdd0 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b501483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45788/0 (socket says 172.21.15.52:45788) 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 -- 172.21.15.52:0/2138302536 learned_addr learned my addr 172.21.15.52:0/2138302536 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b550e2640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b500acdd0 0x7f0b50155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b560e4640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b500ad250 0x7f0b500c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 -- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b500acdd0 msgr2=0x7f0b50155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b500acdd0 0x7f0b50155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 -- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b500ad250 msgr2=0x7f0b500c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b500ad250 0x7f0b500c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b558e3640 1 -- 172.21.15.52:0/2138302536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50156190 con 0x7f0b3c003b10 2023-09-30T16:48:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.716+0000 7f0b550e2640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b500acdd0 0x7f0b50155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:52.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b558e3640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b501483b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c01ce60 tx=0x7f0b4c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:52.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c001680 con 0x7f0b3c003b10 2023-09-30T16:48:52.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0a6430 con 0x7f0b3c003b10 2023-09-30T16:48:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5015eb30 con 0x7f0b3c003b10 2023-09-30T16:48:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c005070 con 0x7f0b3c003b10 2023-09-30T16:48:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b501488f0 con 0x7f0b3c003b10 2023-09-30T16:48:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b500740a0 con 0x7f0b3c003b10 2023-09-30T16:48:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0b4c003600 con 0x7f0b3c003b10 2023-09-30T16:48:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.720+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0b4c0b1790 con 0x7f0b3c003b10 2023-09-30T16:48:52.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.724+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0b4c0ac070 con 0x7f0b3c003b10 2023-09-30T16:48:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.792+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0b5006ed70 con 0x7f0b3c003b10 2023-09-30T16:48:52.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b467fc640 1 -- 172.21.15.52:0/2138302536 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0b4c007b20 con 0x7f0b3c003b10 2023-09-30T16:48:52.799 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2023-09-30T16:48:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 msgr2=0x7f0b501483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b501483b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c01ce60 tx=0x7f0b4c019720 comp rx=0 tx=0).stop 2023-09-30T16:48:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 shutdown_connections 2023-09-30T16:48:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b500ad250 0x7f0b500c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b500acdd0 0x7f0b50155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 --2- 172.21.15.52:0/2138302536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c003b10 0x7f0b501483b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:52.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 >> 172.21.15.52:0/2138302536 conn(0x7f0b5006d320 msgr2=0x7f0b500afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:52.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.796+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 shutdown_connections 2023-09-30T16:48:52.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:52.800+0000 7f0b57b47640 1 -- 172.21.15.52:0/2138302536 wait complete. 2023-09-30T16:48:52.819 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T16:48:52.820 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T16:48:52.820 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:52.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T16:48:52.831 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:52.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T16:48:52.888 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:52.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T16:48:52.945 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:48:52.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T16:48:52.949 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:52.948+0000 7f68bbf10180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T16:48:52.959 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:52.959 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-30T16:48:52.972 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:52.972 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-30T16:48:52.973 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:52.968+0000 7fd9fc7f1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T16:48:53.025 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:53.026 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-30T16:48:53.081 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:48:53.081 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-30T16:48:53.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 7cadf180-98eb-4c22-bb95-37deba653198 0 2023-09-30T16:48:53.294 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 Processor -- start 2023-09-30T16:48:53.295 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 -- start start 2023-09-30T16:48:53.295 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 0x7f17240cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f172406a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17240ccfe0 con 0x7f172415bee0 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240caca0 con 0x7f17240ca860 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f172a956640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172406a7d0 con 0x7f1724069e00 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f17237fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 0x7f17240cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1723fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f172415bee0 0x7f172415ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:59082/0 (socket says 172.21.15.186:59082) 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f17237fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 0x7f17240cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56716/0 (socket says 172.21.15.186:56716) 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1723fff640 1 -- 172.21.15.186:0/1623360764 learned_addr learned my addr 172.21.15.186:0/1623360764 (peer_addr_for_me v1:172.21.15.186:0/0) 2023-09-30T16:48:53.296 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1728ef3640 1 --2- 172.21.15.186:0/1623360764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f172406a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.297 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1722ffd640 1 -- 172.21.15.186:0/1623360764 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473600644 0 0) 0x7f17240ccfe0 con 0x7f172415bee0 2023-09-30T16:48:53.297 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1722ffd640 1 -- 172.21.15.186:0/1623360764 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f170c003530 con 0x7f172415bee0 2023-09-30T16:48:53.298 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1728ef3640 1 -- 172.21.15.186:0/1623360764 >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 msgr2=0x7f17240cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:53.298 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1728ef3640 1 --2- 172.21.15.186:0/1623360764 >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 0x7f17240cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.298 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1728ef3640 1 -- 172.21.15.186:0/1623360764 >> v1:172.21.15.186:6789/0 conn(0x7f172415bee0 legacy=0x7f172415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.298 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f1728ef3640 1 -- 172.21.15.186:0/1623360764 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240cca20 con 0x7f1724069e00 2023-09-30T16:48:53.298 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.292+0000 7f17237fe640 1 --2- 172.21.15.186:0/1623360764 >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 0x7f17240cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1728ef3640 1 --2- 172.21.15.186:0/1623360764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f172406a290 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f171c009d90 tx=0x7f171c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f095aa1e216d2f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1722ffd640 1 -- 172.21.15.186:0/1623360764 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5810 con 0x7f1724069e00 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1722ffd640 1 -- 172.21.15.186:0/1623360764 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0a5970 con 0x7f1724069e00 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1722ffd640 1 -- 172.21.15.186:0/1623360764 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5d00 con 0x7f1724069e00 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- 172.21.15.186:0/1623360764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 msgr2=0x7f172406a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 --2- 172.21.15.186:0/1623360764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f172406a290 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f171c009d90 tx=0x7f171c01c950 comp rx=0 tx=0).stop 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- 172.21.15.186:0/1623360764 shutdown_connections 2023-09-30T16:48:53.299 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 --2- 172.21.15.186:0/1623360764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f172406a290 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 --2- 172.21.15.186:0/1623360764 >> v2:172.21.15.186:3300/0 conn(0x7f17240ca860 0x7f17240cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- 172.21.15.186:0/1623360764 >> 172.21.15.186:0/1623360764 conn(0x7f172406d320 msgr2=0x7f172406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- 172.21.15.186:0/1623360764 shutdown_connections 2023-09-30T16:48:53.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- 172.21.15.186:0/1623360764 wait complete. 2023-09-30T16:48:53.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 Processor -- start 2023-09-30T16:48:53.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- start start 2023-09-30T16:48:53.302 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f17240c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.302 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17240ca860 0x7f1724153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.302 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f172415bee0 0x7f1724153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17240c8fd0 con 0x7f172415bee0 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17240c8210 con 0x7f17240ca860 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f172a956640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240c84f0 con 0x7f1724069e00 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1723fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f17240c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f17237fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17240ca860 0x7f1724153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1723fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f17240c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:45446/0 (socket says 172.21.15.186:45446) 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1723fff640 1 -- 172.21.15.186:0/3933670450 learned_addr learned my addr 172.21.15.186:0/3933670450 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f17237fe640 1 -- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 msgr2=0x7f17240c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f17237fe640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f17240c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f17237fe640 1 -- 172.21.15.186:0/3933670450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f172415bee0 msgr2=0x7f1724153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f17237fe640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f172415bee0 0x7f1724153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f17237fe640 1 -- 172.21.15.186:0/3933670450 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009420 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.296+0000 7f1723fff640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f17240c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f17237fe640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17240ca860 0x7f1724153110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f171800e9b0 tx=0x7f171800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800c9a0 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800cb00 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c009a70 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718013470 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17240c8ab0 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1718005ca0 con 0x7f17240ca860 2023-09-30T16:48:53.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1718006360 con 0x7f17240ca860 2023-09-30T16:48:53.305 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.300+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17240740a0 con 0x7f17240ca860 2023-09-30T16:48:53.312 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.308+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1718021060 con 0x7f17240ca860 2023-09-30T16:48:53.381 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.376+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7cadf180-98eb-4c22-bb95-37deba653198", "id": 0} v 0) v1 -- 0x7f17240c3a70 con 0x7f17240ca860 2023-09-30T16:48:53.391 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f1720ff9640 1 -- 172.21.15.186:0/3933670450 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cadf180-98eb-4c22-bb95-37deba653198", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1718017070 con 0x7f17240ca860 2023-09-30T16:48:53.391 INFO:teuthology.orchestra.run.smithi186.stdout:0 2023-09-30T16:48:53.392 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17240ca860 msgr2=0x7f1724153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.392 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17240ca860 0x7f1724153110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f171800e9b0 tx=0x7f171800ee70 comp rx=0 tx=0).stop 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 shutdown_connections 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f172415bee0 0x7f1724153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17240ca860 0x7f1724153110 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 --2- 172.21.15.186:0/3933670450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1724069e00 0x7f17240c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 >> 172.21.15.186:0/3933670450 conn(0x7f172406d320 msgr2=0x7f172415c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 shutdown_connections 2023-09-30T16:48:53.393 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.388+0000 7f172a956640 1 -- 172.21.15.186:0/3933670450 wait complete. 2023-09-30T16:48:53.408 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 435f1380-5a40-4732-8e94-9c6d802061dd 1 2023-09-30T16:48:53.485 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:53.480+0000 7fd9fc7f1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T16:48:53.523 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:53.520+0000 7f68bbf10180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T16:48:53.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 Processor -- start 2023-09-30T16:48:53.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 -- start start 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3415ce40 0x7f9e340c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e340c4600 0x7f9e340c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3406dec0 con 0x7f9e3406f150 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e340c4330 con 0x7f9e340c4600 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e3a095640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340c4fb0 con 0x7f9e3415ce40 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e337fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3415ce40 0x7f9e340c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e32ffd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9e3406f150 0x7f9e3406e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:59092/0 (socket says 172.21.15.186:59092) 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e32ffd640 1 -- 172.21.15.186:0/1815918500 learned_addr learned my addr 172.21.15.186:0/1815918500 (peer_addr_for_me v1:172.21.15.186:0/0) 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.520+0000 7f9e33fff640 1 --2- 172.21.15.186:0/1815918500 >> v2:172.21.15.52:3300/0 conn(0x7f9e340c4600 0x7f9e340c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e337fe640 1 -- 172.21.15.186:0/1815918500 >> v2:172.21.15.52:3300/0 conn(0x7f9e340c4600 msgr2=0x7f9e340c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:53.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e337fe640 1 --2- 172.21.15.186:0/1815918500 >> v2:172.21.15.52:3300/0 conn(0x7f9e340c4600 0x7f9e340c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e327fc640 1 -- 172.21.15.186:0/1815918500 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828149178 0 0) 0x7f9e3406dec0 con 0x7f9e3406f150 2023-09-30T16:48:53.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e337fe640 1 -- 172.21.15.186:0/1815918500 >> v1:172.21.15.186:6789/0 conn(0x7f9e3406f150 legacy=0x7f9e3406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e337fe640 1 -- 172.21.15.186:0/1815918500 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34161590 con 0x7f9e3415ce40 2023-09-30T16:48:53.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e337fe640 1 --2- 172.21.15.186:0/1815918500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3415ce40 0x7f9e340c3df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e280097c0 tx=0x7f9e2801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1efeee05697dff89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e327fc640 1 -- 172.21.15.186:0/1815918500 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280ac620 con 0x7f9e3415ce40 2023-09-30T16:48:53.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e327fc640 1 -- 172.21.15.186:0/1815918500 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e280ac780 con 0x7f9e3415ce40 2023-09-30T16:48:53.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e327fc640 1 -- 172.21.15.186:0/1815918500 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280acb10 con 0x7f9e3415ce40 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 -- 172.21.15.186:0/1815918500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3415ce40 msgr2=0x7f9e340c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 --2- 172.21.15.186:0/1815918500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3415ce40 0x7f9e340c3df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e280097c0 tx=0x7f9e2801c3c0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 -- 172.21.15.186:0/1815918500 shutdown_connections 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 --2- 172.21.15.186:0/1815918500 >> v2:172.21.15.52:3300/0 conn(0x7f9e340c4600 0x7f9e340c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 --2- 172.21.15.186:0/1815918500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3415ce40 0x7f9e340c3df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 -- 172.21.15.186:0/1815918500 >> 172.21.15.186:0/1815918500 conn(0x7f9e340b0b80 msgr2=0x7f9e340b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 -- 172.21.15.186:0/1815918500 shutdown_connections 2023-09-30T16:48:53.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.524+0000 7f9e3a095640 1 -- 172.21.15.186:0/1815918500 wait complete. 2023-09-30T16:48:53.530 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 Processor -- start 2023-09-30T16:48:53.531 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 -- start start 2023-09-30T16:48:53.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 0x7f9e3414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e340c4600 0x7f9e34151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3415ce40 0x7f9e34151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340b2a40 con 0x7f9e340c4600 2023-09-30T16:48:53.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e341f9630 con 0x7f9e3415ce40 2023-09-30T16:48:53.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340b2cc0 con 0x7f9e3406f150 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 0x7f9e3414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 0x7f9e3414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:45464/0 (socket says 172.21.15.186:45464) 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 -- 172.21.15.186:0/3782171401 learned_addr learned my addr 172.21.15.186:0/3782171401 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e33fff640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3415ce40 0x7f9e34151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e32ffd640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e340c4600 0x7f9e34151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 -- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3415ce40 msgr2=0x7f9e34151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3415ce40 0x7f9e34151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 -- 172.21.15.186:0/3782171401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e340c4600 msgr2=0x7f9e34151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e340c4600 0x7f9e34151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 -- 172.21.15.186:0/3782171401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28009420 con 0x7f9e3406f150 2023-09-30T16:48:53.534 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e33fff640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3415ce40 0x7f9e34151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:53.535 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e32ffd640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e340c4600 0x7f9e34151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:48:53.535 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e337fe640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 0x7f9e3414a5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e2801aa70 tx=0x7f9e28019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.535 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280b5400 con 0x7f9e3406f150 2023-09-30T16:48:53.535 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e280b5560 con 0x7f9e3406f150 2023-09-30T16:48:53.535 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280b5910 con 0x7f9e3406f150 2023-09-30T16:48:53.536 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.528+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e340b2fa0 con 0x7f9e3406f150 2023-09-30T16:48:53.536 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.532+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3414aaf0 con 0x7f9e3406f150 2023-09-30T16:48:53.536 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.532+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9e280b3040 con 0x7f9e3406f150 2023-09-30T16:48:53.536 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.532+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f9e280c1dd0 con 0x7f9e3406f150 2023-09-30T16:48:53.536 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.532+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e340740a0 con 0x7f9e3406f150 2023-09-30T16:48:53.536 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.532+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9e280dfb40 con 0x7f9e3406f150 2023-09-30T16:48:53.604 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.600+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "435f1380-5a40-4732-8e94-9c6d802061dd", "id": 1} v 0) v1 -- 0x7f9e340cde20 con 0x7f9e3406f150 2023-09-30T16:48:53.611 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e1bfff640 1 -- 172.21.15.186:0/3782171401 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "435f1380-5a40-4732-8e94-9c6d802061dd", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9e280ce070 con 0x7f9e3406f150 2023-09-30T16:48:53.611 INFO:teuthology.orchestra.run.smithi186.stdout:1 2023-09-30T16:48:53.612 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 msgr2=0x7f9e3414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.612 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 0x7f9e3414a5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e2801aa70 tx=0x7f9e28019160 comp rx=0 tx=0).stop 2023-09-30T16:48:53.612 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 shutdown_connections 2023-09-30T16:48:53.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3415ce40 0x7f9e34151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e340c4600 0x7f9e34151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 --2- 172.21.15.186:0/3782171401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e3406f150 0x7f9e3414a5b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 >> 172.21.15.186:0/3782171401 conn(0x7f9e340b0b80 msgr2=0x7f9e340c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 shutdown_connections 2023-09-30T16:48:53.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.608+0000 7f9e3a095640 1 -- 172.21.15.186:0/3782171401 wait complete. 2023-09-30T16:48:53.628 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7 2 2023-09-30T16:48:53.683 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:53.680+0000 7fd9fc7f1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T16:48:53.737 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.732+0000 7fea4cbf5640 1 Processor -- start 2023-09-30T16:48:53.737 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.732+0000 7fea4cbf5640 1 -- start start 2023-09-30T16:48:53.738 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4cbf5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fea480ced00 0x7fea480cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.738 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4cbf5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea480b4f50 0x7fea480cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4cbf5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480cb700 con 0x7fea48159b70 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4cbf5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480ce290 con 0x7fea480b4f50 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4cbf5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea48159f50 con 0x7fea480ced00 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea45d9b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fea480ced00 0x7fea480cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4659c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fea48159b70 0x7fea480ce5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:59108/0 (socket says 172.21.15.186:59108) 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4659c640 1 -- 172.21.15.186:0/1019366817 learned_addr learned my addr 172.21.15.186:0/1019366817 (peer_addr_for_me v1:172.21.15.186:0/0) 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea46d9d640 1 --2- 172.21.15.186:0/1019366817 >> v2:172.21.15.52:3300/0 conn(0x7fea480b4f50 0x7fea480cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea45d9b640 1 -- 172.21.15.186:0/1019366817 >> v2:172.21.15.52:3300/0 conn(0x7fea480b4f50 msgr2=0x7fea480cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea45d9b640 1 --2- 172.21.15.186:0/1019366817 >> v2:172.21.15.52:3300/0 conn(0x7fea480b4f50 0x7fea480cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea45d9b640 1 -- 172.21.15.186:0/1019366817 >> v1:172.21.15.186:6789/0 conn(0x7fea48159b70 legacy=0x7fea480ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.739 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea45d9b640 1 -- 172.21.15.186:0/1019366817 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48072020 con 0x7fea480ced00 2023-09-30T16:48:53.740 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4559a640 1 -- 172.21.15.186:0/1019366817 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58238359 0 0) 0x7fea480cb700 con 0x7fea48159b70 2023-09-30T16:48:53.740 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:53.736+0000 7f68bbf10180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T16:48:53.741 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea45d9b640 1 --2- 172.21.15.186:0/1019366817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480ced00 0x7fea480cdd50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fea4815d5b0 tx=0x7fea3001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e29c6aeb0bf0e383 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.741 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4559a640 1 -- 172.21.15.186:0/1019366817 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300a8950 con 0x7fea480ced00 2023-09-30T16:48:53.741 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4559a640 1 -- 172.21.15.186:0/1019366817 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300a8ab0 con 0x7fea480ced00 2023-09-30T16:48:53.741 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.736+0000 7fea4559a640 1 -- 172.21.15.186:0/1019366817 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300a8e40 con 0x7fea480ced00 2023-09-30T16:48:53.742 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/1019366817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480ced00 msgr2=0x7fea480cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.742 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/1019366817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480ced00 0x7fea480cdd50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fea4815d5b0 tx=0x7fea3001ec50 comp rx=0 tx=0).stop 2023-09-30T16:48:53.743 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/1019366817 shutdown_connections 2023-09-30T16:48:53.743 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/1019366817 >> v2:172.21.15.52:3300/0 conn(0x7fea480b4f50 0x7fea480cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.743 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/1019366817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480ced00 0x7fea480cdd50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.743 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/1019366817 >> 172.21.15.186:0/1019366817 conn(0x7fea4806d320 msgr2=0x7fea4806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.743 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/1019366817 shutdown_connections 2023-09-30T16:48:53.743 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/1019366817 wait complete. 2023-09-30T16:48:53.745 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 Processor -- start 2023-09-30T16:48:53.745 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- start start 2023-09-30T16:48:53.745 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 0x7fea48147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.745 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 0x7fea481485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.745 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48159b70 0x7fea4815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48148130 con 0x7fea48159b70 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480c33d0 con 0x7fea480b4f50 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea480c36b0 con 0x7fea480ced00 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4659c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 0x7fea48147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 0x7fea481485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 0x7fea481485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:45470/0 (socket says 172.21.15.186:45470) 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4659c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 0x7fea48147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56736/0 (socket says 172.21.15.186:56736) 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 -- 172.21.15.186:0/3566065265 learned_addr learned my addr 172.21.15.186:0/3566065265 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea46d9d640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48159b70 0x7fea4815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 -- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 msgr2=0x7fea48147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.746 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 0x7fea48147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 -- 172.21.15.186:0/3566065265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48159b70 msgr2=0x7fea4815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48159b70 0x7fea4815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 -- 172.21.15.186:0/3566065265 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009420 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4659c640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 0x7fea48147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea45d9b640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 0x7fea481485e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea3001b860 tx=0x7fea3001b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300b9630 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300b97b0 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea480c3990 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300b9b60 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea480c3f50 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fea300b7040 con 0x7fea480ced00 2023-09-30T16:48:53.747 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.740+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fea300c2c20 con 0x7fea480ced00 2023-09-30T16:48:53.748 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.744+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea480740a0 con 0x7fea480ced00 2023-09-30T16:48:53.748 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.744+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fea300bd020 con 0x7fea480ced00 2023-09-30T16:48:53.815 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.812+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7", "id": 2} v 0) v1 -- 0x7fea480b0570 con 0x7fea480ced00 2023-09-30T16:48:53.824 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea3effd640 1 -- 172.21.15.186:0/3566065265 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fea300b5070 con 0x7fea480ced00 2023-09-30T16:48:53.824 INFO:teuthology.orchestra.run.smithi186.stdout:2 2023-09-30T16:48:53.825 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 msgr2=0x7fea481485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.825 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 0x7fea481485e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea3001b860 tx=0x7fea3001b9f0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.825 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 shutdown_connections 2023-09-30T16:48:53.825 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48159b70 0x7fea4815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.825 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea480ced00 0x7fea481485e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.826 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 --2- 172.21.15.186:0/3566065265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea480b4f50 0x7fea48147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.826 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 >> 172.21.15.186:0/3566065265 conn(0x7fea4806d320 msgr2=0x7fea480b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.826 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 shutdown_connections 2023-09-30T16:48:53.826 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.820+0000 7fea4cbf5640 1 -- 172.21.15.186:0/3566065265 wait complete. 2023-09-30T16:48:53.840 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new d820caf8-a460-48bc-87aa-1a8c814dac17 3 2023-09-30T16:48:53.943 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075e477640 1 Processor -- start 2023-09-30T16:48:53.943 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075e477640 1 -- start start 2023-09-30T16:48:53.945 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075e477640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07580d0260 0x7f07580af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075e477640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075815b500 con 0x7f075815afd0 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075e477640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075815b7e0 con 0x7f075815abf0 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075e477640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075815bac0 con 0x7f07580d0260 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f075815abf0 0x7f07580cb4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:59118/0 (socket says 172.21.15.186:59118) 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 -- 172.21.15.186:0/1025638392 learned_addr learned my addr 172.21.15.186:0/1025638392 (peer_addr_for_me v1:172.21.15.186:0/0) 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f07577fe640 1 --2- 172.21.15.186:0/1025638392 >> v2:172.21.15.52:3300/0 conn(0x7f07580d0260 0x7f07580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527853949 0 0) 0x7f075815b7e0 con 0x7f075815abf0 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0740003530 con 0x7f075815abf0 2023-09-30T16:48:53.946 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4105286817 0 0) 0x7f0740003530 con 0x7f075815abf0 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 >> v2:172.21.15.52:3300/0 conn(0x7f07580d0260 msgr2=0x7f07580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 --2- 172.21.15.186:0/1025638392 >> v2:172.21.15.52:3300/0 conn(0x7f07580d0260 0x7f07580af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 >> v1:172.21.15.52:6789/0 conn(0x7f075815afd0 legacy=0x7f07580af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075815bda0 con 0x7f075815abf0 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f0748001800 con 0x7f075815abf0 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 >> v1:172.21.15.186:6789/0 conn(0x7f075815abf0 legacy=0x7f07580cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f0740003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0740004380 0x7f0740004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0740005050 0x7f074000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075815bac0 con 0x7f0740004380 2023-09-30T16:48:53.947 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074000bfb0 con 0x7f0740005050 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074000c170 con 0x7f0740003980 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f0740003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075ca14640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0740005050 0x7f074000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f07577fe640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0740004380 0x7f0740004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 -- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0740005050 msgr2=0x7f074000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0740005050 0x7f074000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 -- 172.21.15.186:0/1025638392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0740004380 msgr2=0x7f0740004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0740004380 0x7f0740004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f0757fff640 1 -- 172.21.15.186:0/1025638392 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740003530 con 0x7f0740003980 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f07577fe640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0740004380 0x7f0740004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:48:53.948 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.940+0000 7f075ca14640 1 -- 172.21.15.186:0/1025638392 reap_dead start 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f0757fff640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f0740003d60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f074800c1c0 tx=0x7f074801cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a41c28f9da6ff6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480a5b60 con 0x7f0740003980 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480a5cc0 con 0x7f0740003980 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f0756ffd640 1 -- 172.21.15.186:0/1025638392 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480072b0 con 0x7f0740003980 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 -- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 msgr2=0x7f0740003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f0740003d60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f074800c1c0 tx=0x7f074801cbd0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 -- 172.21.15.186:0/1025638392 shutdown_connections 2023-09-30T16:48:53.950 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 --2- 172.21.15.186:0/1025638392 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f0740003d60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.951 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 -- 172.21.15.186:0/1025638392 >> 172.21.15.186:0/1025638392 conn(0x7f0758098a60 msgr2=0x7f07580cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:53.951 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 -- 172.21.15.186:0/1025638392 shutdown_connections 2023-09-30T16:48:53.951 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.944+0000 7f075e477640 1 -- 172.21.15.186:0/1025638392 wait complete. 2023-09-30T16:48:53.953 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 Processor -- start 2023-09-30T16:48:53.953 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- start start 2023-09-30T16:48:53.953 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f07580c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.953 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f075814f7f0 0x7f0758156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.953 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0758154750 0x7f0758154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758155110 con 0x7f0758154750 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c4950 con 0x7f075814f7f0 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0758150000 con 0x7f0740003980 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f07580c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f07580c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:45500/0 (socket says 172.21.15.186:45500) 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 -- 172.21.15.186:0/234341702 learned_addr learned my addr 172.21.15.186:0/234341702 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f07577fe640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f075814f7f0 0x7f0758156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075ca14640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0758154750 0x7f0758154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 -- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f075814f7f0 msgr2=0x7f0758156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.954 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f075814f7f0 0x7f0758156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 -- 172.21.15.186:0/234341702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0758154750 msgr2=0x7f0758154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0758154750 0x7f0758154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 -- 172.21.15.186:0/234341702 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758154120 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0757fff640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f07580c67f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f074801ca00 tx=0x7f0740005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480b3070 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748000f80 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0758154400 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480aeb00 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07580c45e0 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f07480aec60 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0748007520 con 0x7f0740003980 2023-09-30T16:48:53.955 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.948+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07580740a0 con 0x7f0740003980 2023-09-30T16:48:53.956 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:53.952+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f07480bc070 con 0x7f0740003980 2023-09-30T16:48:54.063 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.060+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d820caf8-a460-48bc-87aa-1a8c814dac17", "id": 3} v 0) v1 -- 0x7f0758098f70 con 0x7f0740003980 2023-09-30T16:48:54.069 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.064+0000 7f0754ff9640 1 -- 172.21.15.186:0/234341702 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d820caf8-a460-48bc-87aa-1a8c814dac17", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0748007d00 con 0x7f0740003980 2023-09-30T16:48:54.070 INFO:teuthology.orchestra.run.smithi186.stdout:3 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 msgr2=0x7f07580c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f07580c67f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f074801ca00 tx=0x7f0740005800 comp rx=0 tx=0).stop 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 shutdown_connections 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0758154750 0x7f0758154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f075814f7f0 0x7f0758156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 --2- 172.21.15.186:0/234341702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0740003980 0x7f07580c67f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 >> 172.21.15.186:0/234341702 conn(0x7f0758098a60 msgr2=0x7f075806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 shutdown_connections 2023-09-30T16:48:54.071 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.068+0000 7f075e477640 1 -- 172.21.15.186:0/234341702 wait complete. 2023-09-30T16:48:54.086 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 0f6d72bf-38d4-43c9-ae63-ec59668c7d05 4 2023-09-30T16:48:54.189 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.184+0000 7f8ca17a4640 1 Processor -- start 2023-09-30T16:48:54.189 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.184+0000 7f8ca17a4640 1 -- start start 2023-09-30T16:48:54.190 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c9c06b2d0 0x7f8c9c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.190 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8c9c0cb560 0x7f8c9c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0ced70 con 0x7f8c9c06f1b0 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c15ace0 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c0c56a0 con 0x7f8c9c0cb560 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8c9c0cb560 0x7f8c9c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8c9c0cb560 0x7f8c9c0ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56756/0 (socket says 172.21.15.186:56756) 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 -- 172.21.15.186:0/1265956213 learned_addr learned my addr 172.21.15.186:0/1265956213 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 -- 172.21.15.186:0/1265956213 >> v2:172.21.15.52:3300/0 conn(0x7f8c9c06b2d0 msgr2=0x7f8c9c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c9affd640 1 --2- 172.21.15.186:0/1265956213 >> v2:172.21.15.52:3300/0 conn(0x7f8c9c06b2d0 0x7f8c9c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 --2- 172.21.15.186:0/1265956213 >> v2:172.21.15.52:3300/0 conn(0x7f8c9c06b2d0 0x7f8c9c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 -- 172.21.15.186:0/1265956213 >> v1:172.21.15.52:6789/0 conn(0x7f8c9c06f1b0 legacy=0x7f8c9c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.192 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 -- 172.21.15.186:0/1265956213 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0c5980 con 0x7f8c9c0cb560 2023-09-30T16:48:54.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c93fff640 1 --2- 172.21.15.186:0/1265956213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c0ce830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c06db90 tx=0x7f8c8401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca250d1be46e7def server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c9a7fc640 1 -- 172.21.15.186:0/1265956213 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840ab600 con 0x7f8c9c0cb560 2023-09-30T16:48:54.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c9a7fc640 1 -- 172.21.15.186:0/1265956213 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c840a7050 con 0x7f8c9c0cb560 2023-09-30T16:48:54.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8c9a7fc640 1 -- 172.21.15.186:0/1265956213 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840ab980 con 0x7f8c9c0cb560 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- 172.21.15.186:0/1265956213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c0cb560 msgr2=0x7f8c9c0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/1265956213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c0ce830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c06db90 tx=0x7f8c8401c3a0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- 172.21.15.186:0/1265956213 shutdown_connections 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/1265956213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c0ce830 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/1265956213 >> v2:172.21.15.52:3300/0 conn(0x7f8c9c06b2d0 0x7f8c9c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- 172.21.15.186:0/1265956213 >> 172.21.15.186:0/1265956213 conn(0x7f8c9c0b0b80 msgr2=0x7f8c9c0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.194 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- 172.21.15.186:0/1265956213 shutdown_connections 2023-09-30T16:48:54.195 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.188+0000 7f8ca17a4640 1 -- 172.21.15.186:0/1265956213 wait complete. 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 Processor -- start 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- start start 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 0x7f8c9c141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c06f1b0 0x7f8c9c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c14b040 con 0x7f8c9c0cb560 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c141a60 con 0x7f8c9c06f1b0 2023-09-30T16:48:54.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0ae8e0 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 0x7f8c9c141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 0x7f8c9c141520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:45506/0 (socket says 172.21.15.186:45506) 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c06f1b0 0x7f8c9c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 -- 172.21.15.186:0/4170097886 learned_addr learned my addr 172.21.15.186:0/4170097886 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9b7fe640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 -- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c06f1b0 msgr2=0x7f8c9c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c06f1b0 0x7f8c9c152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 -- 172.21.15.186:0/4170097886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9c0cb560 msgr2=0x7f8c9c152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 -- 172.21.15.186:0/4170097886 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840094d0 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c93fff640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c06f1b0 0x7f8c9c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c9affd640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 0x7f8c9c141520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c820 tx=0x7f8c8c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c007a30 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c007b90 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c0aebc0 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00ce10 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c14a310 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8c8c01a450 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8c8c011900 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.192+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c0af4f0 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.200 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.196+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8c8c039b40 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.262 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.260+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f6d72bf-38d4-43c9-ae63-ec59668c7d05", "id": 4} v 0) v1 -- 0x7f8c9c0740a0 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.270 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8c937fe640 1 -- 172.21.15.186:0/4170097886 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f6d72bf-38d4-43c9-ae63-ec59668c7d05", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c8c028070 con 0x7f8c9c06b2d0 2023-09-30T16:48:54.270 INFO:teuthology.orchestra.run.smithi186.stdout:4 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 msgr2=0x7f8c9c141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 0x7f8c9c141520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c820 tx=0x7f8c8c00cce0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 shutdown_connections 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9c0cb560 0x7f8c9c152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9c06f1b0 0x7f8c9c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 --2- 172.21.15.186:0/4170097886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c9c06b2d0 0x7f8c9c141520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 >> 172.21.15.186:0/4170097886 conn(0x7f8c9c0b0b80 msgr2=0x7f8c9c0c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 shutdown_connections 2023-09-30T16:48:54.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.268+0000 7f8ca17a4640 1 -- 172.21.15.186:0/4170097886 wait complete. 2023-09-30T16:48:54.287 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new c39510df-e980-4d60-a3b4-625511e4efea 5 2023-09-30T16:48:54.326 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.324+0000 7fd9fc7f1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T16:48:54.356 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.351+0000 7f68bbf10180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T16:48:54.382 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.380+0000 7fd9fc7f1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T16:48:54.402 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f850a640 1 Processor -- start 2023-09-30T16:48:54.402 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f850a640 1 -- start start 2023-09-30T16:48:54.406 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f850a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7f006ef90 0x7ff7f006f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.406 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f850a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f015d0b0 con 0x7ff7f006a510 2023-09-30T16:48:54.406 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f850a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f0071450 con 0x7ff7f015ccd0 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f850a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00cbbc0 con 0x7ff7f006ef90 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7ff7f015ccd0 0x7ff7f0069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:59120/0 (socket says 172.21.15.186:59120) 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 -- 172.21.15.186:0/2743207961 learned_addr learned my addr 172.21.15.186:0/2743207961 (peer_addr_for_me v1:172.21.15.186:0/0) 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f6aa7640 1 --2- 172.21.15.186:0/2743207961 >> v2:172.21.15.52:3300/0 conn(0x7ff7f006ef90 0x7ff7f006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679719264 0 0) 0x7ff7f0071450 con 0x7ff7f015ccd0 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7dc003530 con 0x7ff7f015ccd0 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 530183892 0 0) 0x7ff7dc003530 con 0x7ff7f015ccd0 2023-09-30T16:48:54.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 >> v2:172.21.15.52:3300/0 conn(0x7ff7f006ef90 msgr2=0x7ff7f006f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 --2- 172.21.15.186:0/2743207961 >> v2:172.21.15.52:3300/0 conn(0x7ff7f006ef90 0x7ff7f006f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 >> v1:172.21.15.52:6789/0 conn(0x7ff7f006a510 legacy=0x7ff7f00cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0071730 con 0x7ff7f015ccd0 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7ff7ec001680 con 0x7ff7f015ccd0 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 >> v1:172.21.15.186:6789/0 conn(0x7ff7f015ccd0 legacy=0x7ff7f0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7dc0047d0 0x7ff7dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7dc005190 0x7ff7dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00cbbc0 con 0x7ff7dc0047d0 2023-09-30T16:48:54.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc00c130 con 0x7ff7dc003980 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc00c2f0 con 0x7ff7dc005190 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f6aa7640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7dc005190 0x7ff7dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f5aa5640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7dc0047d0 0x7ff7dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 -- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7dc005190 msgr2=0x7ff7dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7dc005190 0x7ff7dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 -- 172.21.15.186:0/2743207961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7dc0047d0 msgr2=0x7ff7dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7dc0047d0 0x7ff7dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f62a6640 1 -- 172.21.15.186:0/2743207961 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc003530 con 0x7ff7dc003980 2023-09-30T16:48:54.410 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.400+0000 7ff7f6aa7640 1 -- 172.21.15.186:0/2743207961 reap_dead start 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7dc003da0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec001060 tx=0x7ff7ec01cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7b2a090e1f1b31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0058e0 con 0x7ff7dc003980 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec005a40 con 0x7ff7dc003980 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f52a4640 1 -- 172.21.15.186:0/2743207961 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec005e70 con 0x7ff7dc003980 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 msgr2=0x7ff7dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7dc003da0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec001060 tx=0x7ff7ec01cb80 comp rx=0 tx=0).stop 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- 172.21.15.186:0/2743207961 shutdown_connections 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 --2- 172.21.15.186:0/2743207961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7dc003da0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- 172.21.15.186:0/2743207961 >> 172.21.15.186:0/2743207961 conn(0x7ff7f006d320 msgr2=0x7ff7f006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- 172.21.15.186:0/2743207961 shutdown_connections 2023-09-30T16:48:54.413 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- 172.21.15.186:0/2743207961 wait complete. 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 Processor -- start 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- start start 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7f014fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7f01590b0 0x7ff7f015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7f015e1b0 0x7ff7f015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00c6840 con 0x7ff7f015e1b0 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f015e650 con 0x7ff7dc003980 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f850a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f015e930 con 0x7ff7f01590b0 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f62a6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7f014fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f5aa5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7f01590b0 0x7ff7f015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.414 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f62a6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7f014fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56786/0 (socket says 172.21.15.186:56786) 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.404+0000 7ff7f62a6640 1 -- 172.21.15.186:0/374827316 learned_addr learned my addr 172.21.15.186:0/374827316 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f6aa7640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7f015e1b0 0x7ff7f015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f62a6640 1 -- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7f01590b0 msgr2=0x7ff7f015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7f01590b0 0x7ff7f015dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f62a6640 1 -- 172.21.15.186:0/374827316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7f015e1b0 msgr2=0x7ff7f015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7f015e1b0 0x7ff7f015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f62a6640 1 -- 172.21.15.186:0/374827316 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00c6a50 con 0x7ff7dc003980 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f5aa5640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7f01590b0 0x7ff7f015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f62a6640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7f014fcc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec01c9b0 tx=0x7ff7dc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0049f0 con 0x7ff7dc003980 2023-09-30T16:48:54.415 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec004b50 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec006e80 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f00c6d30 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f01f5ce0 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff7ec0070d0 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff7ec0a5920 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f015eaf0 con 0x7ff7dc003980 2023-09-30T16:48:54.416 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.407+0000 7f68bbf10180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T16:48:54.417 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.408+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff7ec0be060 con 0x7ff7dc003980 2023-09-30T16:48:54.437 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.432+0000 7fd9fc7f1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T16:48:54.466 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.463+0000 7f68bbf10180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T16:48:54.480 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.476+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c39510df-e980-4d60-a3b4-625511e4efea", "id": 5} v 0) v1 -- 0x7ff7f00740a0 con 0x7ff7dc003980 2023-09-30T16:48:54.487 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7e6ffd640 1 -- 172.21.15.186:0/374827316 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c39510df-e980-4d60-a3b4-625511e4efea", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff7ec007d00 con 0x7ff7dc003980 2023-09-30T16:48:54.487 INFO:teuthology.orchestra.run.smithi186.stdout:5 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 msgr2=0x7ff7f014fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7f014fcc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec01c9b0 tx=0x7ff7dc005800 comp rx=0 tx=0).stop 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 shutdown_connections 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7f015e1b0 0x7ff7f015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7f01590b0 0x7ff7f015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 --2- 172.21.15.186:0/374827316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7dc003980 0x7ff7f014fcc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 >> 172.21.15.186:0/374827316 conn(0x7ff7f006d320 msgr2=0x7ff7f00b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 shutdown_connections 2023-09-30T16:48:54.489 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.484+0000 7ff7f850a640 1 -- 172.21.15.186:0/374827316 wait complete. 2023-09-30T16:48:54.503 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 0317f0d3-2589-4900-9291-4a978b487b0d 6 2023-09-30T16:48:54.517 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.512+0000 7fd9fc7f1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T16:48:54.546 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.543+0000 7f68bbf10180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T16:48:54.571 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.568+0000 7fd9fc7f1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T16:48:54.600 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.595+0000 7f68bbf10180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T16:48:54.631 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 Processor -- start 2023-09-30T16:48:54.631 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 -- start start 2023-09-30T16:48:54.632 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e5c06f150 0x7f4e5c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.632 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4e5c0c4600 0x7f4e5c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.632 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c0c4f50 con 0x7f4e5c15ce40 2023-09-30T16:48:54.632 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0c4330 con 0x7f4e5c06f150 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e61e01640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c06dec0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4e5c0c4600 0x7f4e5c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4e5c0c4600 0x7f4e5c0c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56794/0 (socket says 172.21.15.186:56794) 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 -- 172.21.15.186:0/1087286904 learned_addr learned my addr 172.21.15.186:0/1087286904 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5affd640 1 --2- 172.21.15.186:0/1087286904 >> v2:172.21.15.52:3300/0 conn(0x7f4e5c06f150 0x7f4e5c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 -- 172.21.15.186:0/1087286904 >> v2:172.21.15.52:3300/0 conn(0x7f4e5c06f150 msgr2=0x7f4e5c0c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 --2- 172.21.15.186:0/1087286904 >> v2:172.21.15.52:3300/0 conn(0x7f4e5c06f150 0x7f4e5c0c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 -- 172.21.15.186:0/1087286904 >> v1:172.21.15.52:6789/0 conn(0x7f4e5c15ce40 legacy=0x7f4e5c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5bfff640 1 -- 172.21.15.186:0/1087286904 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c161590 con 0x7f4e5c0c4600 2023-09-30T16:48:54.633 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.628+0000 7f4e5affd640 1 --2- 172.21.15.186:0/1087286904 >> v2:172.21.15.52:3300/0 conn(0x7f4e5c06f150 0x7f4e5c0c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:48:54.634 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5bfff640 1 --2- 172.21.15.186:0/1087286904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c0c4a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0b1c20 tx=0x7f4e5401c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7643d1b463ebbd3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.634 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5a7fc640 1 -- 172.21.15.186:0/1087286904 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540a5790 con 0x7f4e5c0c4600 2023-09-30T16:48:54.634 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5a7fc640 1 -- 172.21.15.186:0/1087286904 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e540a58f0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.634 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5a7fc640 1 -- 172.21.15.186:0/1087286904 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540a5c80 con 0x7f4e5c0c4600 2023-09-30T16:48:54.635 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- 172.21.15.186:0/1087286904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 msgr2=0x7f4e5c0c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.635 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1087286904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c0c4a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0b1c20 tx=0x7f4e5401c8d0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.635 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- 172.21.15.186:0/1087286904 shutdown_connections 2023-09-30T16:48:54.635 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1087286904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c0c4a10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.636 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1087286904 >> v2:172.21.15.52:3300/0 conn(0x7f4e5c06f150 0x7f4e5c0c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.636 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- 172.21.15.186:0/1087286904 >> 172.21.15.186:0/1087286904 conn(0x7f4e5c0b0b80 msgr2=0x7f4e5c0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.636 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- 172.21.15.186:0/1087286904 shutdown_connections 2023-09-30T16:48:54.636 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- 172.21.15.186:0/1087286904 wait complete. 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 Processor -- start 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- start start 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e5c06f150 0x7f4e5c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e5c15ce40 0x7f4e5c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0ae3d0 con 0x7f4e5c06f150 2023-09-30T16:48:54.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1558c0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e61e01640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1560d0 con 0x7f4e5c15ce40 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e5c15ce40 0x7f4e5c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c15bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56798/0 (socket says 172.21.15.186:56798) 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 -- 172.21.15.186:0/1941646305 learned_addr learned my addr 172.21.15.186:0/1941646305 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5b7fe640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e5c06f150 0x7f4e5c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 -- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e5c15ce40 msgr2=0x7f4e5c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e5c15ce40 0x7f4e5c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 -- 172.21.15.186:0/1941646305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e5c06f150 msgr2=0x7f4e5c15b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e5c06f150 0x7f4e5c15b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.639 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 -- 172.21.15.186:0/1941646305 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54009b30 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5bfff640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e5c15ce40 0x7f4e5c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.632+0000 7f4e5affd640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c15bdc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7c0 tx=0x7f4e4c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c007a30 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c007b90 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c15c6c0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ce70 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c155df0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e4c0193f0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.640 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4e4c011a80 con 0x7f4e5c0c4600 2023-09-30T16:48:54.641 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.636+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c0740a0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.642 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.640+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4e4c01e060 con 0x7f4e5c0c4600 2023-09-30T16:48:54.653 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.648+0000 7fd9fc7f1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T16:48:54.680 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.675+0000 7f68bbf10180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T16:48:54.706 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.704+0000 7fd9fc7f1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T16:48:54.707 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.704+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0317f0d3-2589-4900-9291-4a978b487b0d", "id": 6} v 0) v1 -- 0x7f4e5c14c190 con 0x7f4e5c0c4600 2023-09-30T16:48:54.712 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e43fff640 1 -- 172.21.15.186:0/1941646305 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0317f0d3-2589-4900-9291-4a978b487b0d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e4c011df0 con 0x7f4e5c0c4600 2023-09-30T16:48:54.712 INFO:teuthology.orchestra.run.smithi186.stdout:6 2023-09-30T16:48:54.713 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 msgr2=0x7f4e5c15bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c15bdc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7c0 tx=0x7f4e4c00cc80 comp rx=0 tx=0).stop 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 shutdown_connections 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e5c15ce40 0x7f4e5c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e5c0c4600 0x7f4e5c15bdc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 --2- 172.21.15.186:0/1941646305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e5c06f150 0x7f4e5c15b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 >> 172.21.15.186:0/1941646305 conn(0x7f4e5c0b0b80 msgr2=0x7f4e5c0af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.714 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 shutdown_connections 2023-09-30T16:48:54.715 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.708+0000 7f4e61e01640 1 -- 172.21.15.186:0/1941646305 wait complete. 2023-09-30T16:48:54.729 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 0f601fa0-d3e4-45b2-af77-930fd5fb461d 7 2023-09-30T16:48:54.734 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.731+0000 7f68bbf10180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T16:48:54.840 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.836+0000 7f51946ac640 1 Processor -- start 2023-09-30T16:48:54.841 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.836+0000 7f51946ac640 1 -- start start 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c15ace0 con 0x7f518c06f1b0 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0c56a0 con 0x7f518c06b2d0 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c5980 con 0x7f518c0cb560 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191c47640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5192448640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f518c06b2d0 0x7f518c0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:59134/0 (socket says 172.21.15.186:59134) 2023-09-30T16:48:54.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5192448640 1 -- 172.21.15.186:0/3872759157 learned_addr learned my addr 172.21.15.186:0/3872759157 (peer_addr_for_me v1:172.21.15.186:0/0) 2023-09-30T16:48:54.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191c47640 1 -- 172.21.15.186:0/3872759157 >> v1:172.21.15.186:6789/0 conn(0x7f518c06b2d0 legacy=0x7f518c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191c47640 1 -- 172.21.15.186:0/3872759157 >> v1:172.21.15.52:6789/0 conn(0x7f518c06f1b0 legacy=0x7f518c0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:54.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191446640 1 -- 172.21.15.186:0/3872759157 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361565168 0 0) 0x7f518c0c56a0 con 0x7f518c06b2d0 2023-09-30T16:48:54.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191c47640 1 -- 172.21.15.186:0/3872759157 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c06b6b0 con 0x7f518c0cb560 2023-09-30T16:48:54.844 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191c47640 1 --2- 172.21.15.186:0/3872759157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c3df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097f0 tx=0x7f517c01e250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c3ff07562a4fb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.844 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191446640 1 -- 172.21.15.186:0/3872759157 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0a6980 con 0x7f518c0cb560 2023-09-30T16:48:54.844 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191446640 1 -- 172.21.15.186:0/3872759157 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0a6ae0 con 0x7f518c0cb560 2023-09-30T16:48:54.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f5191446640 1 -- 172.21.15.186:0/3872759157 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0a6e70 con 0x7f518c0cb560 2023-09-30T16:48:54.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- 172.21.15.186:0/3872759157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 msgr2=0x7f518c0c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 --2- 172.21.15.186:0/3872759157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c3df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097f0 tx=0x7f517c01e250 comp rx=0 tx=0).stop 2023-09-30T16:48:54.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- 172.21.15.186:0/3872759157 shutdown_connections 2023-09-30T16:48:54.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 --2- 172.21.15.186:0/3872759157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c3df0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- 172.21.15.186:0/3872759157 >> 172.21.15.186:0/3872759157 conn(0x7f518c0b0b80 msgr2=0x7f518c0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- 172.21.15.186:0/3872759157 shutdown_connections 2023-09-30T16:48:54.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.840+0000 7f51946ac640 1 -- 172.21.15.186:0/3872759157 wait complete. 2023-09-30T16:48:54.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 Processor -- start 2023-09-30T16:48:54.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- start start 2023-09-30T16:48:54.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06b2d0 0x7f518c134410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 0x7f518c0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c134150 con 0x7f518c06b2d0 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0b3c40 con 0x7f518c06f1b0 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c136930 con 0x7f518c0cb560 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5191c47640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 0x7f518c0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5191c47640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 0x7f518c0b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56808/0 (socket says 172.21.15.186:56808) 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5191c47640 1 -- 172.21.15.186:0/1259621148 learned_addr learned my addr 172.21.15.186:0/1259621148 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192448640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06b2d0 0x7f518c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:54.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 -- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 msgr2=0x7f518c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 0x7f518c0b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 -- 172.21.15.186:0/1259621148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06b2d0 msgr2=0x7f518c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06b2d0 0x7f518c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 -- 172.21.15.186:0/1259621148 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009420 con 0x7f518c0cb560 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5191c47640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 0x7f518c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5192c49640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c65d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f518400c780 tx=0x7f518400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518400aa50 con 0x7f518c0cb560 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518400abb0 con 0x7f518c0cb560 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c136c10 con 0x7f518c0cb560 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518400ce30 con 0x7f518c0cb560 2023-09-30T16:48:54.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c1371d0 con 0x7f518c0cb560 2023-09-30T16:48:54.851 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5184004c10 con 0x7f518c0cb560 2023-09-30T16:48:54.851 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5184012a80 con 0x7f518c0cb560 2023-09-30T16:48:54.851 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.844+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c0b3e20 con 0x7f518c0cb560 2023-09-30T16:48:54.851 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.848+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5184039b40 con 0x7f518c0cb560 2023-09-30T16:48:54.854 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.852+0000 7fd9fc7f1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T16:48:54.880 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.875+0000 7f68bbf10180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T16:48:54.915 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.912+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f601fa0-d3e4-45b2-af77-930fd5fb461d", "id": 7} v 0) v1 -- 0x7f518c1373c0 con 0x7f518c0cb560 2023-09-30T16:48:54.915 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:54.912+0000 7fd9fc7f1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T16:48:54.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f5182ffd640 1 -- 172.21.15.186:0/1259621148 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f601fa0-d3e4-45b2-af77-930fd5fb461d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5184028070 con 0x7f518c0cb560 2023-09-30T16:48:54.924 INFO:teuthology.orchestra.run.smithi186.stdout:7 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 msgr2=0x7f518c0c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f51946ac640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c65d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f518400c780 tx=0x7f518400cc40 comp rx=0 tx=0).stop 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 shutdown_connections 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f51946ac640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f518c0cb560 0x7f518c0c65d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f51946ac640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f518c06f1b0 0x7f518c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.920+0000 7f51946ac640 1 --2- 172.21.15.186:0/1259621148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06b2d0 0x7f518c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.924+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 >> 172.21.15.186:0/1259621148 conn(0x7f518c0b0b80 msgr2=0x7f518c0c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.924+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 shutdown_connections 2023-09-30T16:48:54.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:48:54.924+0000 7f51946ac640 1 -- 172.21.15.186:0/1259621148 wait complete. 2023-09-30T16:48:54.941 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T16:48:54.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T16:48:54.942 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:54.939+0000 7f68bbf10180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T16:48:54.944 INFO:tasks.ceph.osd.0:Started 2023-09-30T16:48:54.944 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T16:48:54.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T16:48:54.946 INFO:tasks.ceph.osd.1:Started 2023-09-30T16:48:54.946 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T16:48:54.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T16:48:54.949 INFO:tasks.ceph.osd.2:Started 2023-09-30T16:48:54.949 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T16:48:54.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T16:48:54.952 INFO:tasks.ceph.osd.3:Started 2023-09-30T16:48:54.952 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-30T16:48:54.952 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-30T16:48:54.954 INFO:tasks.ceph.osd.4:Started 2023-09-30T16:48:54.954 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-30T16:48:54.954 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-30T16:48:54.956 INFO:tasks.ceph.osd.5:Started 2023-09-30T16:48:54.956 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-30T16:48:54.956 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-30T16:48:54.958 INFO:tasks.ceph.osd.6:Started 2023-09-30T16:48:54.958 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-30T16:48:54.958 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-30T16:48:54.960 INFO:tasks.ceph.osd.7:Started 2023-09-30T16:48:54.961 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:48:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66bc2f7640 1 Processor -- start 2023-09-30T16:48:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66bc2f7640 1 -- start start 2023-09-30T16:48:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66bc2f7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40707e0 0x7f66b40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66bc2f7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b4070350 con 0x7f66b40b2850 2023-09-30T16:48:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66bc2f7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b415db40 con 0x7f66b40cf1e0 2023-09-30T16:48:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66bc2f7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b2ce0 con 0x7f66b40707e0 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66ba894640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f66b40b2850 0x7f66b40cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41886/0 (socket says 172.21.15.52:41886) 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66ba894640 1 -- 172.21.15.52:0/507987726 learned_addr learned my addr 172.21.15.52:0/507987726 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9892640 1 --2- 172.21.15.52:0/507987726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40707e0 0x7f66b40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120069101 0 0) 0x7f66b4070350 con 0x7f66b40b2850 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a0003530 con 0x7f66b40b2850 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264851182 0 0) 0x7f66b415db40 con 0x7f66b40cf1e0 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66b4070350 con 0x7f66b40cf1e0 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9892640 1 -- 172.21.15.52:0/507987726 >> v1:172.21.15.186:6789/0 conn(0x7f66b40cf1e0 legacy=0x7f66b415d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:55.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9892640 1 -- 172.21.15.52:0/507987726 >> v1:172.21.15.52:6789/0 conn(0x7f66b40b2850 legacy=0x7f66b40cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:55.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.091+0000 7f66b9892640 1 -- 172.21.15.52:0/507987726 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b415de20 con 0x7f66b40707e0 2023-09-30T16:48:55.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66b9892640 1 --2- 172.21.15.52:0/507987726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40707e0 0x7f66b40b2310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f66a40097f0 tx=0x7f66a401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ffac5905196d232 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:55.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40a89b0 con 0x7f66b40707e0 2023-09-30T16:48:55.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40a8b10 con 0x7f66b40707e0 2023-09-30T16:48:55.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66b9091640 1 -- 172.21.15.52:0/507987726 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40a8ea0 con 0x7f66b40707e0 2023-09-30T16:48:55.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 -- 172.21.15.52:0/507987726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40707e0 msgr2=0x7f66b40b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:55.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 --2- 172.21.15.52:0/507987726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40707e0 0x7f66b40b2310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f66a40097f0 tx=0x7f66a401ecb0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 -- 172.21.15.52:0/507987726 shutdown_connections 2023-09-30T16:48:55.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 --2- 172.21.15.52:0/507987726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40707e0 0x7f66b40b2310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 -- 172.21.15.52:0/507987726 >> 172.21.15.52:0/507987726 conn(0x7f66b40cd310 msgr2=0x7f66b40cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:55.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 -- 172.21.15.52:0/507987726 shutdown_connections 2023-09-30T16:48:55.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 -- 172.21.15.52:0/507987726 wait complete. 2023-09-30T16:48:55.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 Processor -- start 2023-09-30T16:48:55.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.095+0000 7f66bc2f7640 1 -- start start 2023-09-30T16:48:55.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66b40707e0 0x7f66b40c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40b2850 0x7f66b40b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 0x7f66b41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b4590 con 0x7f66b40cf1e0 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40c9340 con 0x7f66b40707e0 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40c87c0 con 0x7f66b40b2850 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 0x7f66b41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 0x7f66b41566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45824/0 (socket says 172.21.15.52:45824) 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 -- 172.21.15.52:0/3955064286 learned_addr learned my addr 172.21.15.52:0/3955064286 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba093640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66b40707e0 0x7f66b40c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66b9892640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40b2850 0x7f66b40b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 -- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40b2850 msgr2=0x7f66b40b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40b2850 0x7f66b40b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 -- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66b40707e0 msgr2=0x7f66b40c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66b40707e0 0x7f66b40c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 -- 172.21.15.52:0/3955064286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009420 con 0x7f66b40cf1e0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66ba894640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 0x7f66b41566d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f66ac00caa0 tx=0x7f66ac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00ac00 con 0x7f66b40cf1e0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac00ad80 con 0x7f66b40cf1e0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b40c8aa0 con 0x7f66b40cf1e0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac012640 con 0x7f66b40cf1e0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b40c9060 con 0x7f66b40cf1e0 2023-09-30T16:48:55.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f66ac012aa0 con 0x7f66b40cf1e0 2023-09-30T16:48:55.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f66ac007740 con 0x7f66b40cf1e0 2023-09-30T16:48:55.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.099+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b40740a0 con 0x7f66b40cf1e0 2023-09-30T16:48:55.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.103+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f66ac017070 con 0x7f66b40cf1e0 2023-09-30T16:48:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.159+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66b40b6810 con 0x7f66b40cf1e0 2023-09-30T16:48:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.159+0000 7f66aaffd640 1 -- 172.21.15.52:0/3955064286 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f66ac007900 con 0x7f66b40cf1e0 2023-09-30T16:48:55.165 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:48:55.165 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:48:54.918124+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:48:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 msgr2=0x7f66b41566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 0x7f66b41566d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f66ac00caa0 tx=0x7f66ac00cf60 comp rx=0 tx=0).stop 2023-09-30T16:48:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 shutdown_connections 2023-09-30T16:48:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66b40cf1e0 0x7f66b41566d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66b40b2850 0x7f66b40b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 --2- 172.21.15.52:0/3955064286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66b40707e0 0x7f66b40c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 >> 172.21.15.52:0/3955064286 conn(0x7f66b40cd310 msgr2=0x7f66b4160ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 shutdown_connections 2023-09-30T16:48:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:48:55.163+0000 7f66bc2f7640 1 -- 172.21.15.52:0/3955064286 wait complete. 2023-09-30T16:48:55.181 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T16:48:55.181 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T16:48:55.547 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T16:48:55.544+0000 7f25515ed640 -1 Falling back to public interface 2023-09-30T16:48:55.551 INFO:tasks.ceph.mgr.y.smithi052.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-30T16:48:55.551 INFO:tasks.ceph.mgr.y.smithi052.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-30T16:48:55.551 INFO:tasks.ceph.mgr.y.smithi052.stderr: from numpy import show_config as show_numpy_config 2023-09-30T16:48:55.559 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T16:48:55.555+0000 7f7ed70ad640 -1 Falling back to public interface 2023-09-30T16:48:55.565 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T16:48:55.560+0000 7f3c12ff5640 -1 Falling back to public interface 2023-09-30T16:48:55.586 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T16:48:55.584+0000 7f4aeb87e640 -1 Falling back to public interface 2023-09-30T16:48:55.587 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T16:48:55.584+0000 7fd832f9d640 -1 Falling back to public interface 2023-09-30T16:48:55.591 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T16:48:55.587+0000 7f695e69f640 -1 Falling back to public interface 2023-09-30T16:48:55.591 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T16:48:55.587+0000 7f19ceb83640 -1 Falling back to public interface 2023-09-30T16:48:55.591 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T16:48:55.587+0000 7f19cdb44640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-09-30T16:48:55.598 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T16:48:55.595+0000 7f822d38f640 -1 Falling back to public interface 2023-09-30T16:48:55.613 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:55.607+0000 7f68bbf10180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T16:48:55.617 INFO:tasks.ceph.mgr.x.smithi186.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-30T16:48:55.617 INFO:tasks.ceph.mgr.x.smithi186.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-30T16:48:55.617 INFO:tasks.ceph.mgr.x.smithi186.stderr: from numpy import show_config as show_numpy_config 2023-09-30T16:48:55.662 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:55.660+0000 7fd9fc7f1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T16:48:55.741 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:55.735+0000 7f68bbf10180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T16:48:55.792 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:55.788+0000 7fd9fc7f1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T16:48:55.922 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:55.919+0000 7f68bbf10180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T16:48:55.953 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:55.948+0000 7fd9fc7f1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T16:48:55.985 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T16:48:55.988 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:55.983+0000 7f68bbf10180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T16:48:56.016 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:56.012+0000 7fd9fc7f1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T16:48:56.098 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 Processor -- start 2023-09-30T16:48:56.098 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 -- start start 2023-09-30T16:48:56.102 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 0x7f7f8406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.102 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f840ceb00 0x7f7f840cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.102 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f84069f10 con 0x7f7f8406d920 2023-09-30T16:48:56.102 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8406a1f0 con 0x7f7f840ceb00 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f894a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8406a4d0 con 0x7f7f840cd4a0 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f82ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7f8406d920 0x7f7f840cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34780/0 (socket says 172.21.15.52:34780) 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f82ffd640 1 -- 172.21.15.52:0/457437002 learned_addr learned my addr 172.21.15.52:0/457437002 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f837fe640 1 --2- 172.21.15.52:0/457437002 >> v2:172.21.15.186:3300/0 conn(0x7f7f840ceb00 0x7f7f840cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 0x7f7f8406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053975957 0 0) 0x7f7f84069f10 con 0x7f7f8406d920 2023-09-30T16:48:56.103 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f70003530 con 0x7f7f8406d920 2023-09-30T16:48:56.104 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3292778017 0 0) 0x7f7f70003530 con 0x7f7f8406d920 2023-09-30T16:48:56.104 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 msgr2=0x7f7f8406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:56.104 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 0x7f7f8406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.104 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 >> v2:172.21.15.186:3300/0 conn(0x7f7f840ceb00 msgr2=0x7f7f840cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:56.104 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 --2- 172.21.15.52:0/457437002 >> v2:172.21.15.186:3300/0 conn(0x7f7f840ceb00 0x7f7f840cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.104 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8406a7b0 con 0x7f7f8406d920 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f7f74001800 con 0x7f7f8406d920 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 >> v1:172.21.15.52:6789/0 conn(0x7f7f8406d920 legacy=0x7f7f840cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 0x7f7f70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8406a1f0 con 0x7f7f700047d0 2023-09-30T16:48:56.105 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8406a4d0 con 0x7f7f70003980 2023-09-30T16:48:56.106 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7000b990 con 0x7f7f840cd4a0 2023-09-30T16:48:56.106 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.106 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f82ffd640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.106 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 -- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 msgr2=0x7f7f70005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:56.106 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f840cd4a0 0x7f7f70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.106 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 -- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f70003980 msgr2=0x7f7f70003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:48:56.107 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.107 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.095+0000 7f7f7bfff640 1 -- 172.21.15.52:0/457437002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70003530 con 0x7f7f700047d0 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ae0 tx=0x7f7f6c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bf1ff5389a3259 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0a64a0 con 0x7f7f700047d0 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0a6600 con 0x7f7f700047d0 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f827fc640 1 -- 172.21.15.52:0/457437002 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0a69b0 con 0x7f7f700047d0 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 -- 172.21.15.52:0/457437002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700047d0 msgr2=0x7f7f70004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 --2- 172.21.15.52:0/457437002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ae0 tx=0x7f7f6c01ca90 comp rx=0 tx=0).stop 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f837fe640 1 -- 172.21.15.52:0/457437002 reap_dead start 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 -- 172.21.15.52:0/457437002 shutdown_connections 2023-09-30T16:48:56.111 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 -- 172.21.15.52:0/457437002 >> 172.21.15.52:0/457437002 conn(0x7f7f84098a60 msgr2=0x7f7f840cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 -- 172.21.15.52:0/457437002 shutdown_connections 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 -- 172.21.15.52:0/457437002 wait complete. 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 Processor -- start 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.099+0000 7f7f894a1640 1 -- start start 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f700047d0 0x7f7f84156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 0x7f7f8415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f8415bb00 0x7f7f840ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84156590 con 0x7f7f8415ab20 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8415c040 con 0x7f7f8415bb00 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84159d60 con 0x7f7f700047d0 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 0x7f7f8415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 0x7f7f8415b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43294/0 (socket says 172.21.15.52:43294) 2023-09-30T16:48:56.112 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 -- 172.21.15.52:0/3273913431 learned_addr learned my addr 172.21.15.52:0/3273913431 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f82ffd640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f700047d0 0x7f7f84156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f837fe640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f8415bb00 0x7f7f840ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 -- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f700047d0 msgr2=0x7f7f84156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f700047d0 0x7f7f84156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 -- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f8415bb00 msgr2=0x7f7f840ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f8415bb00 0x7f7f840ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 -- 172.21.15.52:0/3273913431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8415a040 con 0x7f7f8415ab20 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f82ffd640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f700047d0 0x7f7f84156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f837fe640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f8415bb00 0x7f7f840ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7bfff640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 0x7f7f8415b5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ae0 tx=0x7f7f70005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:48:56.113 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0a64a0 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0a7680 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0a7a10 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8415a320 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f840c8650 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7f6c0bc450 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7f6c0c6ac0 con 0x7f7f8415ab20 2023-09-30T16:48:56.114 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.103+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f840d04e0 con 0x7f7f8415ab20 2023-09-30T16:48:56.115 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.107+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7f6c0c1020 con 0x7f7f8415ab20 2023-09-30T16:48:56.121 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:56.115+0000 7f68bbf10180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T16:48:56.138 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:56.136+0000 7fd9fc7f1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T16:48:56.166 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f8406aa90 con 0x7f7f8415ab20 2023-09-30T16:48:56.167 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f7b7fe640 1 -- 172.21.15.52:0/3273913431 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7f6c0096b0 con 0x7f7f8415ab20 2023-09-30T16:48:56.167 INFO:teuthology.misc.health.smithi052.stdout: 2023-09-30T16:48:56.167 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:48:54.918124+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:48:56.168 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 msgr2=0x7f7f8415b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:48:56.168 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 0x7f7f8415b5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ae0 tx=0x7f7f70005800 comp rx=0 tx=0).stop 2023-09-30T16:48:56.168 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 shutdown_connections 2023-09-30T16:48:56.168 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f8415bb00 0x7f7f840ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.169 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8415ab20 0x7f7f8415b5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.169 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 --2- 172.21.15.52:0/3273913431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f700047d0 0x7f7f84156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:48:56.169 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 >> 172.21.15.52:0/3273913431 conn(0x7f7f84098a60 msgr2=0x7f7f840ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:48:56.169 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 shutdown_connections 2023-09-30T16:48:56.169 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:48:56.163+0000 7f7f894a1640 1 -- 172.21.15.52:0/3273913431 wait complete. 2023-09-30T16:48:56.183 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-30T16:48:56.750 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:56.747+0000 7f68bbf10180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T16:48:56.757 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:56.752+0000 7fd9fc7f1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T16:48:56.829 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:56.823+0000 7f68bbf10180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T16:48:56.833 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:56.828+0000 7fd9fc7f1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T16:48:57.002 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:57.000+0000 7fd9fc7f1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T16:48:57.008 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:57.003+0000 7f68bbf10180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T16:48:57.076 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:57.072+0000 7fd9fc7f1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T16:48:57.085 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:57.079+0000 7f68bbf10180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T16:48:57.364 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:57.360+0000 7fd9fc7f1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T16:48:57.388 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:57.383+0000 7f68bbf10180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T16:48:57.424 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:57.420+0000 7fd9fc7f1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T16:48:57.450 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-09-30T16:48:57.447+0000 7f68bbf10180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T16:48:58.464 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:58.460+0000 7fd9a4062640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T16:48:58.464 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-09-30T16:48:58.460+0000 7fd9a4062640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T16:48:59.234 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T16:48:59.232+0000 7f4aeb87e640 -1 osd.6 0 log_to_monitors true 2023-09-30T16:48:59.364 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T16:48:59.360+0000 7f25515ed640 -1 osd.4 0 log_to_monitors true 2023-09-30T16:48:59.390 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T16:48:59.387+0000 7f7ed70ad640 -1 osd.1 0 log_to_monitors true 2023-09-30T16:48:59.438 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T16:48:59.436+0000 7f3c12ff5640 -1 osd.5 0 log_to_monitors true 2023-09-30T16:48:59.450 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T16:48:59.448+0000 7fd832f9d640 -1 osd.7 0 log_to_monitors true 2023-09-30T16:48:59.487 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T16:48:59.483+0000 7f19ceb83640 -1 osd.3 0 log_to_monitors true 2023-09-30T16:48:59.501 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T16:48:59.495+0000 7f822d38f640 -1 osd.0 0 log_to_monitors true 2023-09-30T16:48:59.545 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T16:48:59.539+0000 7f695e69f640 -1 osd.2 0 log_to_monitors true 2023-09-30T16:49:01.316 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T16:49:01.311+0000 7f7ed2832640 -1 osd.1 0 waiting for initial osdmap 2023-09-30T16:49:01.334 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T16:49:01.331+0000 7f7ecae79640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.364 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T16:49:02.360+0000 7f4ae7003640 -1 osd.6 0 waiting for initial osdmap 2023-09-30T16:49:02.524 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T16:49:02.384+0000 7f3c0e77a640 -1 osd.5 0 waiting for initial osdmap 2023-09-30T16:49:02.525 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T16:49:02.388+0000 7f4adf64a640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.525 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T16:49:02.408+0000 7f254cd72640 -1 osd.4 0 waiting for initial osdmap 2023-09-30T16:49:02.525 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T16:49:02.424+0000 7f3c06dc1640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.525 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T16:49:02.440+0000 7f25453b9640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.819 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T16:49:02.816+0000 7fd82ff5a640 -1 osd.7 0 waiting for initial osdmap 2023-09-30T16:49:02.832 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T16:49:02.827+0000 7f6959e24640 -1 osd.2 0 waiting for initial osdmap 2023-09-30T16:49:02.841 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T16:49:02.835+0000 7f8228b14640 -1 osd.0 0 waiting for initial osdmap 2023-09-30T16:49:02.842 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T16:49:02.840+0000 7fd826d69640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.866 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T16:49:02.863+0000 7f822115b640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.866 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T16:49:02.863+0000 7f695246b640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:02.890 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T16:49:02.887+0000 7f19ca308640 -1 osd.3 0 waiting for initial osdmap 2023-09-30T16:49:02.930 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T16:49:02.927+0000 7f19c294f640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T16:49:03.129 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:03.286 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 Processor -- start 2023-09-30T16:49:03.286 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 -- start start 2023-09-30T16:49:03.288 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a001538c0 0x7f1a000b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:03.288 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1a000b0640 0x7f1a00070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:03.288 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000714d0 con 0x7f1a00071040 2023-09-30T16:49:03.288 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a000b0af0 con 0x7f1a001538c0 2023-09-30T16:49:03.288 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f1a05db7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a00071770 con 0x7f1a000b0640 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19ff7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a001538c0 0x7f1a000b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19fffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a00071040 0x7f1a0015cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34796/0 (socket says 172.21.15.52:34796) 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19fffff640 1 -- 172.21.15.52:0/470915704 learned_addr learned my addr 172.21.15.52:0/470915704 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19feffd640 1 --2- 172.21.15.52:0/470915704 >> v2:172.21.15.186:3300/0 conn(0x7f1a000b0640 0x7f1a00070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19ff7fe640 1 -- 172.21.15.52:0/470915704 >> v2:172.21.15.186:3300/0 conn(0x7f1a000b0640 msgr2=0x7f1a00070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19ff7fe640 1 --2- 172.21.15.52:0/470915704 >> v2:172.21.15.186:3300/0 conn(0x7f1a000b0640 0x7f1a00070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:03.289 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19ff7fe640 1 -- 172.21.15.52:0/470915704 >> v1:172.21.15.52:6789/0 conn(0x7f1a00071040 legacy=0x7f1a0015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:03.290 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19ff7fe640 1 -- 172.21.15.52:0/470915704 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00071a50 con 0x7f1a001538c0 2023-09-30T16:49:03.290 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.283+0000 7f19fe7fc640 1 -- 172.21.15.52:0/470915704 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382743138 0 0) 0x7f1a000714d0 con 0x7f1a00071040 2023-09-30T16:49:03.291 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19ff7fe640 1 --2- 172.21.15.52:0/470915704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a001538c0 0x7f1a000b0100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a0006ebd0 tx=0x7f19f001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86be441850049cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:03.291 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19fe7fc640 1 -- 172.21.15.52:0/470915704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ab600 con 0x7f1a001538c0 2023-09-30T16:49:03.292 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19fe7fc640 1 -- 172.21.15.52:0/470915704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00a7050 con 0x7f1a001538c0 2023-09-30T16:49:03.292 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19fe7fc640 1 -- 172.21.15.52:0/470915704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ab980 con 0x7f1a001538c0 2023-09-30T16:49:03.292 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/470915704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a001538c0 msgr2=0x7f1a000b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:03.292 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 --2- 172.21.15.52:0/470915704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a001538c0 0x7f1a000b0100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a0006ebd0 tx=0x7f19f001c460 comp rx=0 tx=0).stop 2023-09-30T16:49:03.292 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/470915704 shutdown_connections 2023-09-30T16:49:03.292 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 --2- 172.21.15.52:0/470915704 >> v2:172.21.15.186:3300/0 conn(0x7f1a000b0640 0x7f1a00070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:03.293 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 --2- 172.21.15.52:0/470915704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a001538c0 0x7f1a000b0100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:03.293 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/470915704 >> 172.21.15.52:0/470915704 conn(0x7f1a0006c0c0 msgr2=0x7f1a0006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:03.293 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/470915704 shutdown_connections 2023-09-30T16:49:03.293 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/470915704 wait complete. 2023-09-30T16:49:03.295 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 Processor -- start 2023-09-30T16:49:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- start start 2023-09-30T16:49:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a00071040 0x7f1a0014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 0x7f1a000c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a001538c0 0x7f1a0014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0014db20 con 0x7f1a000b0640 2023-09-30T16:49:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0014ef70 con 0x7f1a001538c0 2023-09-30T16:49:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0014e360 con 0x7f1a00071040 2023-09-30T16:49:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 0x7f1a000c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 0x7f1a000c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43346/0 (socket says 172.21.15.52:43346) 2023-09-30T16:49:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 -- 172.21.15.52:0/3107780359 learned_addr learned my addr 172.21.15.52:0/3107780359 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19fffff640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a001538c0 0x7f1a0014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19ff7fe640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a00071040 0x7f1a0014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:03.298 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 -- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a00071040 msgr2=0x7f1a0014dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:03.298 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a00071040 0x7f1a0014dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:03.298 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 -- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a001538c0 msgr2=0x7f1a0014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:03.298 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a001538c0 0x7f1a0014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:03.298 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 -- 172.21.15.52:0/3107780359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009420 con 0x7f1a000b0640 2023-09-30T16:49:03.298 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19fffff640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a001538c0 0x7f1a0014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:03.299 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19feffd640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 0x7f1a000c29a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d800 tx=0x7f19f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:03.299 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400b6c0 con 0x7f1a000b0640 2023-09-30T16:49:03.299 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400b820 con 0x7f1a000b0640 2023-09-30T16:49:03.299 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0014e640 con 0x7f1a000b0640 2023-09-30T16:49:03.299 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400bb90 con 0x7f1a000b0640 2023-09-30T16:49:03.299 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.287+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0014ec00 con 0x7f1a000b0640 2023-09-30T16:49:03.300 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.291+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0014f120 con 0x7f1a000b0640 2023-09-30T16:49:03.300 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.291+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7f19f400bcf0 con 0x7f1a000b0640 2023-09-30T16:49:03.300 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.291+0000 7f19e7fff640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f19ec066100 0x7f19ec0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:03.300 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.291+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f19f40832c0 con 0x7f1a000b0640 2023-09-30T16:49:03.300 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.291+0000 7f19ff7fe640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f19ec066100 0x7f19ec0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:03.300 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.291+0000 7f19ff7fe640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f19ec066100 0x7f19ec0685c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19f00ad000 tx=0x7f19f00a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:03.312 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.307+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1a0014f120 con 0x7f1a000b0640 2023-09-30T16:49:03.472 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.467+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a0014f0e0 con 0x7f1a000b0640 2023-09-30T16:49:03.474 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.467+0000 7f19e7fff640 1 -- 172.21.15.52:0/3107780359 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10943 (secure 0 0 0) 0x7f19f40515a0 con 0x7f1a000b0640 2023-09-30T16:49:03.474 INFO:teuthology.misc.health.smithi052.stdout: 2023-09-30T16:49:03.474 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":14,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:03.391194+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:04.335 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f19ec066100 msgr2=0x7f19ec0685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:04.335 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f19ec066100 0x7f19ec0685c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19f00ad000 tx=0x7f19f00a6000 comp rx=0 tx=0).stop 2023-09-30T16:49:04.335 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 msgr2=0x7f1a000c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:04.335 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 0x7f1a000c29a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d800 tx=0x7f19f400dcc0 comp rx=0 tx=0).stop 2023-09-30T16:49:04.335 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 shutdown_connections 2023-09-30T16:49:04.336 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f19ec066100 0x7f19ec0685c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:04.336 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a001538c0 0x7f1a0014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:04.336 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a000b0640 0x7f1a000c29a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:04.336 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 --2- 172.21.15.52:0/3107780359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a00071040 0x7f1a0014dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:04.336 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 >> 172.21.15.52:0/3107780359 conn(0x7f1a0006c0c0 msgr2=0x7f1a000b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:04.340 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 shutdown_connections 2023-09-30T16:49:04.341 INFO:teuthology.misc.health.smithi052.stderr:2023-09-30T16:49:03.471+0000 7f1a05db7640 1 -- 172.21.15.52:0/3107780359 wait complete. 2023-09-30T16:49:04.341 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-30T16:49:04.341 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T16:49:04.341 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T16:49:04.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T16:49:04.344 INFO:tasks.ceph.mds.a:Started 2023-09-30T16:49:04.818 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T16:49:04.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T16:49:04.819 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-09-30T16:49:04.823 INFO:tasks.ceph.mds.c:Started 2023-09-30T16:49:04.824 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T16:49:04.824 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T16:49:04.826 INFO:tasks.ceph.mds.b:Started 2023-09-30T16:49:04.968 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T16:49:04.968 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T16:49:04.970 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-09-30T16:49:04.972 INFO:tasks.ceph.mds.d:Started 2023-09-30T16:49:04.972 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T16:49:04.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:05.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 Processor -- start 2023-09-30T16:49:05.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 -- start start 2023-09-30T16:49:05.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 0x7f73ec0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f73ec0c94f0 0x7f73ec0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec069f30 con 0x7f73ec0c9e70 2023-09-30T16:49:05.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec0ce680 con 0x7f73ec0c94f0 2023-09-30T16:49:05.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73f0fae640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ce960 con 0x7f73ec159c60 2023-09-30T16:49:05.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73ead9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f73ec0c9e70 0x7f73ec15d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34822/0 (socket says 172.21.15.52:34822) 2023-09-30T16:49:05.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73ead9d640 1 -- 172.21.15.52:0/3668896942 learned_addr learned my addr 172.21.15.52:0/3668896942 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:05.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/3668896942 >> v2:172.21.15.186:3300/0 conn(0x7f73ec0c94f0 0x7f73ec0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73ea59c640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 0x7f73ec0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890250145 0 0) 0x7f73ec069f30 con 0x7f73ec0c9e70 2023-09-30T16:49:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d4003530 con 0x7f73ec0c9e70 2023-09-30T16:49:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420328045 0 0) 0x7f73d4003530 con 0x7f73ec0c9e70 2023-09-30T16:49:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 msgr2=0x7f73ec0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 0x7f73ec0cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 >> v2:172.21.15.186:3300/0 conn(0x7f73ec0c94f0 msgr2=0x7f73ec0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 --2- 172.21.15.52:0/3668896942 >> v2:172.21.15.186:3300/0 conn(0x7f73ec0c94f0 0x7f73ec0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0ca2c0 con 0x7f73ec0c9e70 2023-09-30T16:49:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f73e4001a00 con 0x7f73ec0c9e70 2023-09-30T16:49:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 >> v1:172.21.15.52:6789/0 conn(0x7f73ec0c9e70 legacy=0x7f73ec15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d40039f0 0x7f73d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73d40047d0 0x7f73d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 0x7f73d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ce680 con 0x7f73d40047d0 2023-09-30T16:49:05.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ce960 con 0x7f73d40039f0 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d400ba10 con 0x7f73ec159c60 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73d40047d0 0x7f73d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73ea59c640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d40039f0 0x7f73d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 -- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 msgr2=0x7f73d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73ead9d640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 0x7f73d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73ec159c60 0x7f73d4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 -- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d40039f0 msgr2=0x7f73d4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:05.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d40039f0 0x7f73d4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.099+0000 7f73e9d9b640 1 -- 172.21.15.52:0/3668896942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4003530 con 0x7f73d40047d0 2023-09-30T16:49:05.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73d40047d0 0x7f73d4004c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ae0 tx=0x7f73e001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f51d61bae6c047 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00a55a0 con 0x7f73d40047d0 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e00a5700 con 0x7f73d40047d0 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73e959a640 1 -- 172.21.15.52:0/3668896942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00a5ab0 con 0x7f73d40047d0 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 -- 172.21.15.52:0/3668896942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73d40047d0 msgr2=0x7f73d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 --2- 172.21.15.52:0/3668896942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73d40047d0 0x7f73d4004c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ae0 tx=0x7f73e001ca90 comp rx=0 tx=0).stop 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73ead9d640 1 -- 172.21.15.52:0/3668896942 reap_dead start 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 -- 172.21.15.52:0/3668896942 shutdown_connections 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 -- 172.21.15.52:0/3668896942 >> 172.21.15.52:0/3668896942 conn(0x7f73ec0b0b80 msgr2=0x7f73ec0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 -- 172.21.15.52:0/3668896942 shutdown_connections 2023-09-30T16:49:05.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 -- 172.21.15.52:0/3668896942 wait complete. 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 Processor -- start 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.103+0000 7f73f0fae640 1 -- start start 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d40047d0 0x7f73ec0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73ec0c7ca0 0x7f73ec0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 0x7f73ec144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec144f40 con 0x7f73ec144580 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec1618f0 con 0x7f73ec0c7ca0 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec160a00 con 0x7f73d40047d0 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 0x7f73ec144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 0x7f73ec144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43418/0 (socket says 172.21.15.52:43418) 2023-09-30T16:49:05.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 -- 172.21.15.52:0/1320745077 learned_addr learned my addr 172.21.15.52:0/1320745077 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ea59c640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d40047d0 0x7f73ec0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73ec0c7ca0 0x7f73ec0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 -- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d40047d0 msgr2=0x7f73ec0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d40047d0 0x7f73ec0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 -- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73ec0c7ca0 msgr2=0x7f73ec0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73ec0c7ca0 0x7f73ec0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 -- 172.21.15.52:0/1320745077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec160ce0 con 0x7f73ec144580 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73ec0c7ca0 0x7f73ec0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ead9d640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 0x7f73ec144a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73e4007c50 tx=0x7f73e400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4004d70 con 0x7f73ec144580 2023-09-30T16:49:05.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400bb80 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec160fc0 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4007070 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec161580 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec0740a0 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7f73e40071d0 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73daffd640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73cc0660d0 0x7f73cc068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f73e4083980 con 0x7f73ec144580 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.107+0000 7f73ea59c640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73cc0660d0 0x7f73cc068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.111+0000 7f73ea59c640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73cc0660d0 0x7f73cc068590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009950 tx=0x7f73dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.111+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f73e40513e0 con 0x7f73ec144580 2023-09-30T16:49:05.290 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2023-09-30T16:49:05.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.267+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73ec0b1600 con 0x7f73ec144580 2023-09-30T16:49:05.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73daffd640 1 -- 172.21.15.52:0/1320745077 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12866 (secure 0 0 0) 0x7f73e4054a00 con 0x7f73ec144580 2023-09-30T16:49:05.291 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2023-09-30T16:49:05.292 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:05.292 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:04.397753+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:05.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73cc0660d0 msgr2=0x7f73cc068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73f0fae640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73cc0660d0 0x7f73cc068590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009950 tx=0x7f73dc008040 comp rx=0 tx=0).stop 2023-09-30T16:49:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 msgr2=0x7f73ec144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73f0fae640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 0x7f73ec144a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73e4007c50 tx=0x7f73e400b4a0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 shutdown_connections 2023-09-30T16:49:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.271+0000 7f73f0fae640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73cc0660d0 0x7f73cc068590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.275+0000 7f73f0fae640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec144580 0x7f73ec144a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.275+0000 7f73f0fae640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73ec0c7ca0 0x7f73ec0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.275+0000 7f73f0fae640 1 --2- 172.21.15.52:0/1320745077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d40047d0 0x7f73ec0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.275+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 >> 172.21.15.52:0/1320745077 conn(0x7f73ec0b0b80 msgr2=0x7f73ec0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:05.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.275+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 shutdown_connections 2023-09-30T16:49:05.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.275+0000 7f73f0fae640 1 -- 172.21.15.52:0/1320745077 wait complete. 2023-09-30T16:49:05.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:05.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:05.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 Processor -- start 2023-09-30T16:49:05.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 -- start start 2023-09-30T16:49:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fcc06ca40 0x7f6fcc06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6fcc069e00 0x7f6fcc06a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc06d3e0 con 0x7f6fcc1591b0 2023-09-30T16:49:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0cab10 con 0x7f6fcc06ca40 2023-09-30T16:49:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fd21c3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc06a7d0 con 0x7f6fcc069e00 2023-09-30T16:49:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fcc06ca40 0x7f6fcc06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fcc06ca40 0x7f6fcc06cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58690/0 (socket says 172.21.15.52:58690) 2023-09-30T16:49:05.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 -- 172.21.15.52:0/3408433949 learned_addr learned my addr 172.21.15.52:0/3408433949 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:05.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fcbfff640 1 --2- 172.21.15.52:0/3408433949 >> v2:172.21.15.186:3300/0 conn(0x7f6fcc069e00 0x7f6fcc06a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 -- 172.21.15.52:0/3408433949 >> v2:172.21.15.186:3300/0 conn(0x7f6fcc069e00 msgr2=0x7f6fcc06a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:05.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 --2- 172.21.15.52:0/3408433949 >> v2:172.21.15.186:3300/0 conn(0x7f6fcc069e00 0x7f6fcc06a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 -- 172.21.15.52:0/3408433949 >> v1:172.21.15.186:6789/0 conn(0x7f6fcc1591b0 legacy=0x7f6fcc0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.423+0000 7f6fc3fff640 1 -- 172.21.15.52:0/3408433949 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc159590 con 0x7f6fcc06ca40 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fc3fff640 1 --2- 172.21.15.52:0/3408433949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc06ca40 0x7f6fcc06cea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0706c0 tx=0x7f6fb401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cce49d7c36bf42c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fcaffd640 1 -- 172.21.15.52:0/3408433949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40ab680 con 0x7f6fcc06ca40 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fcaffd640 1 -- 172.21.15.52:0/3408433949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb40ab7e0 con 0x7f6fcc06ca40 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fcaffd640 1 -- 172.21.15.52:0/3408433949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40abb70 con 0x7f6fcc06ca40 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 -- 172.21.15.52:0/3408433949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc06ca40 msgr2=0x7f6fcc06cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/3408433949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc06ca40 0x7f6fcc06cea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0706c0 tx=0x7f6fb401c500 comp rx=0 tx=0).stop 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 -- 172.21.15.52:0/3408433949 shutdown_connections 2023-09-30T16:49:05.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/3408433949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc06ca40 0x7f6fcc06cea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/3408433949 >> v2:172.21.15.186:3300/0 conn(0x7f6fcc069e00 0x7f6fcc06a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 -- 172.21.15.52:0/3408433949 >> 172.21.15.52:0/3408433949 conn(0x7f6fcc0cb950 msgr2=0x7f6fcc0cbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 -- 172.21.15.52:0/3408433949 shutdown_connections 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 -- 172.21.15.52:0/3408433949 wait complete. 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 Processor -- start 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.427+0000 7f6fd21c3640 1 -- start start 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 0x7f6fcc149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc06ca40 0x7f6fcc14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc1591b0 0x7f6fcc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0bfce0 con 0x7f6fcc069e00 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0bf6f0 con 0x7f6fcc1591b0 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c13b0 con 0x7f6fcc06ca40 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 0x7f6fcc149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 0x7f6fcc149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58696/0 (socket says 172.21.15.52:58696) 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 -- 172.21.15.52:0/2463959582 learned_addr learned my addr 172.21.15.52:0/2463959582 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc3fff640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc06ca40 0x7f6fcc14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcbfff640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc1591b0 0x7f6fcc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 -- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc06ca40 msgr2=0x7f6fcc14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc06ca40 0x7f6fcc14c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 -- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc1591b0 msgr2=0x7f6fcc0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc1591b0 0x7f6fcc0b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 -- 172.21.15.52:0/2463959582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40094d0 con 0x7f6fcc069e00 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc3fff640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc06ca40 0x7f6fcc14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fcb7fe640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 0x7f6fcc149a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c500 tx=0x7f6fbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc005220 con 0x7f6fcc069e00 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc005380 con 0x7f6fcc069e00 2023-09-30T16:49:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc14d090 con 0x7f6fcc069e00 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc007270 con 0x7f6fcc069e00 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc0bf900 con 0x7f6fcc069e00 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc0740a0 con 0x7f6fcc069e00 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7f6fbc0073d0 con 0x7f6fcc069e00 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc8ff9640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6fac066100 0x7f6fac0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fbc082ed0 con 0x7f6fcc069e00 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.431+0000 7f6fc3fff640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6fac066100 0x7f6fac0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.435+0000 7f6fc3fff640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6fac066100 0x7f6fac0685c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40af000 tx=0x7f6fb40a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.439+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6fbc050890 con 0x7f6fcc069e00 2023-09-30T16:49:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.607+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fcc0cc690 con 0x7f6fcc069e00 2023-09-30T16:49:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.607+0000 7f6fc8ff9640 1 -- 172.21.15.52:0/2463959582 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fbc053eb0 con 0x7f6fcc069e00 2023-09-30T16:49:05.759 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6fac066100 msgr2=0x7f6fac0685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6fac066100 0x7f6fac0685c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40af000 tx=0x7f6fb40a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 msgr2=0x7f6fcc149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 0x7f6fcc149a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c500 tx=0x7f6fbc00c9c0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 shutdown_connections 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6fac066100 0x7f6fac0685c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc1591b0 0x7f6fcc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc06ca40 0x7f6fcc14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 --2- 172.21.15.52:0/2463959582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fcc069e00 0x7f6fcc149a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 >> 172.21.15.52:0/2463959582 conn(0x7f6fcc0cb950 msgr2=0x7f6fcc0708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 shutdown_connections 2023-09-30T16:49:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.611+0000 7f6fd21c3640 1 -- 172.21.15.52:0/2463959582 wait complete. 2023-09-30T16:49:05.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:49:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 Processor -- start 2023-09-30T16:49:05.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 -- start start 2023-09-30T16:49:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5e1806a060 0x7f5e180ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e180cdf60 0x7f5e180abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e18072280 con 0x7f5e1806f6f0 2023-09-30T16:49:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e18071670 con 0x7f5e1806a060 2023-09-30T16:49:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e20731640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18071950 con 0x7f5e180cdf60 2023-09-30T16:49:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1ecce640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e1806f6f0 0x7f5e180ac460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60670/0 (socket says 172.21.15.52:60670) 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1ecce640 1 -- 172.21.15.52:0/3957048762 learned_addr learned my addr 172.21.15.52:0/3957048762 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/3957048762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e180cdf60 0x7f5e180abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1e4cd640 1 --2- 172.21.15.52:0/3957048762 >> v2:172.21.15.186:3300/0 conn(0x7f5e1806a060 0x7f5e180ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1d4cb640 1 -- 172.21.15.52:0/3957048762 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854102480 0 0) 0x7f5e18072280 con 0x7f5e1806f6f0 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1d4cb640 1 -- 172.21.15.52:0/3957048762 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e04003530 con 0x7f5e1806f6f0 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1dccc640 1 -- 172.21.15.52:0/3957048762 >> v2:172.21.15.186:3300/0 conn(0x7f5e1806a060 msgr2=0x7f5e180ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/3957048762 >> v2:172.21.15.186:3300/0 conn(0x7f5e1806a060 0x7f5e180ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1dccc640 1 -- 172.21.15.52:0/3957048762 >> v1:172.21.15.52:6789/0 conn(0x7f5e1806f6f0 legacy=0x7f5e180ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1dccc640 1 -- 172.21.15.52:0/3957048762 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18071c30 con 0x7f5e180cdf60 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.875+0000 7f5e1e4cd640 1 --2- 172.21.15.52:0/3957048762 >> v2:172.21.15.186:3300/0 conn(0x7f5e1806a060 0x7f5e180ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:49:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/3957048762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e180cdf60 0x7f5e180abf20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097c0 tx=0x7f5e0801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb36d919cef62ece server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e1d4cb640 1 -- 172.21.15.52:0/3957048762 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080a8970 con 0x7f5e180cdf60 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e1d4cb640 1 -- 172.21.15.52:0/3957048762 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e080a8ad0 con 0x7f5e180cdf60 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e1d4cb640 1 -- 172.21.15.52:0/3957048762 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080a8e40 con 0x7f5e180cdf60 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 -- 172.21.15.52:0/3957048762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e180cdf60 msgr2=0x7f5e180abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 --2- 172.21.15.52:0/3957048762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e180cdf60 0x7f5e180abf20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097c0 tx=0x7f5e0801ec70 comp rx=0 tx=0).stop 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 -- 172.21.15.52:0/3957048762 shutdown_connections 2023-09-30T16:49:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 --2- 172.21.15.52:0/3957048762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e180cdf60 0x7f5e180abf20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 --2- 172.21.15.52:0/3957048762 >> v2:172.21.15.186:3300/0 conn(0x7f5e1806a060 0x7f5e180ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 -- 172.21.15.52:0/3957048762 >> 172.21.15.52:0/3957048762 conn(0x7f5e1806d320 msgr2=0x7f5e1806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 -- 172.21.15.52:0/3957048762 shutdown_connections 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.879+0000 7f5e20731640 1 -- 172.21.15.52:0/3957048762 wait complete. 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 Processor -- start 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- start start 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 0x7f5e1815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e1806f6f0 0x7f5e1814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e180cdf60 0x7f5e1815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1815e6f0 con 0x7f5e1806a060 2023-09-30T16:49:05.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18159670 con 0x7f5e180cdf60 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1815e8e0 con 0x7f5e1806f6f0 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 0x7f5e1815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 0x7f5e1815e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58706/0 (socket says 172.21.15.52:58706) 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 -- 172.21.15.52:0/1042928418 learned_addr learned my addr 172.21.15.52:0/1042928418 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e1806f6f0 0x7f5e1814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1ecce640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e180cdf60 0x7f5e1815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 -- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e1806f6f0 msgr2=0x7f5e1814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e1806f6f0 0x7f5e1814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 -- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e180cdf60 msgr2=0x7f5e1815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e180cdf60 0x7f5e1815a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 -- 172.21.15.52:0/1042928418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14009420 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e1806f6f0 0x7f5e1814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e1e4cd640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 0x7f5e1815e1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400e9b0 tx=0x7f5e1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400ca00 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1400cb60 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e08009420 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14013470 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1815eea0 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e180740a0 con 0x7f5e1806a060 2023-09-30T16:49:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7f5e140135d0 con 0x7f5e1806a060 2023-09-30T16:49:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.883+0000 7f5e0effd640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5dfc066120 0x7f5dfc0685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.887+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e14083830 con 0x7f5e1806a060 2023-09-30T16:49:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.887+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5dfc066120 0x7f5dfc0685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.887+0000 7f5e1dccc640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5dfc066120 0x7f5dfc0685e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e080b2000 tx=0x7f5e080aa070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:05.891+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5e14051360 con 0x7f5e1806a060 2023-09-30T16:49:06.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e180cdd40 con 0x7f5e1806a060 2023-09-30T16:49:06.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e0effd640 1 -- 172.21.15.52:0/1042928418 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f5e14021e90 con 0x7f5e1806a060 2023-09-30T16:49:06.087 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:06.087 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-30T16:49:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2023-09-30T16:49:06.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5dfc066120 msgr2=0x7f5dfc0685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5dfc066120 0x7f5dfc0685e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e080b2000 tx=0x7f5e080aa070 comp rx=0 tx=0).stop 2023-09-30T16:49:06.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 msgr2=0x7f5e1815e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 0x7f5e1815e1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400e9b0 tx=0x7f5e1400ee70 comp rx=0 tx=0).stop 2023-09-30T16:49:06.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 shutdown_connections 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5dfc066120 0x7f5dfc0685e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e180cdf60 0x7f5e1815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e1806f6f0 0x7f5e1814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 --2- 172.21.15.52:0/1042928418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e1806a060 0x7f5e1815e1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 >> 172.21.15.52:0/1042928418 conn(0x7f5e1806d320 msgr2=0x7f5e180b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 shutdown_connections 2023-09-30T16:49:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.083+0000 7f5e20731640 1 -- 172.21.15.52:0/1042928418 wait complete. 2023-09-30T16:49:06.105 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.219+0000 7fcd025d9640 1 Processor -- start 2023-09-30T16:49:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.219+0000 7fcd025d9640 1 -- start start 2023-09-30T16:49:06.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd025d9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fccfc06a510 0x7fccfc15d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd025d9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc15dca0 con 0x7fccfc15c750 2023-09-30T16:49:06.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd025d9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc15cb30 con 0x7fccfc070cc0 2023-09-30T16:49:06.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd025d9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0cd370 con 0x7fccfc06a510 2023-09-30T16:49:06.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfbfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fccfc15c750 0x7fccfc0cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60680/0 (socket says 172.21.15.52:60680) 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfbfff640 1 -- 172.21.15.52:0/445618415 learned_addr learned my addr 172.21.15.52:0/445618415 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd00b76640 1 --2- 172.21.15.52:0/445618415 >> v2:172.21.15.186:3300/0 conn(0x7fccfc06a510 0x7fccfc15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926145294 0 0) 0x7fccec001120 con 0x7fccfc15c750 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce4005740 con 0x7fccfc15c750 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106261767 0 0) 0x7fcce4005740 con 0x7fccfc15c750 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 >> v2:172.21.15.186:3300/0 conn(0x7fccfc06a510 msgr2=0x7fccfc15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 --2- 172.21.15.52:0/445618415 >> v2:172.21.15.186:3300/0 conn(0x7fccfc06a510 0x7fccfc15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 >> v1:172.21.15.186:6789/0 conn(0x7fccfc070cc0 legacy=0x7fccfc069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0ccd20 con 0x7fccfc15c750 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fccec001810 con 0x7fccfc15c750 2023-09-30T16:49:06.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 >> v1:172.21.15.52:6789/0 conn(0x7fccfc15c750 legacy=0x7fccfc0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce4005c00 0x7fcce4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce40069e0 0x7fcce4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce40073f0 0x7fcce400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0cd370 con 0x7fcce40069e0 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce400e320 con 0x7fcce40073f0 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce400e4e0 con 0x7fcce4005c00 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce40069e0 0x7fcce4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd00b76640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce40073f0 0x7fcce400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfbfff640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce4005c00 0x7fcce4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfb7fe640 1 -- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce4005c00 msgr2=0x7fcce4005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce4005c00 0x7fcce4005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfb7fe640 1 -- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce40073f0 msgr2=0x7fcce400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:06.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce40073f0 0x7fcce400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fccfb7fe640 1 -- 172.21.15.52:0/445618415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4005740 con 0x7fcce40069e0 2023-09-30T16:49:06.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.223+0000 7fcd00b76640 1 -- 172.21.15.52:0/445618415 reap_dead start 2023-09-30T16:49:06.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce40069e0 0x7fcce4006e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fccf0001860 tx=0x7fccf001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58976fce99fe5ea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:06.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00ab600 con 0x7fcce40069e0 2023-09-30T16:49:06.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf00a7050 con 0x7fcce40069e0 2023-09-30T16:49:06.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fccfaffd640 1 -- 172.21.15.52:0/445618415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00ab9a0 con 0x7fcce40069e0 2023-09-30T16:49:06.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 -- 172.21.15.52:0/445618415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce40069e0 msgr2=0x7fcce4006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce40069e0 0x7fcce4006e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fccf0001860 tx=0x7fccf001c490 comp rx=0 tx=0).stop 2023-09-30T16:49:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 -- 172.21.15.52:0/445618415 shutdown_connections 2023-09-30T16:49:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 --2- 172.21.15.52:0/445618415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce40069e0 0x7fcce4006e60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 -- 172.21.15.52:0/445618415 >> 172.21.15.52:0/445618415 conn(0x7fccfc0cb590 msgr2=0x7fccfc0cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 -- 172.21.15.52:0/445618415 shutdown_connections 2023-09-30T16:49:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.227+0000 7fcd025d9640 1 -- 172.21.15.52:0/445618415 wait complete. 2023-09-30T16:49:06.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 Processor -- start 2023-09-30T16:49:06.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 -- start start 2023-09-30T16:49:06.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce40069e0 0x7fccfc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 0x7fccfc155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccfc159880 0x7fccfc150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc155800 con 0x7fccfc154660 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc151e90 con 0x7fccfc159880 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc154e40 con 0x7fcce40069e0 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 0x7fccfc155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 0x7fccfc155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58726/0 (socket says 172.21.15.52:58726) 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 -- 172.21.15.52:0/506169132 learned_addr learned my addr 172.21.15.52:0/506169132 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfbfff640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce40069e0 0x7fccfc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd00b76640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccfc159880 0x7fccfc150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 -- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce40069e0 msgr2=0x7fccfc157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce40069e0 0x7fccfc157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 -- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccfc159880 msgr2=0x7fccfc150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccfc159880 0x7fccfc150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 -- 172.21.15.52:0/506169132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc155180 con 0x7fccfc154660 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccfb7fe640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 0x7fccfc155c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccf001c2c0 tx=0x7fcce4007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0007240 con 0x7fccfc154660 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf00073a0 con 0x7fccfc154660 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 -- 172.21.15.52:0/506169132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc154b60 con 0x7fccfc154660 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0007710 con 0x7fccfc154660 2023-09-30T16:49:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcd025d9640 1 -- 172.21.15.52:0/506169132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc158350 con 0x7fccfc154660 2023-09-30T16:49:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.231+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4005260 con 0x7fccfc154660 2023-09-30T16:49:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.235+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7fccf00b2040 con 0x7fccfc154660 2023-09-30T16:49:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.235+0000 7fccf8ff9640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcce8066100 0x7fcce80685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.235+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fccf011cd40 con 0x7fccfc154660 2023-09-30T16:49:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.235+0000 7fccfbfff640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcce8066100 0x7fcce80685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.235+0000 7fccfbfff640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcce8066100 0x7fcce80685c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c10 tx=0x7fccec007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.239+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fccf00ea8d0 con 0x7fccfc154660 2023-09-30T16:49:06.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.395+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd4005510 con 0x7fccfc154660 2023-09-30T16:49:06.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.395+0000 7fccf8ff9640 1 -- 172.21.15.52:0/506169132 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12875 (secure 0 0 0) 0x7fccf00edef0 con 0x7fccfc154660 2023-09-30T16:49:06.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:06.400 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:05.405308+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcce8066100 msgr2=0x7fcce80685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcce8066100 0x7fcce80685c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c10 tx=0x7fccec007040 comp rx=0 tx=0).stop 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 msgr2=0x7fccfc155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 0x7fccfc155c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccf001c2c0 tx=0x7fcce4007a10 comp rx=0 tx=0).stop 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 shutdown_connections 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcce8066100 0x7fcce80685c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccfc159880 0x7fccfc150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccfc154660 0x7fccfc155c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 --2- 172.21.15.52:0/506169132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce40069e0 0x7fccfc157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 >> 172.21.15.52:0/506169132 conn(0x7fccfc0cb590 msgr2=0x7fccfc0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 shutdown_connections 2023-09-30T16:49:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.399+0000 7fcce27fc640 1 -- 172.21.15.52:0/506169132 wait complete. 2023-09-30T16:49:06.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:06.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:06.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 Processor -- start 2023-09-30T16:49:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 -- start start 2023-09-30T16:49:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f97680d0850 0x7f97680d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97680cba80 0x7f97680cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680d11f0 con 0x7f976815ab50 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680ceee0 con 0x7f97680d0850 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f976de8a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680cf1c0 con 0x7f97680cba80 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f97680d0850 0x7f97680d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f97680d0850 0x7f97680d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57956/0 (socket says 172.21.15.52:57956) 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 -- 172.21.15.52:0/2126278988 learned_addr learned my addr 172.21.15.52:0/2126278988 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9767fff640 1 --2- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97680cba80 0x7f97680cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 -- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97680cba80 msgr2=0x7f97680cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 --2- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97680cba80 0x7f97680cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 -- 172.21.15.52:0/2126278988 >> v1:172.21.15.186:6789/0 conn(0x7f976815ab50 legacy=0x7f97680ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.647+0000 7f9766ffd640 1 -- 172.21.15.52:0/2126278988 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680cf4a0 con 0x7f97680d0850 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f9766ffd640 1 --2- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680d0cb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9750009870 tx=0x7f975001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc258310d4f32fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f97667fc640 1 -- 172.21.15.52:0/2126278988 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500a6040 con 0x7f97680d0850 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f97667fc640 1 -- 172.21.15.52:0/2126278988 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97500aa600 con 0x7f97680d0850 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f97667fc640 1 -- 172.21.15.52:0/2126278988 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500aa990 con 0x7f97680d0850 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 -- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 msgr2=0x7f97680d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 --2- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680d0cb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9750009870 tx=0x7f975001c510 comp rx=0 tx=0).stop 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 -- 172.21.15.52:0/2126278988 shutdown_connections 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 --2- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97680cba80 0x7f97680cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 --2- 172.21.15.52:0/2126278988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680d0cb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 -- 172.21.15.52:0/2126278988 >> 172.21.15.52:0/2126278988 conn(0x7f9768089ff0 msgr2=0x7f9768099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 -- 172.21.15.52:0/2126278988 shutdown_connections 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.651+0000 7f976de8a640 1 -- 172.21.15.52:0/2126278988 wait complete. 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 Processor -- start 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 -- start start 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 0x7f9768159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f976815ab50 0x7f976815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976815cab0 con 0x7f97680cba80 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976815e110 con 0x7f97680d0850 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f976de8a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97681596a0 con 0x7f976815ab50 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 0x7f9768159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 0x7f9768159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58742/0 (socket says 172.21.15.52:58742) 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f9767fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f976815ab50 0x7f976815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 -- 172.21.15.52:0/533039736 learned_addr learned my addr 172.21.15.52:0/533039736 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f9766ffd640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 -- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f976815ab50 msgr2=0x7f976815d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f976815ab50 0x7f976815d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 -- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 msgr2=0x7f97680b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 -- 172.21.15.52:0/533039736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500094d0 con 0x7f97680cba80 2023-09-30T16:49:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.655+0000 7f97677fe640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 0x7f9768159160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f975800c3a0 tx=0x7f975800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580052d0 con 0x7f97680cba80 2023-09-30T16:49:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758005450 con 0x7f97680cba80 2023-09-30T16:49:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758003860 con 0x7f97680cba80 2023-09-30T16:49:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680b4e10 con 0x7f97680cba80 2023-09-30T16:49:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97680b53d0 con 0x7f97680cba80 2023-09-30T16:49:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97680b4bd0 con 0x7f97680cba80 2023-09-30T16:49:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7f97580039c0 con 0x7f97680cba80 2023-09-30T16:49:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f975ffff640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f97480660d0 0x7f9748068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9758082c70 con 0x7f97680cba80 2023-09-30T16:49:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.671+0000 7f9766ffd640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f97480660d0 0x7f9748068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.675+0000 7f9766ffd640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f97480660d0 0x7f9748068590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97500ae000 tx=0x7f97500b5040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.675+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f97580508e0 con 0x7f97680cba80 2023-09-30T16:49:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.831+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97680b4bd0 con 0x7f97680cba80 2023-09-30T16:49:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f975ffff640 1 -- 172.21.15.52:0/533039736 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97680b4bd0 con 0x7f97680cba80 2023-09-30T16:49:06.994 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f97480660d0 msgr2=0x7f9748068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f97480660d0 0x7f9748068590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97500ae000 tx=0x7f97500b5040 comp rx=0 tx=0).stop 2023-09-30T16:49:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 msgr2=0x7f9768159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 0x7f9768159160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f975800c3a0 tx=0x7f975800c860 comp rx=0 tx=0).stop 2023-09-30T16:49:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 shutdown_connections 2023-09-30T16:49:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f97480660d0 0x7f9748068590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f976815ab50 0x7f976815d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97680d0850 0x7f97680b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 --2- 172.21.15.52:0/533039736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97680cba80 0x7f9768159160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 >> 172.21.15.52:0/533039736 conn(0x7f9768089ff0 msgr2=0x7f97680ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 shutdown_connections 2023-09-30T16:49:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:06.835+0000 7f976de8a640 1 -- 172.21.15.52:0/533039736 wait complete. 2023-09-30T16:49:07.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T16:49:07.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.123+0000 7fd08936b640 1 Processor -- start 2023-09-30T16:49:07.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.123+0000 7fd08936b640 1 -- start start 2023-09-30T16:49:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd08936b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd0840ca590 0x7fd0840ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd08936b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840caf00 con 0x7fd084159df0 2023-09-30T16:49:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd08936b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840c9dd0 con 0x7fd0841574c0 2023-09-30T16:49:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd08936b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08415ae50 con 0x7fd0840ca590 2023-09-30T16:49:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd084159df0 0x7fd08406bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60682/0 (socket says 172.21.15.52:60682) 2023-09-30T16:49:07.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 -- 172.21.15.52:0/536693664 learned_addr learned my addr 172.21.15.52:0/536693664 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0837fe640 1 --2- 172.21.15.52:0/536693664 >> v2:172.21.15.186:3300/0 conn(0x7fd0840ca590 0x7fd0840ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543553137 0 0) 0x7fd078001120 con 0x7fd084159df0 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd06c003530 con 0x7fd084159df0 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4062370745 0 0) 0x7fd06c003530 con 0x7fd084159df0 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 >> v2:172.21.15.186:3300/0 conn(0x7fd0840ca590 msgr2=0x7fd0840ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 --2- 172.21.15.52:0/536693664 >> v2:172.21.15.186:3300/0 conn(0x7fd0840ca590 0x7fd0840ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 >> v1:172.21.15.186:6789/0 conn(0x7fd0841574c0 legacy=0x7fd0840cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08415a5b0 con 0x7fd084159df0 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fd078001810 con 0x7fd084159df0 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 >> v1:172.21.15.52:6789/0 conn(0x7fd084159df0 legacy=0x7fd08406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd06c0039f0 0x7fd06c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd06c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd06c005190 0x7fd06c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415ae50 con 0x7fd06c0047d0 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00c0c0 con 0x7fd06c0039f0 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00c280 con 0x7fd06c005190 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd06c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 -- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd06c005190 msgr2=0x7fd06c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd06c005190 0x7fd06c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 -- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd06c0039f0 msgr2=0x7fd06c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd082ffd640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd06c0039f0 0x7fd06c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd06c0039f0 0x7fd06c003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0837fe640 1 -- 172.21.15.52:0/536693664 reap_dead start 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 -- 172.21.15.52:0/536693664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c003530 con 0x7fd06c0047d0 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd0827fc640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd06c004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd07800e450 tx=0x7fd0780219f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2427a058baada21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078005ae0 con 0x7fd06c0047d0 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078005c60 con 0x7fd06c0047d0 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.127+0000 7fd081ffb640 1 -- 172.21.15.52:0/536693664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780072b0 con 0x7fd06c0047d0 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/536693664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 msgr2=0x7fd06c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd06c004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd07800e450 tx=0x7fd0780219f0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/536693664 shutdown_connections 2023-09-30T16:49:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 --2- 172.21.15.52:0/536693664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd06c004c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/536693664 >> 172.21.15.52:0/536693664 conn(0x7fd08406a5f0 msgr2=0x7fd0840ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/536693664 shutdown_connections 2023-09-30T16:49:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/536693664 wait complete. 2023-09-30T16:49:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 Processor -- start 2023-09-30T16:49:07.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- start start 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd0840b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0841f18a0 0x7fd0840c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0841eea50 0x7fd0841eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841ee5c0 con 0x7fd06c0047d0 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841ee2b0 con 0x7fd0841f18a0 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841f2080 con 0x7fd0841eea50 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd0840b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd0840b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58768/0 (socket says 172.21.15.52:58768) 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 -- 172.21.15.52:0/1326104773 learned_addr learned my addr 172.21.15.52:0/1326104773 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:07.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd0827fc640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0841f18a0 0x7fd0840c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd0837fe640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0841eea50 0x7fd0841eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 -- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0841eea50 msgr2=0x7fd0841eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0841eea50 0x7fd0841eeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 -- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0841f18a0 msgr2=0x7fd0840c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0841f18a0 0x7fd0840c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 -- 172.21.15.52:0/1326104773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0841f2360 con 0x7fd06c0047d0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd082ffd640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd0840b11a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd07400d4f0 tx=0x7fd07400d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074005480 con 0x7fd06c0047d0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074003620 con 0x7fd06c0047d0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074003990 con 0x7fd06c0047d0 2023-09-30T16:49:07.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0841f2640 con 0x7fd06c0047d0 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.131+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0840c7fd0 con 0x7fd06c0047d0 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.135+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0841f2830 con 0x7fd06c0047d0 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.135+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7fd074003af0 con 0x7fd06c0047d0 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.135+0000 7fd06b7fe640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd0700660d0 0x7fd070068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.135+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0740835b0 con 0x7fd06c0047d0 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.135+0000 7fd0827fc640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd0700660d0 0x7fd070068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.135+0000 7fd0827fc640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd0700660d0 0x7fd070068590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd0780b2000 tx=0x7fd0780ad070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.139+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd0841f2830 con 0x7fd06c0047d0 2023-09-30T16:49:07.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.291+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0841f2830 con 0x7fd06c0047d0 2023-09-30T16:49:07.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.291+0000 7fd06b7fe640 1 -- 172.21.15.52:0/1326104773 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd0841f2830 con 0x7fd06c0047d0 2023-09-30T16:49:07.296 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:07.296 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-09-30T16:49:07.296 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:49:07.296 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-09-30T16:49:07.296 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2023-09-30T16:49:07.297 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:49:07.297 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-09-30T16:49:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd0700660d0 msgr2=0x7fd070068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd0700660d0 0x7fd070068590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd0780b2000 tx=0x7fd0780ad070 comp rx=0 tx=0).stop 2023-09-30T16:49:07.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 msgr2=0x7fd0840b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd0840b11a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd07400d4f0 tx=0x7fd07400d9b0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 shutdown_connections 2023-09-30T16:49:07.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd0700660d0 0x7fd070068590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0841eea50 0x7fd0841eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0841f18a0 0x7fd0840c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 --2- 172.21.15.52:0/1326104773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0047d0 0x7fd0840b11a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 >> 172.21.15.52:0/1326104773 conn(0x7fd08406a5f0 msgr2=0x7fd0840b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 shutdown_connections 2023-09-30T16:49:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.295+0000 7fd08936b640 1 -- 172.21.15.52:0/1326104773 wait complete. 2023-09-30T16:49:07.313 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T16:49:07.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T16:49:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 Processor -- start 2023-09-30T16:49:07.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 -- start start 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa71815a9e0 0x7fa718070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7180b2310 0x7fa7180b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7180b2cb0 con 0x7fa7180b63e0 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7180b3ef0 con 0x7fa7180b2310 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa7202e3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7180ce770 con 0x7fa71815a9e0 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7180b2310 0x7fa7180b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7180b2310 0x7fa7180b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58776/0 (socket says 172.21.15.52:58776) 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71d87e640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa7180b63e0 0x7fa7180b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:49000/0 (socket says 172.21.15.52:49000) 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e07f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa71815a9e0 0x7fa718070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 -- 172.21.15.52:0/3392255913 learned_addr learned my addr 172.21.15.52:0/3392255913 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 -- 172.21.15.52:0/3392255913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa71815a9e0 msgr2=0x7fa718070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 --2- 172.21.15.52:0/3392255913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa71815a9e0 0x7fa718070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 -- 172.21.15.52:0/3392255913 >> v1:172.21.15.186:6789/0 conn(0x7fa7180b63e0 legacy=0x7fa7180b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.427+0000 7fa71e880640 1 -- 172.21.15.52:0/3392255913 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7180cea10 con 0x7fa7180b2310 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa71e880640 1 --2- 172.21.15.52:0/3392255913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7180b2310 0x7fa7180b2770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa710009870 tx=0x7fa71001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3735d8c6860a96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa71d07d640 1 -- 172.21.15.52:0/3392255913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100ab680 con 0x7fa7180b2310 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa71d07d640 1 -- 172.21.15.52:0/3392255913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7100ab7e0 con 0x7fa7180b2310 2023-09-30T16:49:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa71d07d640 1 -- 172.21.15.52:0/3392255913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100abb70 con 0x7fa7180b2310 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 -- 172.21.15.52:0/3392255913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7180b2310 msgr2=0x7fa7180b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 --2- 172.21.15.52:0/3392255913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7180b2310 0x7fa7180b2770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa710009870 tx=0x7fa71001c480 comp rx=0 tx=0).stop 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 -- 172.21.15.52:0/3392255913 shutdown_connections 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 --2- 172.21.15.52:0/3392255913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7180b2310 0x7fa7180b2770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 --2- 172.21.15.52:0/3392255913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa71815a9e0 0x7fa718070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 -- 172.21.15.52:0/3392255913 >> 172.21.15.52:0/3392255913 conn(0x7fa7180cd310 msgr2=0x7fa7180cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 -- 172.21.15.52:0/3392255913 shutdown_connections 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 -- 172.21.15.52:0/3392255913 wait complete. 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.431+0000 7fa7202e3640 1 Processor -- start 2023-09-30T16:49:07.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- start start 2023-09-30T16:49:07.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7180b2310 0x7fa718156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7180b63e0 0x7fa7181544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 0x7fa718154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa718151b90 con 0x7fa71815a9e0 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa718150f10 con 0x7fa7180b2310 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7181511f0 con 0x7fa7180b63e0 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 0x7fa718154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 0x7fa718154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58790/0 (socket says 172.21.15.52:58790) 2023-09-30T16:49:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 -- 172.21.15.52:0/1667073890 learned_addr learned my addr 172.21.15.52:0/1667073890 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e07f640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7180b2310 0x7fa718156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71d87e640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7180b63e0 0x7fa7181544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 -- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7180b63e0 msgr2=0x7fa7181544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7180b63e0 0x7fa7181544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 -- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7180b2310 msgr2=0x7fa718156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7180b2310 0x7fa718156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 -- 172.21.15.52:0/1667073890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100094d0 con 0x7fa71815a9e0 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e880640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 0x7fa718154a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa7100ad040 tx=0x7fa71001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100be5f0 con 0x7fa71815a9e0 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7100be770 con 0x7fa71815a9e0 2023-09-30T16:49:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7181514d0 con 0x7fa71815a9e0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100beb20 con 0x7fa71815a9e0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7181627b0 con 0x7fa71815a9e0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa718066750 con 0x7fa71815a9e0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 85620+0+0 (secure 0 0 0) 0x7fa7100b43f0 con 0x7fa71815a9e0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa716ffd640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa7040660d0 0x7fa704068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa71011e7e0 con 0x7fa71815a9e0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.435+0000 7fa71e07f640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa7040660d0 0x7fa704068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.439+0000 7fa71e07f640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa7040660d0 0x7fa704068590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009a50 tx=0x7fa70c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:07.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.439+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fa7100ec2c0 con 0x7fa71815a9e0 2023-09-30T16:49:07.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:07.595+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa7180ce430 con 0x7fa71815a9e0 2023-09-30T16:49:08.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.383+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa7100ec690 con 0x7fa71815a9e0 2023-09-30T16:49:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.555+0000 7fa716ffd640 1 -- 172.21.15.52:0/1667073890 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa7101055a0 con 0x7fa71815a9e0 2023-09-30T16:49:08.561 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-09-30T16:49:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa7040660d0 msgr2=0x7fa704068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa7040660d0 0x7fa704068590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009a50 tx=0x7fa70c008040 comp rx=0 tx=0).stop 2023-09-30T16:49:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 msgr2=0x7fa718154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 0x7fa718154a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa7100ad040 tx=0x7fa71001acc0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 shutdown_connections 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa7040660d0 0x7fa704068590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa71815a9e0 0x7fa718154a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7180b63e0 0x7fa7181544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 --2- 172.21.15.52:0/1667073890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7180b2310 0x7fa718156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 >> 172.21.15.52:0/1667073890 conn(0x7fa7180cd310 msgr2=0x7fa71815a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 shutdown_connections 2023-09-30T16:49:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.559+0000 7fa7202e3640 1 -- 172.21.15.52:0/1667073890 wait complete. 2023-09-30T16:49:08.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T16:49:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fade0194640 1 Processor -- start 2023-09-30T16:49:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fade0194640 1 -- start start 2023-09-30T16:49:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fade0194640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fadd80c9d20 0x7fadd8070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fade0194640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd815d3a0 con 0x7fadd80ca1a0 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fade0194640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd806db80 con 0x7fadd8159780 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fade0194640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80cd740 con 0x7fadd80c9d20 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fadde731640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fadd80ca1a0 0x7fadd815d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60688/0 (socket says 172.21.15.52:60688) 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fadde731640 1 -- 172.21.15.52:0/3767859264 learned_addr learned my addr 172.21.15.52:0/3767859264 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 --2- 172.21.15.52:0/3767859264 >> v2:172.21.15.186:3300/0 conn(0x7fadd80c9d20 0x7fadd8070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763287746 0 0) 0x7fadd815d3a0 con 0x7fadd80ca1a0 2023-09-30T16:49:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc4003530 con 0x7fadd80ca1a0 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1793114758 0 0) 0x7fadc4003530 con 0x7fadd80ca1a0 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 >> v2:172.21.15.186:3300/0 conn(0x7fadd80c9d20 msgr2=0x7fadd8070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 --2- 172.21.15.52:0/3767859264 >> v2:172.21.15.186:3300/0 conn(0x7fadd80c9d20 0x7fadd8070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 >> v1:172.21.15.186:6789/0 conn(0x7fadd8159780 legacy=0x7fadd806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80cda20 con 0x7fadd80ca1a0 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fadd0001a00 con 0x7fadd80ca1a0 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 >> v1:172.21.15.52:6789/0 conn(0x7fadd80ca1a0 legacy=0x7fadd815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadc4003980 0x7fadc4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadc4005190 0x7fadc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80cd740 con 0x7fadc40047d0 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc400c130 con 0x7fadc4003980 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc400c2f0 con 0x7fadc4005190 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fadddf30640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadc4003980 0x7fadc4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fadde731640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadc4005190 0x7fadc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 -- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadc4005190 msgr2=0x7fadc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadc4005190 0x7fadc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 -- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadc4003980 msgr2=0x7fadc4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadc4003980 0x7fadc4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7fadde731640 1 -- 172.21.15.52:0/3767859264 reap_dead start 2023-09-30T16:49:08.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.715+0000 7faddd72f640 1 -- 172.21.15.52:0/3767859264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4003530 con 0x7fadc40047d0 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7faddd72f640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadc4004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009ae0 tx=0x7fadc801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6962da1a0c6a441 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80a55f0 con 0x7fadc40047d0 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80a5750 con 0x7fadc40047d0 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7faddcf2e640 1 -- 172.21.15.52:0/3767859264 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80a5b00 con 0x7fadc40047d0 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- 172.21.15.52:0/3767859264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 msgr2=0x7fadc4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadc4004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009ae0 tx=0x7fadc801ca20 comp rx=0 tx=0).stop 2023-09-30T16:49:08.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- 172.21.15.52:0/3767859264 shutdown_connections 2023-09-30T16:49:08.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 --2- 172.21.15.52:0/3767859264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadc4004c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- 172.21.15.52:0/3767859264 >> 172.21.15.52:0/3767859264 conn(0x7fadd806a5c0 msgr2=0x7fadd80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:08.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- 172.21.15.52:0/3767859264 shutdown_connections 2023-09-30T16:49:08.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- 172.21.15.52:0/3767859264 wait complete. 2023-09-30T16:49:08.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 Processor -- start 2023-09-30T16:49:08.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- start start 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadd80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadd80c75d0 0x7fadd814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadd81e8b80 0x7fadd81e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c2560 con 0x7fadc40047d0 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81e9540 con 0x7fadd81e8b80 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fade0194640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c65b0 con 0x7fadd80c75d0 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fadddf30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadd80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fadddf30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadd80c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58800/0 (socket says 172.21.15.52:58800) 2023-09-30T16:49:08.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.719+0000 7fadddf30640 1 -- 172.21.15.52:0/3445009465 learned_addr learned my addr 172.21.15.52:0/3445009465 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadddf30640 1 -- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadd80c75d0 msgr2=0x7fadd814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadddf30640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadd80c75d0 0x7fadd814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadddf30640 1 -- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadd81e8b80 msgr2=0x7fadd81e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadde731640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadd81e8b80 0x7fadd81e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadddf30640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadd81e8b80 0x7fadd81e9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadddf30640 1 -- 172.21.15.52:0/3445009465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80c6850 con 0x7fadc40047d0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadddf30640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadd80c6070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fadd4001ec0 tx=0x7fadd400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd40052e0 con 0x7fadc40047d0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd4005440 con 0x7fadc40047d0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80c6b30 con 0x7fadc40047d0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4003820 con 0x7fadc40047d0 2023-09-30T16:49:08.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80c70f0 con 0x7fadc40047d0 2023-09-30T16:49:08.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd80740a0 con 0x7fadc40047d0 2023-09-30T16:49:08.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fadd4003980 con 0x7fadc40047d0 2023-09-30T16:49:08.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadce7fc640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fadbc066160 0x7fadbc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:08.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fadd4083040 con 0x7fadc40047d0 2023-09-30T16:49:08.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7faddd72f640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fadbc066160 0x7fadbc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:08.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.723+0000 7faddd72f640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fadbc066160 0x7fadbc068620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadc80af000 tx=0x7fadc8004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:08.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.727+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fadd40508f0 con 0x7fadc40047d0 2023-09-30T16:49:08.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:08.879+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fadd80713d0 con 0x7fadc40047d0 2023-09-30T16:49:09.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.559+0000 7fadce7fc640 1 -- 172.21.15.52:0/3445009465 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fadd40190d0 con 0x7fadc40047d0 2023-09-30T16:49:09.566 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-09-30T16:49:09.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fadbc066160 msgr2=0x7fadbc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fadbc066160 0x7fadbc068620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadc80af000 tx=0x7fadc8004740 comp rx=0 tx=0).stop 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 msgr2=0x7fadd80c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadd80c6070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fadd4001ec0 tx=0x7fadd400e8a0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 shutdown_connections 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fadbc066160 0x7fadbc068620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadd81e8b80 0x7fadd81e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadd80c75d0 0x7fadd814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 --2- 172.21.15.52:0/3445009465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadc40047d0 0x7fadd80c6070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 >> 172.21.15.52:0/3445009465 conn(0x7fadd806a5c0 msgr2=0x7fadd815bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 shutdown_connections 2023-09-30T16:49:09.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.563+0000 7fade0194640 1 -- 172.21.15.52:0/3445009465 wait complete. 2023-09-30T16:49:09.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T16:49:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 Processor -- start 2023-09-30T16:49:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 -- start start 2023-09-30T16:49:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe52c15cc60 0x7fe52c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d0040 0x7fe52c0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe52c0d25b0 0x7fe52c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0d04a0 con 0x7fe52c15cc60 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0d39b0 con 0x7fe52c0d25b0 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe532fdb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c15d040 con 0x7fe52c0d0040 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe52c15cc60 0x7fe52c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe52c15cc60 0x7fe52c0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58802/0 (socket says 172.21.15.52:58802) 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 -- 172.21.15.52:0/1220837725 learned_addr learned my addr 172.21.15.52:0/1220837725 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe52bfff640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d0040 0x7fe52c0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe531578640 1 --2- 172.21.15.52:0/1220837725 >> v2:172.21.15.186:3300/0 conn(0x7fe52c0d25b0 0x7fe52c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 -- 172.21.15.52:0/1220837725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d0040 msgr2=0x7fe52c0d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d0040 0x7fe52c0d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 -- 172.21.15.52:0/1220837725 >> v2:172.21.15.186:3300/0 conn(0x7fe52c0d25b0 msgr2=0x7fe52c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 --2- 172.21.15.52:0/1220837725 >> v2:172.21.15.186:3300/0 conn(0x7fe52c0d25b0 0x7fe52c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe530d77640 1 -- 172.21.15.52:0/1220837725 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0d2da0 con 0x7fe52c15cc60 2023-09-30T16:49:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe531578640 1 --2- 172.21.15.52:0/1220837725 >> v2:172.21.15.186:3300/0 conn(0x7fe52c0d25b0 0x7fe52c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.727+0000 7fe52bfff640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d0040 0x7fe52c0d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:09.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe530d77640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c15cc60 0x7fe52c0cfb00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0b2550 tx=0x7fe51c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b331ce644c7ad5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:09.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe52b7fe640 1 -- 172.21.15.52:0/1220837725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0ab600 con 0x7fe52c15cc60 2023-09-30T16:49:09.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe52b7fe640 1 -- 172.21.15.52:0/1220837725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c0a7050 con 0x7fe52c15cc60 2023-09-30T16:49:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe52b7fe640 1 -- 172.21.15.52:0/1220837725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0ab980 con 0x7fe52c15cc60 2023-09-30T16:49:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 -- 172.21.15.52:0/1220837725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c15cc60 msgr2=0x7fe52c0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c15cc60 0x7fe52c0cfb00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0b2550 tx=0x7fe51c01c210 comp rx=0 tx=0).stop 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 -- 172.21.15.52:0/1220837725 shutdown_connections 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 --2- 172.21.15.52:0/1220837725 >> v2:172.21.15.186:3300/0 conn(0x7fe52c0d25b0 0x7fe52c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d0040 0x7fe52c0d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 --2- 172.21.15.52:0/1220837725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c15cc60 0x7fe52c0cfb00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 -- 172.21.15.52:0/1220837725 >> 172.21.15.52:0/1220837725 conn(0x7fe52c071930 msgr2=0x7fe52c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 -- 172.21.15.52:0/1220837725 shutdown_connections 2023-09-30T16:49:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.731+0000 7fe532fdb640 1 -- 172.21.15.52:0/1220837725 wait complete. 2023-09-30T16:49:09.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 Processor -- start 2023-09-30T16:49:09.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 -- start start 2023-09-30T16:49:09.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 0x7fe52c0b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d25b0 0x7fe52c0b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe52c15cc60 0x7fe52c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c158010 con 0x7fe52c0d0040 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c157720 con 0x7fe52c15cc60 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1579c0 con 0x7fe52c0d25b0 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 0x7fe52c0b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 0x7fe52c0b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58816/0 (socket says 172.21.15.52:58816) 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 -- 172.21.15.52:0/2651751106 learned_addr learned my addr 172.21.15.52:0/2651751106 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe52bfff640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d25b0 0x7fe52c0b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe531578640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe52c15cc60 0x7fe52c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 -- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d25b0 msgr2=0x7fe52c0b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d25b0 0x7fe52c0b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 -- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe52c15cc60 msgr2=0x7fe52c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe52c15cc60 0x7fe52c1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 -- 172.21.15.52:0/2651751106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0094d0 con 0x7fe52c0d0040 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe531578640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe52c15cc60 0x7fe52c1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe530d77640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 0x7fe52c0b6980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe51c01a8c0 tx=0x7fe51c018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0b4840 con 0x7fe52c0d0040 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c0b49a0 con 0x7fe52c0d0040 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0b4d30 con 0x7fe52c0d0040 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c157ca0 con 0x7fe52c0d0040 2023-09-30T16:49:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.735+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c0b8540 con 0x7fe52c0d0040 2023-09-30T16:49:09.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.739+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c0740a0 con 0x7fe52c0d0040 2023-09-30T16:49:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.739+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe51c0b2040 con 0x7fe52c0d0040 2023-09-30T16:49:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.739+0000 7fe5297fa640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe518066160 0x7fe518068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.739+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe51c11d380 con 0x7fe52c0d0040 2023-09-30T16:49:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.739+0000 7fe52bfff640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe518066160 0x7fe518068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.739+0000 7fe52bfff640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe518066160 0x7fe518068620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe52c1f8850 tx=0x7fe520008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.743+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe51c0eaae0 con 0x7fe52c0d0040 2023-09-30T16:49:09.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:09.931+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe52c0b4d60 con 0x7fe52c0d0040 2023-09-30T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.583+0000 7fe5297fa640 1 -- 172.21.15.52:0/2651751106 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe51c0ee100 con 0x7fe52c0d0040 2023-09-30T16:49:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 2 and data pool 3 2023-09-30T16:49:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe518066160 msgr2=0x7fe518068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe518066160 0x7fe518068620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe52c1f8850 tx=0x7fe520008040 comp rx=0 tx=0).stop 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 msgr2=0x7fe52c0b6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 0x7fe52c0b6980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe51c01a8c0 tx=0x7fe51c018fb0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 shutdown_connections 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe518066160 0x7fe518068620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe52c15cc60 0x7fe52c1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe52c0d25b0 0x7fe52c0b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 --2- 172.21.15.52:0/2651751106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe52c0d0040 0x7fe52c0b6980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 >> 172.21.15.52:0/2651751106 conn(0x7fe52c071930 msgr2=0x7fe52c156550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:10.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 shutdown_connections 2023-09-30T16:49:10.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.591+0000 7fe532fdb640 1 -- 172.21.15.52:0/2651751106 wait complete. 2023-09-30T16:49:10.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:10.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdf9d8640 1 Processor -- start 2023-09-30T16:49:10.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdf9d8640 1 -- start start 2023-09-30T16:49:10.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdf9d8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3bd81600a0 0x7f3bd806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdf9d8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80caf90 con 0x7f3bd806b660 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdf9d8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80cb230 con 0x7f3bd80b2a20 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdf9d8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd806c440 con 0x7f3bd81600a0 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdcf73640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3bd806b660 0x7f3bd80b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60694/0 (socket says 172.21.15.52:60694) 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdcf73640 1 -- 172.21.15.52:0/3387868536 learned_addr learned my addr 172.21.15.52:0/3387868536 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 --2- 172.21.15.52:0/3387868536 >> v2:172.21.15.186:3300/0 conn(0x7f3bd81600a0 0x7f3bd806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068920952 0 0) 0x7f3bd80caf90 con 0x7f3bd806b660 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc4003530 con 0x7f3bd806b660 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3305756126 0 0) 0x7f3bc4003530 con 0x7f3bd806b660 2023-09-30T16:49:10.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 >> v2:172.21.15.186:3300/0 conn(0x7f3bd81600a0 msgr2=0x7f3bd806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 --2- 172.21.15.52:0/3387868536 >> v2:172.21.15.186:3300/0 conn(0x7f3bd81600a0 0x7f3bd806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 >> v1:172.21.15.186:6789/0 conn(0x7f3bd80b2a20 legacy=0x7f3bd80cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd806bba0 con 0x7f3bd806b660 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f3bc8001680 con 0x7f3bd806b660 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 >> v1:172.21.15.52:6789/0 conn(0x7f3bd806b660 legacy=0x7f3bd80b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bc4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bc40051e0 0x7f3bc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd806c440 con 0x7f3bc4003a40 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc400c0f0 con 0x7f3bc40051e0 2023-09-30T16:49:10.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc400c2b0 con 0x7f3bc40047d0 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bc4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdcf73640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bddf75640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bc40051e0 0x7f3bc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 -- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bc40047d0 msgr2=0x7f3bc4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 -- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bc40051e0 msgr2=0x7f3bc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bc40051e0 0x7f3bc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bdd774640 1 -- 172.21.15.52:0/3387868536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4003530 con 0x7f3bc4003a40 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.819+0000 7f3bddf75640 1 -- 172.21.15.52:0/3387868536 reap_dead start 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdd774640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bc4003e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009ae0 tx=0x7f3bd401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3742f544bcddf0ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40a5640 con 0x7f3bc4003a40 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd40a57a0 con 0x7f3bc4003a40 2023-09-30T16:49:10.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bcffff640 1 -- 172.21.15.52:0/3387868536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40a5b50 con 0x7f3bc4003a40 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/3387868536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 msgr2=0x7f3bc4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bc4003e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009ae0 tx=0x7f3bd401ca50 comp rx=0 tx=0).stop 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/3387868536 shutdown_connections 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/3387868536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bc4003e60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/3387868536 >> 172.21.15.52:0/3387868536 conn(0x7f3bd80cd310 msgr2=0x7f3bd80cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/3387868536 shutdown_connections 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/3387868536 wait complete. 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 Processor -- start 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.823+0000 7f3bdf9d8640 1 -- start start 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bd80c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80c53f0 0x7f3bd80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd81f1e20 0x7f3bd80b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8154610 con 0x7f3bc4003a40 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b6740 con 0x7f3bd80c53f0 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b3570 con 0x7f3bd81f1e20 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bd80c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bd80c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58846/0 (socket says 172.21.15.52:58846) 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 -- 172.21.15.52:0/2978639252 learned_addr learned my addr 172.21.15.52:0/2978639252 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bddf75640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd81f1e20 0x7f3bd80b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdcf73640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80c53f0 0x7f3bd80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 -- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd81f1e20 msgr2=0x7f3bd80b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd81f1e20 0x7f3bd80b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 -- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80c53f0 msgr2=0x7f3bd80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:10.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80c53f0 0x7f3bd80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:10.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 -- 172.21.15.52:0/2978639252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80c69f0 con 0x7f3bc4003a40 2023-09-30T16:49:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bddf75640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd81f1e20 0x7f3bd80b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdcf73640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80c53f0 0x7f3bd80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdd774640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bd80c8f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bd401c880 tx=0x7f3bc8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40b6660 con 0x7f3bc4003a40 2023-09-30T16:49:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd40b6800 con 0x7f3bc4003a40 2023-09-30T16:49:10.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40b6bb0 con 0x7f3bc4003a40 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd80b3810 con 0x7f3bc4003a40 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd81f22a0 con 0x7f3bc4003a40 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd80b6880 con 0x7f3bc4003a40 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f3bd40b4070 con 0x7f3bc4003a40 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bcdffb640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3bbc066160 0x7f3bbc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bd411d640 con 0x7f3bc4003a40 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.827+0000 7f3bdcf73640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3bbc066160 0x7f3bbc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.831+0000 7f3bdcf73640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3bbc066160 0x7f3bbc068620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8004880 tx=0x7f3bc80047f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:10.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.831+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f3bd40eada0 con 0x7f3bc4003a40 2023-09-30T16:49:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.987+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bd8066750 con 0x7f3bc4003a40 2023-09-30T16:49:11.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.991+0000 7f3bcdffb640 1 -- 172.21.15.52:0/2978639252 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f3bd40ee3c0 con 0x7f3bc4003a40 2023-09-30T16:49:11.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:11.016 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:09.937607+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3bbc066160 msgr2=0x7f3bbc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3bbc066160 0x7f3bbc068620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8004880 tx=0x7f3bc80047f0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 msgr2=0x7f3bd80c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bd80c8f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bd401c880 tx=0x7f3bc8001e80 comp rx=0 tx=0).stop 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 shutdown_connections 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3bbc066160 0x7f3bbc068620 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd81f1e20 0x7f3bd80b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80c53f0 0x7f3bd80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 --2- 172.21.15.52:0/2978639252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bc4003a40 0x7f3bd80c8f40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 >> 172.21.15.52:0/2978639252 conn(0x7f3bd80cd310 msgr2=0x7f3bd815dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 shutdown_connections 2023-09-30T16:49:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:10.995+0000 7f3bdf9d8640 1 -- 172.21.15.52:0/2978639252 wait complete. 2023-09-30T16:49:11.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:11.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 Processor -- start 2023-09-30T16:49:11.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 -- start start 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f184415ca60 0x7f1844070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f18440cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1844070fc0 con 0x7f18440c8c90 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1844161720 con 0x7f184415ca60 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f184a2d7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1844160b10 con 0x7f18440b07b0 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f184415ca60 0x7f1844070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f184415ca60 0x7f1844070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58854/0 (socket says 172.21.15.52:58854) 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 -- 172.21.15.52:0/3555523620 learned_addr learned my addr 172.21.15.52:0/3555523620 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1848874640 1 --2- 172.21.15.52:0/3555523620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f18440cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 -- 172.21.15.52:0/3555523620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 msgr2=0x7f18440cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 --2- 172.21.15.52:0/3555523620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f18440cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 -- 172.21.15.52:0/3555523620 >> v1:172.21.15.186:6789/0 conn(0x7f18440c8c90 legacy=0x7f18440b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.135+0000 7f1843fff640 1 -- 172.21.15.52:0/3555523620 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844160df0 con 0x7f184415ca60 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f1843fff640 1 --2- 172.21.15.52:0/3555523620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f184415ca60 0x7f1844070a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1834009870 tx=0x7f183401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a620c5a84aa0d228 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f18437fe640 1 -- 172.21.15.52:0/3555523620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340aa670 con 0x7f184415ca60 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f18437fe640 1 -- 172.21.15.52:0/3555523620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340aa7d0 con 0x7f184415ca60 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f18437fe640 1 -- 172.21.15.52:0/3555523620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340aab60 con 0x7f184415ca60 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 -- 172.21.15.52:0/3555523620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f184415ca60 msgr2=0x7f1844070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 --2- 172.21.15.52:0/3555523620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f184415ca60 0x7f1844070a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1834009870 tx=0x7f183401c510 comp rx=0 tx=0).stop 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 -- 172.21.15.52:0/3555523620 shutdown_connections 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 --2- 172.21.15.52:0/3555523620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f18440cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 --2- 172.21.15.52:0/3555523620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f184415ca60 0x7f1844070a80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 -- 172.21.15.52:0/3555523620 >> 172.21.15.52:0/3555523620 conn(0x7f184406a5f0 msgr2=0x7f18440ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 -- 172.21.15.52:0/3555523620 shutdown_connections 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 -- 172.21.15.52:0/3555523620 wait complete. 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 Processor -- start 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.139+0000 7f184a2d7640 1 -- start start 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f184414ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 0x7f18440afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f184415ca60 0x7f1844156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440b0670 con 0x7f18440c8c90 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440aea30 con 0x7f184415ca60 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440b0390 con 0x7f18440b07b0 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 0x7f18440afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 0x7f18440afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58868/0 (socket says 172.21.15.52:58868) 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 -- 172.21.15.52:0/275030502 learned_addr learned my addr 172.21.15.52:0/275030502 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f1843fff640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f184414ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f1848874640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f184415ca60 0x7f1844156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 -- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 msgr2=0x7f184414ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f184414ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 -- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f184415ca60 msgr2=0x7f1844156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f184415ca60 0x7f1844156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 -- 172.21.15.52:0/275030502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340094d0 con 0x7f18440c8c90 2023-09-30T16:49:11.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f183b7fe640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 0x7f18440afa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f182c00c530 tx=0x7f182c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:11.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c005220 con 0x7f18440c8c90 2023-09-30T16:49:11.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c005380 con 0x7f18440c8c90 2023-09-30T16:49:11.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c007270 con 0x7f18440c8c90 2023-09-30T16:49:11.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440ae3e0 con 0x7f18440c8c90 2023-09-30T16:49:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184414d380 con 0x7f18440c8c90 2023-09-30T16:49:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18440ae240 con 0x7f18440c8c90 2023-09-30T16:49:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f182c0073d0 con 0x7f18440c8c90 2023-09-30T16:49:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f18417fa640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1824066190 0x7f1824068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f182c083220 con 0x7f18440c8c90 2023-09-30T16:49:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.143+0000 7f1843fff640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1824066190 0x7f1824068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.147+0000 7f1843fff640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1824066190 0x7f1824068650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18340ae000 tx=0x7f18340a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.147+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f18440ae240 con 0x7f18440c8c90 2023-09-30T16:49:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.307+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1844070fc0 con 0x7f18440c8c90 2023-09-30T16:49:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f18417fa640 1 -- 172.21.15.52:0/275030502 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f1844070fc0 con 0x7f18440c8c90 2023-09-30T16:49:11.419 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:11.419 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:09.937607+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1824066190 msgr2=0x7f1824068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1824066190 0x7f1824068650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18340ae000 tx=0x7f18340a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 msgr2=0x7f18440afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 0x7f18440afa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f182c00c530 tx=0x7f182c00c9f0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 shutdown_connections 2023-09-30T16:49:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1824066190 0x7f1824068650 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f184415ca60 0x7f1844156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18440c8c90 0x7f18440afa20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 --2- 172.21.15.52:0/275030502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18440b07b0 0x7f184414ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 >> 172.21.15.52:0/275030502 conn(0x7f184406a5f0 msgr2=0x7f1844158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 shutdown_connections 2023-09-30T16:49:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.311+0000 7f184a2d7640 1 -- 172.21.15.52:0/275030502 wait complete. 2023-09-30T16:49:11.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T16:49:11.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 Processor -- start 2023-09-30T16:49:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 -- start start 2023-09-30T16:49:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1834159780 0x7f183406d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1834070070 0x7f18340704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1834070a00 con 0x7f183406d9b0 2023-09-30T16:49:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183415d3a0 con 0x7f1834159780 2023-09-30T16:49:11.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1838f92640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18340cd740 con 0x7f1834070070 2023-09-30T16:49:11.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1834159780 0x7f183406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1834159780 0x7f183406d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58884/0 (socket says 172.21.15.52:58884) 2023-09-30T16:49:11.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 -- 172.21.15.52:0/1036466589 learned_addr learned my addr 172.21.15.52:0/1036466589 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:11.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f1832d9d640 1 --2- 172.21.15.52:0/1036466589 >> v2:172.21.15.186:3300/0 conn(0x7f1834070070 0x7f18340704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 -- 172.21.15.52:0/1036466589 >> v2:172.21.15.186:3300/0 conn(0x7f1834070070 msgr2=0x7f18340704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:11.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 --2- 172.21.15.52:0/1036466589 >> v2:172.21.15.186:3300/0 conn(0x7f1834070070 0x7f18340704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 -- 172.21.15.52:0/1036466589 >> v1:172.21.15.186:6789/0 conn(0x7f183406d9b0 legacy=0x7f18340c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:11.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.619+0000 7f183259c640 1 -- 172.21.15.52:0/1036466589 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340cda20 con 0x7f1834159780 2023-09-30T16:49:11.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f183259c640 1 --2- 172.21.15.52:0/1036466589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f183406d470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f183406e5c0 tx=0x7f182c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3482320fcf42c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:11.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f183159a640 1 -- 172.21.15.52:0/1036466589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0a5790 con 0x7f1834159780 2023-09-30T16:49:11.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f183159a640 1 -- 172.21.15.52:0/1036466589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c0a58f0 con 0x7f1834159780 2023-09-30T16:49:11.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f183159a640 1 -- 172.21.15.52:0/1036466589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0a5c80 con 0x7f1834159780 2023-09-30T16:49:11.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- 172.21.15.52:0/1036466589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 msgr2=0x7f183406d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 --2- 172.21.15.52:0/1036466589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f183406d470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f183406e5c0 tx=0x7f182c01c8d0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- 172.21.15.52:0/1036466589 shutdown_connections 2023-09-30T16:49:11.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 --2- 172.21.15.52:0/1036466589 >> v2:172.21.15.186:3300/0 conn(0x7f1834070070 0x7f18340704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 --2- 172.21.15.52:0/1036466589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f183406d470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- 172.21.15.52:0/1036466589 >> 172.21.15.52:0/1036466589 conn(0x7f183406a5c0 msgr2=0x7f18340ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:11.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- 172.21.15.52:0/1036466589 shutdown_connections 2023-09-30T16:49:11.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- 172.21.15.52:0/1036466589 wait complete. 2023-09-30T16:49:11.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 Processor -- start 2023-09-30T16:49:11.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- start start 2023-09-30T16:49:11.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1834070070 0x7f18340c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f18340c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18340c42c0 0x7f18340c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183415c170 con 0x7f1834159780 2023-09-30T16:49:11.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18341489f0 con 0x7f18340c42c0 2023-09-30T16:49:11.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1838f92640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183415bbb0 con 0x7f1834070070 2023-09-30T16:49:11.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1831d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f18340c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1831d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f18340c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58890/0 (socket says 172.21.15.52:58890) 2023-09-30T16:49:11.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1831d9b640 1 -- 172.21.15.52:0/1788430609 learned_addr learned my addr 172.21.15.52:0/1788430609 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:11.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f1832d9d640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18340c42c0 0x7f18340c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.623+0000 7f183259c640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1834070070 0x7f18340c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1831d9b640 1 -- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1834070070 msgr2=0x7f18340c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1831d9b640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1834070070 0x7f18340c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1831d9b640 1 -- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18340c42c0 msgr2=0x7f18340c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:11.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1831d9b640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18340c42c0 0x7f18340c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:11.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1831d9b640 1 -- 172.21.15.52:0/1788430609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c009b30 con 0x7f1834159780 2023-09-30T16:49:11.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1831d9b640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f18340c3d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f182400b410 tx=0x7f182400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:11.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824004020 con 0x7f1834159780 2023-09-30T16:49:11.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824004180 con 0x7f1834159780 2023-09-30T16:49:11.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183415be90 con 0x7f1834159780 2023-09-30T16:49:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824011630 con 0x7f1834159780 2023-09-30T16:49:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18340c4770 con 0x7f1834159780 2023-09-30T16:49:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1834148850 con 0x7f1834159780 2023-09-30T16:49:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1824011790 con 0x7f1834159780 2023-09-30T16:49:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f182affd640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1814066160 0x7f1814068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:11.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1824083830 con 0x7f1834159780 2023-09-30T16:49:11.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.627+0000 7f183259c640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1814066160 0x7f1814068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:11.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.631+0000 7f183259c640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1814066160 0x7f1814068620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f182c0ae000 tx=0x7f182c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:11.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.631+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1834148850 con 0x7f1834159780 2023-09-30T16:49:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:11.823+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1834148ed0 con 0x7f1834159780 2023-09-30T16:49:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.635+0000 7f182affd640 1 -- 172.21.15.52:0/1788430609 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1834148ed0 con 0x7f1834159780 2023-09-30T16:49:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1814066160 msgr2=0x7f1814068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1814066160 0x7f1814068620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f182c0ae000 tx=0x7f182c0a7070 comp rx=0 tx=0).stop 2023-09-30T16:49:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 msgr2=0x7f18340c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f18340c3d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f182400b410 tx=0x7f182400b8d0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 shutdown_connections 2023-09-30T16:49:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1814066160 0x7f1814068620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18340c42c0 0x7f18340c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1834159780 0x7f18340c3d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 --2- 172.21.15.52:0/1788430609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1834070070 0x7f18340c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 >> 172.21.15.52:0/1788430609 conn(0x7f183406a5c0 msgr2=0x7f18340cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 shutdown_connections 2023-09-30T16:49:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.639+0000 7f1838f92640 1 -- 172.21.15.52:0/1788430609 wait complete. 2023-09-30T16:49:12.668 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T16:49:12.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T16:49:12.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 Processor -- start 2023-09-30T16:49:12.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 -- start start 2023-09-30T16:49:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6e815e4b0 0x7fb6e80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e80b0a30 con 0x7fb6e815a8b0 2023-09-30T16:49:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e815ea50 con 0x7fb6e815e4b0 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ef657640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e815ed30 con 0x7fb6e80b00a0 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6e815e4b0 0x7fb6e80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6e815e4b0 0x7fb6e80b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58902/0 (socket says 172.21.15.52:58902) 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/3941025628 learned_addr learned my addr 172.21.15.52:0/3941025628 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ed3f3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb6e815a8b0 0x7fb6e806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60710/0 (socket says 172.21.15.52:60710) 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6edbf4640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/3941025628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 msgr2=0x7fb6e80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e80b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/3941025628 >> v1:172.21.15.52:6789/0 conn(0x7fb6e815a8b0 legacy=0x7fb6e806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/3941025628 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e815f010 con 0x7fb6e815e4b0 2023-09-30T16:49:12.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.795+0000 7fb6edbf4640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e80b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:12.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815e4b0 0x7fb6e80b1470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009870 tx=0x7fb6d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd6c643878c4775 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:12.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6dffff640 1 -- 172.21.15.52:0/3941025628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80aa670 con 0x7fb6e815e4b0 2023-09-30T16:49:12.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6dffff640 1 -- 172.21.15.52:0/3941025628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d80aa7d0 con 0x7fb6e815e4b0 2023-09-30T16:49:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6dffff640 1 -- 172.21.15.52:0/3941025628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80aab60 con 0x7fb6e815e4b0 2023-09-30T16:49:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- 172.21.15.52:0/3941025628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815e4b0 msgr2=0x7fb6e80b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815e4b0 0x7fb6e80b1470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009870 tx=0x7fb6d801c510 comp rx=0 tx=0).stop 2023-09-30T16:49:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- 172.21.15.52:0/3941025628 shutdown_connections 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e80b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 --2- 172.21.15.52:0/3941025628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815e4b0 0x7fb6e80b1470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- 172.21.15.52:0/3941025628 >> 172.21.15.52:0/3941025628 conn(0x7fb6e806a5c0 msgr2=0x7fb6e80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- 172.21.15.52:0/3941025628 shutdown_connections 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- 172.21.15.52:0/3941025628 wait complete. 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 Processor -- start 2023-09-30T16:49:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- start start 2023-09-30T16:49:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e81f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 0x7fb6e80c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e815e4b0 0x7fb6e81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81fa0f0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e80c5a20 con 0x7fb6e815e4b0 2023-09-30T16:49:12.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ef657640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e80c5d00 con 0x7fb6e80b00a0 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 0x7fb6e80c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 0x7fb6e80c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58908/0 (socket says 172.21.15.52:58908) 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/2865039566 learned_addr learned my addr 172.21.15.52:0/2865039566 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ed3f3640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e81f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6edbf4640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e815e4b0 0x7fb6e81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 msgr2=0x7fb6e81f9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e81f9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e815e4b0 msgr2=0x7fb6e81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e815e4b0 0x7fb6e81594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 -- 172.21.15.52:0/2865039566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80094d0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6edbf4640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e815e4b0 0x7fb6e81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.799+0000 7fb6ecbf2640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 0x7fb6e80c4e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80ac040 tx=0x7fb6d80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80b48d0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d80b4a50 con 0x7fb6e815a8b0 2023-09-30T16:49:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e80c5fe0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80b4e00 con 0x7fb6e815a8b0 2023-09-30T16:49:12.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e80c65a0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e80740a0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb6d80be410 con 0x7fb6e815a8b0 2023-09-30T16:49:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ddffb640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6cc066160 0x7fb6cc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6d811e6f0 con 0x7fb6e815a8b0 2023-09-30T16:49:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ed3f3640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6cc066160 0x7fb6cc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:12.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.803+0000 7fb6ed3f3640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6cc066160 0x7fb6cc068620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4005fd0 tx=0x7fb6e4005ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:12.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.807+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb6d80ebda0 con 0x7fb6e815a8b0 2023-09-30T16:49:13.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:12.995+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb6e80c8f80 con 0x7fb6e815a8b0 2023-09-30T16:49:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.643+0000 7fb6ddffb640 1 -- 172.21.15.52:0/2865039566 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb6d80ef3c0 con 0x7fb6e815a8b0 2023-09-30T16:49:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6cc066160 msgr2=0x7fb6cc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6cc066160 0x7fb6cc068620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4005fd0 tx=0x7fb6e4005ba0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 msgr2=0x7fb6e80c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 0x7fb6e80c4e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80ac040 tx=0x7fb6d80192b0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 shutdown_connections 2023-09-30T16:49:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6cc066160 0x7fb6cc068620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e815e4b0 0x7fb6e81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6e815a8b0 0x7fb6e80c4e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 --2- 172.21.15.52:0/2865039566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb6e80b00a0 0x7fb6e81f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 >> 172.21.15.52:0/2865039566 conn(0x7fb6e806a5c0 msgr2=0x7fb6e806d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 shutdown_connections 2023-09-30T16:49:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.647+0000 7fb6ef657640 1 -- 172.21.15.52:0/2865039566 wait complete. 2023-09-30T16:49:13.674 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T16:49:13.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:49:13.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 Processor -- start 2023-09-30T16:49:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 -- start start 2023-09-30T16:49:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13840cca70 0x7f13840c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f138406a3c0 0x7f138406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1384069f30 con 0x7f1384159c60 2023-09-30T16:49:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840ccee0 con 0x7f13840cca70 2023-09-30T16:49:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138bbc9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840ce680 con 0x7f138406a3c0 2023-09-30T16:49:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13840cca70 0x7f13840c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13840cca70 0x7f13840c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58924/0 (socket says 172.21.15.52:58924) 2023-09-30T16:49:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 -- 172.21.15.52:0/2666347428 learned_addr learned my addr 172.21.15.52:0/2666347428 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 -- 172.21.15.52:0/2666347428 >> v2:172.21.15.186:3300/0 conn(0x7f138406a3c0 msgr2=0x7f138406a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f138a166640 1 --2- 172.21.15.52:0/2666347428 >> v2:172.21.15.186:3300/0 conn(0x7f138406a3c0 0x7f138406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 --2- 172.21.15.52:0/2666347428 >> v2:172.21.15.186:3300/0 conn(0x7f138406a3c0 0x7f138406a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 -- 172.21.15.52:0/2666347428 >> v1:172.21.15.186:6789/0 conn(0x7f1384159c60 legacy=0x7f13840c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.799+0000 7f1389164640 1 -- 172.21.15.52:0/2666347428 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840ce960 con 0x7f13840cca70 2023-09-30T16:49:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f1389164640 1 --2- 172.21.15.52:0/2666347428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f13840c9c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f13840b1be0 tx=0x7f137401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b610d0343b69d49f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f1388963640 1 -- 172.21.15.52:0/2666347428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740aa640 con 0x7f13840cca70 2023-09-30T16:49:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f1388963640 1 -- 172.21.15.52:0/2666347428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740aa7a0 con 0x7f13840cca70 2023-09-30T16:49:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f1388963640 1 -- 172.21.15.52:0/2666347428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740aab30 con 0x7f13840cca70 2023-09-30T16:49:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 -- 172.21.15.52:0/2666347428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 msgr2=0x7f13840c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 --2- 172.21.15.52:0/2666347428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f13840c9c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f13840b1be0 tx=0x7f137401c4c0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 -- 172.21.15.52:0/2666347428 shutdown_connections 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 --2- 172.21.15.52:0/2666347428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f13840c9c00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 --2- 172.21.15.52:0/2666347428 >> v2:172.21.15.186:3300/0 conn(0x7f138406a3c0 0x7f138406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 -- 172.21.15.52:0/2666347428 >> 172.21.15.52:0/2666347428 conn(0x7f13840b0b80 msgr2=0x7f13840b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 -- 172.21.15.52:0/2666347428 shutdown_connections 2023-09-30T16:49:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 -- 172.21.15.52:0/2666347428 wait complete. 2023-09-30T16:49:13.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 Processor -- start 2023-09-30T16:49:13.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 -- start start 2023-09-30T16:49:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f138406a3c0 0x7f1384159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.803+0000 7f138bbc9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f138415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1384159c60 0x7f1384152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138415c810 con 0x7f13840cca70 2023-09-30T16:49:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138415bc90 con 0x7f1384159c60 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138415bf70 con 0x7f138406a3c0 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f138415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f138415b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58938/0 (socket says 172.21.15.52:58938) 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 -- 172.21.15.52:0/1946967774 learned_addr learned my addr 172.21.15.52:0/1946967774 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389965640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f138406a3c0 0x7f1384159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138a166640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1384159c60 0x7f1384152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 -- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f138406a3c0 msgr2=0x7f1384159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f138406a3c0 0x7f1384159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 -- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1384159c60 msgr2=0x7f1384152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1384159c60 0x7f1384152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 -- 172.21.15.52:0/1946967774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740094d0 con 0x7f13840cca70 2023-09-30T16:49:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138a166640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1384159c60 0x7f1384152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389164640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f138415b260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f137401a0f0 tx=0x7f1374019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740bd5f0 con 0x7f13840cca70 2023-09-30T16:49:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740bd750 con 0x7f13840cca70 2023-09-30T16:49:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138415c250 con 0x7f13840cca70 2023-09-30T16:49:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740bdb00 con 0x7f13840cca70 2023-09-30T16:49:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13840c8030 con 0x7f13840cca70 2023-09-30T16:49:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1384065e40 con 0x7f13840cca70 2023-09-30T16:49:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f13740a8050 con 0x7f13840cca70 2023-09-30T16:49:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f137a7fc640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1368066160 0x7f1368068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f137411e670 con 0x7f13840cca70 2023-09-30T16:49:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.807+0000 7f1389965640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1368066160 0x7f1368068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:13.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.811+0000 7f1389965640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1368066160 0x7f1368068620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f138000b810 tx=0x7f1380008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.811+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f13740ebc80 con 0x7f13840cca70 2023-09-30T16:49:14.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13840740a0 con 0x7f13840cca70 2023-09-30T16:49:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f137a7fc640 1 -- 172.21.15.52:0/1946967774 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f13740ef2a0 con 0x7f13840cca70 2023-09-30T16:49:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:14.004 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:49:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:49:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1368066160 msgr2=0x7f1368068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1368066160 0x7f1368068620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f138000b810 tx=0x7f1380008040 comp rx=0 tx=0).stop 2023-09-30T16:49:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 msgr2=0x7f138415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f138415b260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f137401a0f0 tx=0x7f1374019260 comp rx=0 tx=0).stop 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 shutdown_connections 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1368066160 0x7f1368068620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1384159c60 0x7f1384152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13840cca70 0x7f138415b260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 --2- 172.21.15.52:0/1946967774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f138406a3c0 0x7f1384159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 >> 172.21.15.52:0/1946967774 conn(0x7f13840b0b80 msgr2=0x7f138406de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 shutdown_connections 2023-09-30T16:49:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:13.999+0000 7f138bbc9640 1 -- 172.21.15.52:0/1946967774 wait complete. 2023-09-30T16:49:14.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:14.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 Processor -- start 2023-09-30T16:49:14.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 -- start start 2023-09-30T16:49:14.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f66a806a060 0x7f66a80ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 0x7f66a8161090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a8072280 con 0x7f66a80cdf60 2023-09-30T16:49:14.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a81615d0 con 0x7f66a806a060 2023-09-30T16:49:14.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66ad662640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8071670 con 0x7f66a806f6f0 2023-09-30T16:49:14.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66a67fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f66a80cdf60 0x7f66a80abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60720/0 (socket says 172.21.15.52:60720) 2023-09-30T16:49:14.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66a67fc640 1 -- 172.21.15.52:0/3943568283 learned_addr learned my addr 172.21.15.52:0/3943568283 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66a6ffd640 1 --2- 172.21.15.52:0/3943568283 >> v2:172.21.15.186:3300/0 conn(0x7f66a806a060 0x7f66a80ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66a77fe640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 0x7f66a8161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710394448 0 0) 0x7f66a8072280 con 0x7f66a80cdf60 2023-09-30T16:49:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.139+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6690003530 con 0x7f66a80cdf60 2023-09-30T16:49:14.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176444681 0 0) 0x7f6690003530 con 0x7f66a80cdf60 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 msgr2=0x7f66a8161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 0x7f66a8161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 >> v2:172.21.15.186:3300/0 conn(0x7f66a806a060 msgr2=0x7f66a80ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 --2- 172.21.15.52:0/3943568283 >> v2:172.21.15.186:3300/0 conn(0x7f66a806a060 0x7f66a80ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a8071950 con 0x7f66a80cdf60 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f669c001680 con 0x7f66a80cdf60 2023-09-30T16:49:14.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 >> v1:172.21.15.52:6789/0 conn(0x7f66a80cdf60 legacy=0x7f66a80abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66900039f0 0x7f6690003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 0x7f66900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6690004d10 0x7f6690005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a81615d0 con 0x7f6690004d10 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8071670 con 0x7f66900039f0 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669000ba40 con 0x7f66a806f6f0 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6690004d10 0x7f6690005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a6ffd640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66900039f0 0x7f6690003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a67fc640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 0x7f66900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 -- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 msgr2=0x7f66900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a806f6f0 0x7f66900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 -- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66900039f0 msgr2=0x7f6690003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66900039f0 0x7f6690003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 -- 172.21.15.52:0/3943568283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690003530 con 0x7f6690004d10 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a6ffd640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66900039f0 0x7f6690003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6690004d10 0x7f6690005190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009f90 tx=0x7f66a001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475843fbca4ea8fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00a5c30 con 0x7f6690004d10 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a000f040 con 0x7f6690004d10 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a5ffb640 1 -- 172.21.15.52:0/3943568283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00ad440 con 0x7f6690004d10 2023-09-30T16:49:14.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66ad662640 1 -- 172.21.15.52:0/3943568283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6690004d10 msgr2=0x7f6690005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66ad662640 1 --2- 172.21.15.52:0/3943568283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6690004d10 0x7f6690005190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009f90 tx=0x7f66a001cc20 comp rx=0 tx=0).stop 2023-09-30T16:49:14.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66a77fe640 1 -- 172.21.15.52:0/3943568283 reap_dead start 2023-09-30T16:49:14.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66ad662640 1 -- 172.21.15.52:0/3943568283 shutdown_connections 2023-09-30T16:49:14.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66ad662640 1 -- 172.21.15.52:0/3943568283 >> 172.21.15.52:0/3943568283 conn(0x7f66a806d320 msgr2=0x7f66a806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:14.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66ad662640 1 -- 172.21.15.52:0/3943568283 shutdown_connections 2023-09-30T16:49:14.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.143+0000 7f66ad662640 1 -- 172.21.15.52:0/3943568283 wait complete. 2023-09-30T16:49:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 Processor -- start 2023-09-30T16:49:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- start start 2023-09-30T16:49:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a81f1b80 0x7f66a80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 0x7f66a80c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66a815fe50 0x7f66a81602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c70b0 con 0x7f66a81f1f60 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8160810 con 0x7f66a815fe50 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815c970 con 0x7f66a81f1b80 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 0x7f66a80c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 0x7f66a80c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58960/0 (socket says 172.21.15.52:58960) 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 -- 172.21.15.52:0/2114506503 learned_addr learned my addr 172.21.15.52:0/2114506503 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a6ffd640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a81f1b80 0x7f66a80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 -- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a81f1b80 msgr2=0x7f66a80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a81f1b80 0x7f66a80cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 -- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66a815fe50 msgr2=0x7f66a81602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a77fe640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66a815fe50 0x7f66a81602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66a815fe50 0x7f66a81602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 -- 172.21.15.52:0/2114506503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a815ce00 con 0x7f66a81f1f60 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66a67fc640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 0x7f66a80c6840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f669c00eaf0 tx=0x7f669c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c00c870 con 0x7f66a81f1f60 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c00c9d0 con 0x7f66a81f1f60 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a815c040 con 0x7f66a81f1f60 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c00cd80 con 0x7f66a81f1f60 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a815c600 con 0x7f66a81f1f60 2023-09-30T16:49:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.147+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a80740a0 con 0x7f66a81f1f60 2023-09-30T16:49:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.151+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f669c013420 con 0x7f66a81f1f60 2023-09-30T16:49:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.151+0000 7f668f7fe640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6694066190 0x7f6694068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.151+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f669c083840 con 0x7f66a81f1f60 2023-09-30T16:49:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.151+0000 7f66a6ffd640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6694066190 0x7f6694068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.151+0000 7f66a6ffd640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6694066190 0x7f6694068650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6698009a10 tx=0x7f6698008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.155+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f669c050dc0 con 0x7f66a81f1f60 2023-09-30T16:49:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.307+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66a806ed70 con 0x7f66a81f1f60 2023-09-30T16:49:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.311+0000 7f668f7fe640 1 -- 172.21.15.52:0/2114506503 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f669c0543e0 con 0x7f66a81f1f60 2023-09-30T16:49:14.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:14.317 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6694066190 msgr2=0x7f6694068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6694066190 0x7f6694068650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6698009a10 tx=0x7f6698008040 comp rx=0 tx=0).stop 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 msgr2=0x7f66a80c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 0x7f66a80c6840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f669c00eaf0 tx=0x7f669c001650 comp rx=0 tx=0).stop 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 shutdown_connections 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6694066190 0x7f6694068650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66a815fe50 0x7f66a81602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66a81f1f60 0x7f66a80c6840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 --2- 172.21.15.52:0/2114506503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66a81f1b80 0x7f66a80cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 >> 172.21.15.52:0/2114506503 conn(0x7f66a806d320 msgr2=0x7f66a80cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:14.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 shutdown_connections 2023-09-30T16:49:14.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.315+0000 7f66ad662640 1 -- 172.21.15.52:0/2114506503 wait complete. 2023-09-30T16:49:14.336 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T16:49:14.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:14.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.451+0000 7fb06ad4e640 1 Processor -- start 2023-09-30T16:49:14.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.451+0000 7fb06ad4e640 1 -- start start 2023-09-30T16:49:14.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb06ad4e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 0x7fb0640b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb06ad4e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb0640cd870 0x7fb0640cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb06ad4e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0640b7570 con 0x7fb0640d0fa0 2023-09-30T16:49:14.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb06ad4e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0640b7850 con 0x7fb0640cd870 2023-09-30T16:49:14.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb06ad4e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640b7b30 con 0x7fb06415ce10 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb068aea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 0x7fb0640b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb063fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb0640cd870 0x7fb0640cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb068aea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 0x7fb0640b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:56258/0 (socket says 172.21.15.52:56258) 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb068aea640 1 -- 172.21.15.52:0/168710888 learned_addr learned my addr 172.21.15.52:0/168710888 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb063fff640 1 -- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 msgr2=0x7fb0640b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb063fff640 1 --2- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 0x7fb0640b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb063fff640 1 -- 172.21.15.52:0/168710888 >> v1:172.21.15.186:6789/0 conn(0x7fb0640d0fa0 legacy=0x7fb0640d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb063fff640 1 -- 172.21.15.52:0/168710888 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640b7e10 con 0x7fb0640cd870 2023-09-30T16:49:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb068aea640 1 --2- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 0x7fb0640b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:49:14.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.455+0000 7fb063fff640 1 --2- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640cd870 0x7fb0640cdcb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb0540097c0 tx=0x7fb05401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63f97c519123e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb0637fe640 1 -- 172.21.15.52:0/168710888 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540ac630 con 0x7fb0640cd870 2023-09-30T16:49:14.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb0637fe640 1 -- 172.21.15.52:0/168710888 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0540ac790 con 0x7fb0640cd870 2023-09-30T16:49:14.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb0637fe640 1 -- 172.21.15.52:0/168710888 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540acb20 con 0x7fb0640cd870 2023-09-30T16:49:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640cd870 msgr2=0x7fb0640cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640cd870 0x7fb0640cdcb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb0540097c0 tx=0x7fb05401c3f0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- 172.21.15.52:0/168710888 shutdown_connections 2023-09-30T16:49:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640cd870 0x7fb0640cdcb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/168710888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415ce10 0x7fb0640b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- 172.21.15.52:0/168710888 >> 172.21.15.52:0/168710888 conn(0x7fb064071930 msgr2=0x7fb064071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- 172.21.15.52:0/168710888 shutdown_connections 2023-09-30T16:49:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- 172.21.15.52:0/168710888 wait complete. 2023-09-30T16:49:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 Processor -- start 2023-09-30T16:49:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- start start 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 0x7fb06415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640d0fa0 0x7fb06415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415e120 0x7fb064155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641f6070 con 0x7fb0640cd870 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641f6490 con 0x7fb0640d0fa0 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.459+0000 7fb06ad4e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641f53f0 con 0x7fb06415e120 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 0x7fb06415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 0x7fb06415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58966/0 (socket says 172.21.15.52:58966) 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 -- 172.21.15.52:0/3330683433 learned_addr learned my addr 172.21.15.52:0/3330683433 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb063fff640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640d0fa0 0x7fb06415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0692eb640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415e120 0x7fb064155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 -- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415e120 msgr2=0x7fb064155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415e120 0x7fb064155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 -- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640d0fa0 msgr2=0x7fb06415f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640d0fa0 0x7fb06415f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 -- 172.21.15.52:0/3330683433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0094d0 con 0x7fb0640cd870 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb063fff640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640d0fa0 0x7fb06415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb068aea640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 0x7fb06415dbe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00e930 tx=0x7fb04c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00ca00 con 0x7fb0640cd870 2023-09-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00cb60 con 0x7fb0640cd870 2023-09-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c013470 con 0x7fb0640cd870 2023-09-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb054009420 con 0x7fb0640cd870 2023-09-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0641f59b0 con 0x7fb0640cd870 2023-09-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0640740a0 con 0x7fb0640cd870 2023-09-30T16:49:14.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb04c0135d0 con 0x7fb0640cd870 2023-09-30T16:49:14.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0617fa640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb044066190 0x7fb044068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb04c083c60 con 0x7fb0640cd870 2023-09-30T16:49:14.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.463+0000 7fb063fff640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb044066190 0x7fb044068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.467+0000 7fb063fff640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb044066190 0x7fb044068650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0540ae000 tx=0x7fb0540a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.467+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb04c051310 con 0x7fb0640cd870 2023-09-30T16:49:14.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.615+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0640c5e00 con 0x7fb044066190 2023-09-30T16:49:14.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.635+0000 7fb0617fa640 1 -- 172.21.15.52:0/3330683433 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250981 (secure 0 0 0) 0x7fb0640c5e00 con 0x7fb044066190 2023-09-30T16:49:14.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:14.642 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb044066190 msgr2=0x7fb044068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb044066190 0x7fb044068650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0540ae000 tx=0x7fb0540a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 msgr2=0x7fb06415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 0x7fb06415dbe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00e930 tx=0x7fb04c00edf0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 shutdown_connections 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb044066190 0x7fb044068650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb06415e120 0x7fb064155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0640d0fa0 0x7fb06415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 --2- 172.21.15.52:0/3330683433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0640cd870 0x7fb06415dbe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 >> 172.21.15.52:0/3330683433 conn(0x7fb064071930 msgr2=0x7fb0641531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:14.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 shutdown_connections 2023-09-30T16:49:14.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.639+0000 7fb06ad4e640 1 -- 172.21.15.52:0/3330683433 wait complete. 2023-09-30T16:49:14.658 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T16:49:13.457252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235932,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738788,"statfs":{"total":773094113280,"available":772852518912,"internally_reserved":0,"allocated":2539520,"data_stored":1592345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894053"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":757760,"data_stored":639452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":658389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:14.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:14.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d8a7ef640 1 Processor -- start 2023-09-30T16:49:14.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d8a7ef640 1 -- start start 2023-09-30T16:49:14.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d8a7ef640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 0x7f0d840ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d8a7ef640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d84070ae0 con 0x7f0d84160b40 2023-09-30T16:49:14.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d8a7ef640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d841610c0 con 0x7f0d841571f0 2023-09-30T16:49:14.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d8a7ef640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84070ea0 con 0x7f0d841606e0 2023-09-30T16:49:14.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0d84160b40 0x7f0d8415de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60726/0 (socket says 172.21.15.52:60726) 2023-09-30T16:49:14.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 -- 172.21.15.52:0/4084735617 learned_addr learned my addr 172.21.15.52:0/4084735617 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:14.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d837fe640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 0x7f0d840ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447623227 0 0) 0x7f0d84070ae0 con 0x7f0d84160b40 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d6c003530 con 0x7f0d84160b40 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041703810 0 0) 0x7f0d6c003530 con 0x7f0d84160b40 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 msgr2=0x7f0d840ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 0x7f0d840ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 >> v1:172.21.15.186:6789/0 conn(0x7f0d841571f0 legacy=0x7f0d840712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d841613a0 con 0x7f0d84160b40 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f0d7c001a00 con 0x7f0d84160b40 2023-09-30T16:49:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 >> v1:172.21.15.52:6789/0 conn(0x7f0d84160b40 legacy=0x7f0d8415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d6c003a20 0x7f0d6c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 0x7f0d6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6c004d10 0x7f0d6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84070ea0 con 0x7f0d6c004d10 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c00bb50 con 0x7f0d6c003a20 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c00bd10 con 0x7f0d841606e0 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6c004d10 0x7f0d6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d83fff640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d6c003a20 0x7f0d6c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 -- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 msgr2=0x7f0d6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d841606e0 0x7f0d6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 -- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d6c003a20 msgr2=0x7f0d6c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:14.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d6c003a20 0x7f0d6c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.819+0000 7f0d88d8c640 1 -- 172.21.15.52:0/4084735617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c003530 con 0x7f0d6c004d10 2023-09-30T16:49:14.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d88d8c640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6c004d10 0x7f0d6c005190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00a830 tx=0x7f0d7c01faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc9f9c37733aa68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0aa6d0 con 0x7f0d6c004d10 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0aa830 con 0x7f0d6c004d10 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d82ffd640 1 -- 172.21.15.52:0/4084735617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0aac20 con 0x7f0d6c004d10 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/4084735617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6c004d10 msgr2=0x7f0d6c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/4084735617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6c004d10 0x7f0d6c005190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00a830 tx=0x7f0d7c01faa0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d88d8c640 1 -- 172.21.15.52:0/4084735617 reap_dead start 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/4084735617 shutdown_connections 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/4084735617 >> 172.21.15.52:0/4084735617 conn(0x7f0d8406cad0 msgr2=0x7f0d8406cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/4084735617 shutdown_connections 2023-09-30T16:49:14.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/4084735617 wait complete. 2023-09-30T16:49:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 Processor -- start 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.823+0000 7f0d8a7ef640 1 -- start start 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 0x7f0d840ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d841592f0 0x7f0d84159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d84159d50 0x7f0d841575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415a200 con 0x7f0d84143870 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840ac490 con 0x7f0d841592f0 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84143c50 con 0x7f0d84159d50 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 0x7f0d840ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 0x7f0d840ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58984/0 (socket says 172.21.15.52:58984) 2023-09-30T16:49:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 -- 172.21.15.52:0/1575690255 learned_addr learned my addr 172.21.15.52:0/1575690255 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d88d8c640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d84159d50 0x7f0d841575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d837fe640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d841592f0 0x7f0d84159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 -- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d84159d50 msgr2=0x7f0d841575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d84159d50 0x7f0d841575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 -- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d841592f0 msgr2=0x7f0d84159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d841592f0 0x7f0d84159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 -- 172.21.15.52:0/1575690255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840ac730 con 0x7f0d84143870 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d837fe640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d841592f0 0x7f0d84159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d83fff640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 0x7f0d840ae1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800e4b0 tx=0x7f0d7800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780052e0 con 0x7f0d84143870 2023-09-30T16:49:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78005440 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840aca10 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78003820 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d840acfd0 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d84149960 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f0d78003980 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d80ff9640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d70066190 0x7f0d70068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d78083880 con 0x7f0d84143870 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.827+0000 7f0d837fe640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d70066190 0x7f0d70068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.831+0000 7f0d837fe640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d70066190 0x7f0d70068650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d740047c0 tx=0x7f0d74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.831+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f0d78050e10 con 0x7f0d84143870 2023-09-30T16:49:14.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:14.983+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d840ad160 con 0x7f0d70066190 2023-09-30T16:49:15.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.003+0000 7f0d80ff9640 1 -- 172.21.15.52:0/1575690255 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250981 (secure 0 0 0) 0x7f0d840ad160 con 0x7f0d70066190 2023-09-30T16:49:15.008 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:15.010 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d70066190 msgr2=0x7f0d70068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d70066190 0x7f0d70068650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d740047c0 tx=0x7f0d74008040 comp rx=0 tx=0).stop 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 msgr2=0x7f0d840ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 0x7f0d840ae1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800e4b0 tx=0x7f0d7800e970 comp rx=0 tx=0).stop 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 shutdown_connections 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d70066190 0x7f0d70068650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d84159d50 0x7f0d841575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d841592f0 0x7f0d84159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 --2- 172.21.15.52:0/1575690255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d84143870 0x7f0d840ae1b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 >> 172.21.15.52:0/1575690255 conn(0x7f0d8406cad0 msgr2=0x7f0d840c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 shutdown_connections 2023-09-30T16:49:15.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.007+0000 7f0d8a7ef640 1 -- 172.21.15.52:0/1575690255 wait complete. 2023-09-30T16:49:15.029 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T16:49:13.457252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235932,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738788,"statfs":{"total":773094113280,"available":772852518912,"internally_reserved":0,"allocated":2539520,"data_stored":1592345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894053"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":757760,"data_stored":639452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":658389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:15.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:15.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 Processor -- start 2023-09-30T16:49:15.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 -- start start 2023-09-30T16:49:15.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5b7815ce10 0x7f5b780b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b780cd870 0x7f5b780cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780b7570 con 0x7f5b780d0fa0 2023-09-30T16:49:15.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b7850 con 0x7f5b780cd870 2023-09-30T16:49:15.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7eb32640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b7b30 con 0x7f5b7815ce10 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b780cd870 0x7f5b780cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b780cd870 0x7f5b780cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58992/0 (socket says 172.21.15.52:58992) 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 -- 172.21.15.52:0/2562991023 learned_addr learned my addr 172.21.15.52:0/2562991023 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7c8ce640 1 --2- 172.21.15.52:0/2562991023 >> v2:172.21.15.186:3300/0 conn(0x7f5b7815ce10 0x7f5b780b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 -- 172.21.15.52:0/2562991023 >> v2:172.21.15.186:3300/0 conn(0x7f5b7815ce10 msgr2=0x7f5b780b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 --2- 172.21.15.52:0/2562991023 >> v2:172.21.15.186:3300/0 conn(0x7f5b7815ce10 0x7f5b780b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 -- 172.21.15.52:0/2562991023 >> v1:172.21.15.52:6789/0 conn(0x7f5b780d0fa0 legacy=0x7f5b780d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b77fff640 1 -- 172.21.15.52:0/2562991023 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780b7e10 con 0x7f5b780cd870 2023-09-30T16:49:15.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.191+0000 7f5b7c8ce640 1 --2- 172.21.15.52:0/2562991023 >> v2:172.21.15.186:3300/0 conn(0x7f5b7815ce10 0x7f5b780b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:15.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 --2- 172.21.15.52:0/2562991023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780cd870 0x7f5b780cdcb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b4e30 tx=0x7f5b6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2e857207bfe0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b777fe640 1 -- 172.21.15.52:0/2562991023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0aa5f0 con 0x7f5b780cd870 2023-09-30T16:49:15.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b777fe640 1 -- 172.21.15.52:0/2562991023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0aa750 con 0x7f5b780cd870 2023-09-30T16:49:15.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b777fe640 1 -- 172.21.15.52:0/2562991023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0aaae0 con 0x7f5b780cd870 2023-09-30T16:49:15.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- 172.21.15.52:0/2562991023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780cd870 msgr2=0x7f5b780cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/2562991023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780cd870 0x7f5b780cdcb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b4e30 tx=0x7f5b6c01c470 comp rx=0 tx=0).stop 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- 172.21.15.52:0/2562991023 shutdown_connections 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/2562991023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780cd870 0x7f5b780cdcb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/2562991023 >> v2:172.21.15.186:3300/0 conn(0x7f5b7815ce10 0x7f5b780b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- 172.21.15.52:0/2562991023 >> 172.21.15.52:0/2562991023 conn(0x7f5b78071930 msgr2=0x7f5b78071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- 172.21.15.52:0/2562991023 shutdown_connections 2023-09-30T16:49:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- 172.21.15.52:0/2562991023 wait complete. 2023-09-30T16:49:15.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 Processor -- start 2023-09-30T16:49:15.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- start start 2023-09-30T16:49:15.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b780cd870 0x7f5b7815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 0x7f5b7814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b78150d10 0x7f5b781511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c8ed0 con 0x7f5b780d0fa0 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78152140 con 0x7f5b780cd870 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7eb32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78152420 con 0x7f5b78150d10 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 0x7f5b7814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 0x7f5b7814b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59002/0 (socket says 172.21.15.52:59002) 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 -- 172.21.15.52:0/966532681 learned_addr learned my addr 172.21.15.52:0/966532681 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7c8ce640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b780cd870 0x7f5b7815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b7d0cf640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b78150d10 0x7f5b781511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 -- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b78150d10 msgr2=0x7f5b781511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b78150d10 0x7f5b781511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 -- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b780cd870 msgr2=0x7f5b7815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b780cd870 0x7f5b7815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 -- 172.21.15.52:0/966532681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0094d0 con 0x7f5b780d0fa0 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.195+0000 7f5b77fff640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 0x7f5b7814b7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01a0a0 tx=0x7f5b6c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b1920 con 0x7f5b780d0fa0 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0b1a80 con 0x7f5b780d0fa0 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b78152700 con 0x7f5b780d0fa0 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b1e30 con 0x7f5b780d0fa0 2023-09-30T16:49:15.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7815bfa0 con 0x7f5b780d0fa0 2023-09-30T16:49:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b780cdf20 con 0x7f5b780d0fa0 2023-09-30T16:49:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f5b6c0bd3f0 con 0x7f5b780d0fa0 2023-09-30T16:49:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b757fa640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b64066160 0x7f5b64068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b6c0a7070 con 0x7f5b780d0fa0 2023-09-30T16:49:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b7c8ce640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b64066160 0x7f5b64068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.199+0000 7f5b7c8ce640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b64066160 0x7f5b64068620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006fd0 tx=0x7f5b68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.203+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5b6c0ebd20 con 0x7f5b780d0fa0 2023-09-30T16:49:15.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.355+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b78152bb0 con 0x7f5b64066160 2023-09-30T16:49:15.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b757fa640 1 -- 172.21.15.52:0/966532681 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250981 (secure 0 0 0) 0x7f5b6800c050 con 0x7f5b64066160 2023-09-30T16:49:15.381 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:15.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b64066160 msgr2=0x7f5b64068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b64066160 0x7f5b64068620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006fd0 tx=0x7f5b68008040 comp rx=0 tx=0).stop 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 msgr2=0x7f5b7814b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 0x7f5b7814b7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01a0a0 tx=0x7f5b6c01acb0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 shutdown_connections 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b64066160 0x7f5b64068620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b78150d10 0x7f5b781511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b780d0fa0 0x7f5b7814b7e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 --2- 172.21.15.52:0/966532681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b780cd870 0x7f5b7815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 >> 172.21.15.52:0/966532681 conn(0x7f5b78071930 msgr2=0x7f5b780b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 shutdown_connections 2023-09-30T16:49:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.379+0000 7f5b7eb32640 1 -- 172.21.15.52:0/966532681 wait complete. 2023-09-30T16:49:15.400 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T16:49:13.457252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235932,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738788,"statfs":{"total":773094113280,"available":772852518912,"internally_reserved":0,"allocated":2539520,"data_stored":1592345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894053"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:09.560735+0000","last_change":"2023-09-30T16:49:09.560735+0000","last_active":"2023-09-30T16:49:09.560735+0000","last_peered":"2023-09-30T16:49:09.560735+0000","last_clean":"2023-09-30T16:49:09.560735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:09.560735+0000","last_undegraded":"2023-09-30T16:49:09.560735+0000","last_fullsized":"2023-09-30T16:49:09.560735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:49:08.551181+0000","last_change":"2023-09-30T16:49:08.551181+0000","last_active":"2023-09-30T16:49:08.551181+0000","last_peered":"2023-09-30T16:49:08.551181+0000","last_clean":"2023-09-30T16:49:08.551181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:49:08.551181+0000","last_undegraded":"2023-09-30T16:49:08.551181+0000","last_fullsized":"2023-09-30T16:49:08.551181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":757760,"data_stored":639452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":658389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-09-30T16:49:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-09-30T16:49:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-09-30T16:49:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-09-30T16:49:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-09-30T16:49:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-09-30T16:49:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-09-30T16:49:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-09-30T16:49:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-09-30T16:49:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-09-30T16:49:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-09-30T16:49:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-30T16:49:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-09-30T16:49:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-09-30T16:49:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-09-30T16:49:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:09.560735+0000', 'last_change': '2023-09-30T16:49:09.560735+0000', 'last_active': '2023-09-30T16:49:09.560735+0000', 'last_peered': '2023-09-30T16:49:09.560735+0000', 'last_clean': '2023-09-30T16:49:09.560735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:09.560735+0000', 'last_undegraded': '2023-09-30T16:49:09.560735+0000', 'last_fullsized': '2023-09-30T16:49:09.560735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:09.560735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-09-30T16:49:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T16:49:08.551181+0000', 'last_change': '2023-09-30T16:49:08.551181+0000', 'last_active': '2023-09-30T16:49:08.551181+0000', 'last_peered': '2023-09-30T16:49:08.551181+0000', 'last_clean': '2023-09-30T16:49:08.551181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T16:49:08.551181+0000', 'last_undegraded': '2023-09-30T16:49:08.551181+0000', 'last_fullsized': '2023-09-30T16:49:08.551181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'last_clean_scrub_stamp': '2023-09-30T16:49:08.551181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T16:49:15.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T16:49:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.563+0000 7ff4e618d640 1 Processor -- start 2023-09-30T16:49:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.563+0000 7ff4e618d640 1 -- start start 2023-09-30T16:49:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4e618d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff4e0159980 0x7ff4e015d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4e618d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e006a510 0x7ff4e006d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4e618d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e015d9c0 con 0x7ff4e006d420 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4e618d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e006ae90 con 0x7ff4e006a510 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4e618d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e0159d60 con 0x7ff4e0159980 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e006a510 0x7ff4e006d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4e006a510 0x7ff4e006d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53838/0 (socket says 172.21.15.52:53838) 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 -- 172.21.15.52:0/792887984 learned_addr learned my addr 172.21.15.52:0/792887984 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4df7fe640 1 --2- 172.21.15.52:0/792887984 >> v2:172.21.15.186:3300/0 conn(0x7ff4e0159980 0x7ff4e015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 -- 172.21.15.52:0/792887984 >> v2:172.21.15.186:3300/0 conn(0x7ff4e0159980 msgr2=0x7ff4e015d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 --2- 172.21.15.52:0/792887984 >> v2:172.21.15.186:3300/0 conn(0x7ff4e0159980 0x7ff4e015d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 -- 172.21.15.52:0/792887984 >> v1:172.21.15.186:6789/0 conn(0x7ff4e006d420 legacy=0x7ff4e0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 -- 172.21.15.52:0/792887984 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e006bcb0 con 0x7ff4e006a510 2023-09-30T16:49:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4dffff640 1 --2- 172.21.15.52:0/792887984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006a510 0x7ff4e006d880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00cb0e0 tx=0x7ff4d801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95fd40adf385ba4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.567+0000 7ff4de7fc640 1 -- 172.21.15.52:0/792887984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80ab5f0 con 0x7ff4e006a510 2023-09-30T16:49:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4de7fc640 1 -- 172.21.15.52:0/792887984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d80ab750 con 0x7ff4e006a510 2023-09-30T16:49:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4de7fc640 1 -- 172.21.15.52:0/792887984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80abae0 con 0x7ff4e006a510 2023-09-30T16:49:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- 172.21.15.52:0/792887984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006a510 msgr2=0x7ff4e006d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 --2- 172.21.15.52:0/792887984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006a510 0x7ff4e006d880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00cb0e0 tx=0x7ff4d801c500 comp rx=0 tx=0).stop 2023-09-30T16:49:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- 172.21.15.52:0/792887984 shutdown_connections 2023-09-30T16:49:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 --2- 172.21.15.52:0/792887984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006a510 0x7ff4e006d880 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 --2- 172.21.15.52:0/792887984 >> v2:172.21.15.186:3300/0 conn(0x7ff4e0159980 0x7ff4e015d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- 172.21.15.52:0/792887984 >> 172.21.15.52:0/792887984 conn(0x7ff4e00ce700 msgr2=0x7ff4e00ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- 172.21.15.52:0/792887984 shutdown_connections 2023-09-30T16:49:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- 172.21.15.52:0/792887984 wait complete. 2023-09-30T16:49:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 Processor -- start 2023-09-30T16:49:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- start start 2023-09-30T16:49:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4e006a510 0x7ff4e00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 0x7ff4e0162720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4e0159980 0x7ff4e015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0162290 con 0x7ff4e006d420 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0161f60 con 0x7ff4e006a510 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4e618d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00adfd0 con 0x7ff4e0159980 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4deffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 0x7ff4e0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4deffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 0x7ff4e0162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53852/0 (socket says 172.21.15.52:53852) 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4deffd640 1 -- 172.21.15.52:0/1749001854 learned_addr learned my addr 172.21.15.52:0/1749001854 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.571+0000 7ff4df7fe640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4e006a510 0x7ff4e00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4dffff640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4e0159980 0x7ff4e015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4deffd640 1 -- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4e0159980 msgr2=0x7ff4e015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4deffd640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4e0159980 0x7ff4e015abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4deffd640 1 -- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4e006a510 msgr2=0x7ff4e00c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4deffd640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4e006a510 0x7ff4e00c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4deffd640 1 -- 172.21.15.52:0/1749001854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d80094d0 con 0x7ff4e006d420 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4deffd640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 0x7ff4e0162720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c7f0 tx=0x7ff4d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0003b80 con 0x7ff4e006d420 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0003ce0 con 0x7ff4e006d420 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e00ae2b0 con 0x7ff4e006d420 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e00c8590 con 0x7ff4e006d420 2023-09-30T16:49:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000aa90 con 0x7ff4e006d420 2023-09-30T16:49:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c4005260 con 0x7ff4e006d420 2023-09-30T16:49:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff4d000abf0 con 0x7ff4e006d420 2023-09-30T16:49:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4d7fff640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff4c0066160 0x7ff4c0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4d0083990 con 0x7ff4e006d420 2023-09-30T16:49:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.575+0000 7ff4df7fe640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff4c0066160 0x7ff4c0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.579+0000 7ff4df7fe640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff4c0066160 0x7ff4c0068620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009a50 tx=0x7ff4c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.579+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff4d0050f10 con 0x7ff4e006d420 2023-09-30T16:49:15.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff4c4005a90 con 0x7ff4e006d420 2023-09-30T16:49:15.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4d7fff640 1 -- 172.21.15.52:0/1749001854 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7ff4d00018c0 con 0x7ff4e006d420 2023-09-30T16:49:15.799 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:15.799 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1696092543,"num_in_osds":8,"osd_in_since":1696092534,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":241348608,"bytes_avail":772852764672,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-30T16:48:52.672079+0000","services":{}},"progress_events":{}} 2023-09-30T16:49:15.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff4c0066160 msgr2=0x7ff4c0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff4c0066160 0x7ff4c0068620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009a50 tx=0x7ff4c8008040 comp rx=0 tx=0).stop 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 msgr2=0x7ff4e0162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 0x7ff4e0162720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c7f0 tx=0x7ff4d000ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 shutdown_connections 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff4c0066160 0x7ff4c0068620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4e0159980 0x7ff4e015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4e006d420 0x7ff4e0162720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 --2- 172.21.15.52:0/1749001854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4e006a510 0x7ff4e00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 >> 172.21.15.52:0/1749001854 conn(0x7ff4e00ce700 msgr2=0x7ff4e00ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 shutdown_connections 2023-09-30T16:49:15.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.795+0000 7ff4e618d640 1 -- 172.21.15.52:0/1749001854 wait complete. 2023-09-30T16:49:15.815 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T16:49:15.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 Processor -- start 2023-09-30T16:49:15.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 -- start start 2023-09-30T16:49:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4dc0707e0 0x7fd4dc0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd4dc0b2850 0x7fd4dc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4dc070350 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4dc0b2ce0 con 0x7fd4dc0707e0 2023-09-30T16:49:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4e289d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4dc070c90 con 0x7fd4dc0b2850 2023-09-30T16:49:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4db7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4dc0707e0 0x7fd4dc0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4db7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4dc0707e0 0x7fd4dc0b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53858/0 (socket says 172.21.15.52:53858) 2023-09-30T16:49:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4db7fe640 1 -- 172.21.15.52:0/4283109273 learned_addr learned my addr 172.21.15.52:0/4283109273 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4db7fe640 1 -- 172.21.15.52:0/4283109273 >> v2:172.21.15.186:3300/0 conn(0x7fd4dc0b2850 msgr2=0x7fd4dc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4db7fe640 1 --2- 172.21.15.52:0/4283109273 >> v2:172.21.15.186:3300/0 conn(0x7fd4dc0b2850 0x7fd4dc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.919+0000 7fd4db7fe640 1 -- 172.21.15.52:0/4283109273 >> v1:172.21.15.186:6789/0 conn(0x7fd4dc0cf1e0 legacy=0x7fd4dc15d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4db7fe640 1 -- 172.21.15.52:0/4283109273 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc15db40 con 0x7fd4dc0707e0 2023-09-30T16:49:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4db7fe640 1 --2- 172.21.15.52:0/4283109273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0707e0 0x7fd4dc0b2310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0affd0 tx=0x7fd4d001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b41dd2a5571627 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4daffd640 1 -- 172.21.15.52:0/4283109273 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00a89b0 con 0x7fd4dc0707e0 2023-09-30T16:49:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4daffd640 1 -- 172.21.15.52:0/4283109273 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d00a8b10 con 0x7fd4dc0707e0 2023-09-30T16:49:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4daffd640 1 -- 172.21.15.52:0/4283109273 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00a8ea0 con 0x7fd4dc0707e0 2023-09-30T16:49:15.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 -- 172.21.15.52:0/4283109273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0707e0 msgr2=0x7fd4dc0b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 --2- 172.21.15.52:0/4283109273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0707e0 0x7fd4dc0b2310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0affd0 tx=0x7fd4d001ecb0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 -- 172.21.15.52:0/4283109273 shutdown_connections 2023-09-30T16:49:15.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 --2- 172.21.15.52:0/4283109273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0707e0 0x7fd4dc0b2310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 --2- 172.21.15.52:0/4283109273 >> v2:172.21.15.186:3300/0 conn(0x7fd4dc0b2850 0x7fd4dc0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 -- 172.21.15.52:0/4283109273 >> 172.21.15.52:0/4283109273 conn(0x7fd4dc0cd310 msgr2=0x7fd4dc0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:15.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 -- 172.21.15.52:0/4283109273 shutdown_connections 2023-09-30T16:49:15.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.923+0000 7fd4e289d640 1 -- 172.21.15.52:0/4283109273 wait complete. 2023-09-30T16:49:15.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 Processor -- start 2023-09-30T16:49:15.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- start start 2023-09-30T16:49:15.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4dc0707e0 0x7fd4dc153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4dc0b2850 0x7fd4dc1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 0x7fd4dc155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c8620 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c8900 con 0x7fd4dc0b2850 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c8be0 con 0x7fd4dc0707e0 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 0x7fd4dc155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 0x7fd4dc155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53860/0 (socket says 172.21.15.52:53860) 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 -- 172.21.15.52:0/2575430425 learned_addr learned my addr 172.21.15.52:0/2575430425 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4db7fe640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4dc0b2850 0x7fd4dc1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4dbfff640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4dc0707e0 0x7fd4dc153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 -- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4dc0707e0 msgr2=0x7fd4dc153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4dc0707e0 0x7fd4dc153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 -- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4dc0b2850 msgr2=0x7fd4dc1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4dc0b2850 0x7fd4dc1557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 -- 172.21.15.52:0/2575430425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d00094d0 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e0e3a640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 0x7fd4dc155d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400b9e0 tx=0x7fd4d400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400caa0 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d400cc20 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4dc0c8ec0 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4014440 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4dc1f2510 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4dc0740a0 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd4d401d3b0 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4d8ff9640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd4c8066160 0x7fd4c8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4d40838e0 con 0x7fd4dc0cf1e0 2023-09-30T16:49:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.927+0000 7fd4dbfff640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd4c8066160 0x7fd4c8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.931+0000 7fd4dbfff640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd4c8066160 0x7fd4c8068620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00a790 tx=0x7fd4cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:15.931+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd4d4050f90 con 0x7fd4dc0cf1e0 2023-09-30T16:49:16.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.075+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4dc06ffe0 con 0x7fd4c8066160 2023-09-30T16:49:16.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4d8ff9640 1 -- 172.21.15.52:0/2575430425 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264646 (secure 0 0 0) 0x7fd4cc00a430 con 0x7fd4c8066160 2023-09-30T16:49:16.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd4c8066160 msgr2=0x7fd4c8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd4c8066160 0x7fd4c8068620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00a790 tx=0x7fd4cc008040 comp rx=0 tx=0).stop 2023-09-30T16:49:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 msgr2=0x7fd4dc155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 0x7fd4dc155d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400b9e0 tx=0x7fd4d400bea0 comp rx=0 tx=0).stop 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 shutdown_connections 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd4c8066160 0x7fd4c8068620 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4dc0cf1e0 0x7fd4dc155d30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4dc0b2850 0x7fd4dc1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 --2- 172.21.15.52:0/2575430425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4dc0707e0 0x7fd4dc153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.099+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 >> 172.21.15.52:0/2575430425 conn(0x7fd4dc0cd310 msgr2=0x7fd4dc160450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.103+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 shutdown_connections 2023-09-30T16:49:16.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:16.103+0000 7fd4e289d640 1 -- 172.21.15.52:0/2575430425 wait complete. 2023-09-30T16:49:16.121 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-30T16:49:15.457902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235692,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739028,"statfs":{"total":773094113280,"available":772852764672,"internally_reserved":0,"allocated":2945024,"data_stored":1773264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001877"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978658+0000","last_change":"2023-09-30T16:49:10.633322+0000","last_active":"2023-09-30T16:49:11.978658+0000","last_peered":"2023-09-30T16:49:11.978658+0000","last_clean":"2023-09-30T16:49:11.978658+0000","last_became_active":"2023-09-30T16:49:10.631135+0000","last_became_peered":"2023-09-30T16:49:10.631135+0000","last_unstale":"2023-09-30T16:49:11.978658+0000","last_undegraded":"2023-09-30T16:49:11.978658+0000","last_fullsized":"2023-09-30T16:49:11.978658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976757+0000","last_change":"2023-09-30T16:49:10.632204+0000","last_active":"2023-09-30T16:49:11.976757+0000","last_peered":"2023-09-30T16:49:11.976757+0000","last_clean":"2023-09-30T16:49:11.976757+0000","last_became_active":"2023-09-30T16:49:10.631691+0000","last_became_peered":"2023-09-30T16:49:10.631691+0000","last_unstale":"2023-09-30T16:49:11.976757+0000","last_undegraded":"2023-09-30T16:49:11.976757+0000","last_fullsized":"2023-09-30T16:49:11.976757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:56:24.913821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976467+0000","last_change":"2023-09-30T16:49:10.629832+0000","last_active":"2023-09-30T16:49:11.976467+0000","last_peered":"2023-09-30T16:49:11.976467+0000","last_clean":"2023-09-30T16:49:11.976467+0000","last_became_active":"2023-09-30T16:49:10.629449+0000","last_became_peered":"2023-09-30T16:49:10.629449+0000","last_unstale":"2023-09-30T16:49:11.976467+0000","last_undegraded":"2023-09-30T16:49:11.976467+0000","last_fullsized":"2023-09-30T16:49:11.976467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.604692+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.603126+0000","last_became_peered":"2023-09-30T16:49:10.603126+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:34.821952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:10.633644+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:10.630535+0000","last_became_peered":"2023-09-30T16:49:10.630535+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:25.913808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597358+0000","last_change":"2023-09-30T16:49:10.604995+0000","last_active":"2023-09-30T16:49:11.597358+0000","last_peered":"2023-09-30T16:49:11.597358+0000","last_clean":"2023-09-30T16:49:11.597358+0000","last_became_active":"2023-09-30T16:49:10.603075+0000","last_became_peered":"2023-09-30T16:49:10.603075+0000","last_unstale":"2023-09-30T16:49:11.597358+0000","last_undegraded":"2023-09-30T16:49:11.597358+0000","last_fullsized":"2023-09-30T16:49:11.597358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976179+0000","last_change":"2023-09-30T16:49:10.630597+0000","last_active":"2023-09-30T16:49:11.976179+0000","last_peered":"2023-09-30T16:49:11.976179+0000","last_clean":"2023-09-30T16:49:11.976179+0000","last_became_active":"2023-09-30T16:49:10.626842+0000","last_became_peered":"2023-09-30T16:49:10.626842+0000","last_unstale":"2023-09-30T16:49:11.976179+0000","last_undegraded":"2023-09-30T16:49:11.976179+0000","last_fullsized":"2023-09-30T16:49:11.976179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:25:42.884890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977750+0000","last_change":"2023-09-30T16:49:10.633003+0000","last_active":"2023-09-30T16:49:11.977750+0000","last_peered":"2023-09-30T16:49:11.977750+0000","last_clean":"2023-09-30T16:49:11.977750+0000","last_became_active":"2023-09-30T16:49:10.632147+0000","last_became_peered":"2023-09-30T16:49:10.632147+0000","last_unstale":"2023-09-30T16:49:11.977750+0000","last_undegraded":"2023-09-30T16:49:11.977750+0000","last_fullsized":"2023-09-30T16:49:11.977750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:51:01.956500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978014+0000","last_change":"2023-09-30T16:49:10.633201+0000","last_active":"2023-09-30T16:49:11.978014+0000","last_peered":"2023-09-30T16:49:11.978014+0000","last_clean":"2023-09-30T16:49:11.978014+0000","last_became_active":"2023-09-30T16:49:10.631149+0000","last_became_peered":"2023-09-30T16:49:10.631149+0000","last_unstale":"2023-09-30T16:49:11.978014+0000","last_undegraded":"2023-09-30T16:49:11.978014+0000","last_fullsized":"2023-09-30T16:49:11.978014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977411+0000","last_change":"2023-09-30T16:49:10.633919+0000","last_active":"2023-09-30T16:49:11.977411+0000","last_peered":"2023-09-30T16:49:11.977411+0000","last_clean":"2023-09-30T16:49:11.977411+0000","last_became_active":"2023-09-30T16:49:10.633415+0000","last_became_peered":"2023-09-30T16:49:10.633415+0000","last_unstale":"2023-09-30T16:49:11.977411+0000","last_undegraded":"2023-09-30T16:49:11.977411+0000","last_fullsized":"2023-09-30T16:49:11.977411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:06.308183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976984+0000","last_change":"2023-09-30T16:49:10.638963+0000","last_active":"2023-09-30T16:49:11.976984+0000","last_peered":"2023-09-30T16:49:11.976984+0000","last_clean":"2023-09-30T16:49:11.976984+0000","last_became_active":"2023-09-30T16:49:10.638232+0000","last_became_peered":"2023-09-30T16:49:10.638232+0000","last_unstale":"2023-09-30T16:49:11.976984+0000","last_undegraded":"2023-09-30T16:49:11.976984+0000","last_fullsized":"2023-09-30T16:49:11.976984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:14.058908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601136+0000","last_change":"2023-09-30T16:49:10.635159+0000","last_active":"2023-09-30T16:49:11.601136+0000","last_peered":"2023-09-30T16:49:11.601136+0000","last_clean":"2023-09-30T16:49:11.601136+0000","last_became_active":"2023-09-30T16:49:10.634816+0000","last_became_peered":"2023-09-30T16:49:10.634816+0000","last_unstale":"2023-09-30T16:49:11.601136+0000","last_undegraded":"2023-09-30T16:49:11.601136+0000","last_fullsized":"2023-09-30T16:49:11.601136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:56.576610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601222+0000","last_change":"2023-09-30T16:49:10.623197+0000","last_active":"2023-09-30T16:49:11.601222+0000","last_peered":"2023-09-30T16:49:11.601222+0000","last_clean":"2023-09-30T16:49:11.601222+0000","last_became_active":"2023-09-30T16:49:10.622869+0000","last_became_peered":"2023-09-30T16:49:10.622869+0000","last_unstale":"2023-09-30T16:49:11.601222+0000","last_undegraded":"2023-09-30T16:49:11.601222+0000","last_fullsized":"2023-09-30T16:49:11.601222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:50.982816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976170+0000","last_change":"2023-09-30T16:49:10.636242+0000","last_active":"2023-09-30T16:49:11.976170+0000","last_peered":"2023-09-30T16:49:11.976170+0000","last_clean":"2023-09-30T16:49:11.976170+0000","last_became_active":"2023-09-30T16:49:10.635932+0000","last_became_peered":"2023-09-30T16:49:10.635932+0000","last_unstale":"2023-09-30T16:49:11.976170+0000","last_undegraded":"2023-09-30T16:49:11.976170+0000","last_fullsized":"2023-09-30T16:49:11.976170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977806+0000","last_change":"2023-09-30T16:49:10.617833+0000","last_active":"2023-09-30T16:49:11.977806+0000","last_peered":"2023-09-30T16:49:11.977806+0000","last_clean":"2023-09-30T16:49:11.977806+0000","last_became_active":"2023-09-30T16:49:10.617311+0000","last_became_peered":"2023-09-30T16:49:10.617311+0000","last_unstale":"2023-09-30T16:49:11.977806+0000","last_undegraded":"2023-09-30T16:49:11.977806+0000","last_fullsized":"2023-09-30T16:49:11.977806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978520+0000","last_change":"2023-09-30T16:49:10.635091+0000","last_active":"2023-09-30T16:49:11.978520+0000","last_peered":"2023-09-30T16:49:11.978520+0000","last_clean":"2023-09-30T16:49:11.978520+0000","last_became_active":"2023-09-30T16:49:10.633981+0000","last_became_peered":"2023-09-30T16:49:10.633981+0000","last_unstale":"2023-09-30T16:49:11.978520+0000","last_undegraded":"2023-09-30T16:49:11.978520+0000","last_fullsized":"2023-09-30T16:49:11.978520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:09:36.748081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977435+0000","last_change":"2023-09-30T16:49:10.628753+0000","last_active":"2023-09-30T16:49:11.977435+0000","last_peered":"2023-09-30T16:49:11.977435+0000","last_clean":"2023-09-30T16:49:11.977435+0000","last_became_active":"2023-09-30T16:49:10.628478+0000","last_became_peered":"2023-09-30T16:49:10.628478+0000","last_unstale":"2023-09-30T16:49:11.977435+0000","last_undegraded":"2023-09-30T16:49:11.977435+0000","last_fullsized":"2023-09-30T16:49:11.977435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979513+0000","last_change":"2023-09-30T16:49:10.629633+0000","last_active":"2023-09-30T16:49:11.979513+0000","last_peered":"2023-09-30T16:49:11.979513+0000","last_clean":"2023-09-30T16:49:11.979513+0000","last_became_active":"2023-09-30T16:49:10.629202+0000","last_became_peered":"2023-09-30T16:49:10.629202+0000","last_unstale":"2023-09-30T16:49:11.979513+0000","last_undegraded":"2023-09-30T16:49:11.979513+0000","last_fullsized":"2023-09-30T16:49:11.979513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:21:16.999794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977323+0000","last_change":"2023-09-30T16:49:10.638755+0000","last_active":"2023-09-30T16:49:11.977323+0000","last_peered":"2023-09-30T16:49:11.977323+0000","last_clean":"2023-09-30T16:49:11.977323+0000","last_became_active":"2023-09-30T16:49:10.637877+0000","last_became_peered":"2023-09-30T16:49:10.637877+0000","last_unstale":"2023-09-30T16:49:11.977323+0000","last_undegraded":"2023-09-30T16:49:11.977323+0000","last_fullsized":"2023-09-30T16:49:11.977323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:14.992346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601810+0000","last_change":"2023-09-30T16:49:10.604164+0000","last_active":"2023-09-30T16:49:11.601810+0000","last_peered":"2023-09-30T16:49:11.601810+0000","last_clean":"2023-09-30T16:49:11.601810+0000","last_became_active":"2023-09-30T16:49:10.603748+0000","last_became_peered":"2023-09-30T16:49:10.603748+0000","last_unstale":"2023-09-30T16:49:11.601810+0000","last_undegraded":"2023-09-30T16:49:11.601810+0000","last_fullsized":"2023-09-30T16:49:11.601810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976548+0000","last_change":"2023-09-30T16:49:10.622204+0000","last_active":"2023-09-30T16:49:11.976548+0000","last_peered":"2023-09-30T16:49:11.976548+0000","last_clean":"2023-09-30T16:49:11.976548+0000","last_became_active":"2023-09-30T16:49:10.621777+0000","last_became_peered":"2023-09-30T16:49:10.621777+0000","last_unstale":"2023-09-30T16:49:11.976548+0000","last_undegraded":"2023-09-30T16:49:11.976548+0000","last_fullsized":"2023-09-30T16:49:11.976548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978154+0000","last_change":"2023-09-30T16:49:10.630731+0000","last_active":"2023-09-30T16:49:11.978154+0000","last_peered":"2023-09-30T16:49:11.978154+0000","last_clean":"2023-09-30T16:49:11.978154+0000","last_became_active":"2023-09-30T16:49:10.630397+0000","last_became_peered":"2023-09-30T16:49:10.630397+0000","last_unstale":"2023-09-30T16:49:11.978154+0000","last_undegraded":"2023-09-30T16:49:11.978154+0000","last_fullsized":"2023-09-30T16:49:11.978154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:56:20.514299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976860+0000","last_change":"2023-09-30T16:49:10.632997+0000","last_active":"2023-09-30T16:49:11.976860+0000","last_peered":"2023-09-30T16:49:11.976860+0000","last_clean":"2023-09-30T16:49:11.976860+0000","last_became_active":"2023-09-30T16:49:10.631924+0000","last_became_peered":"2023-09-30T16:49:10.631924+0000","last_unstale":"2023-09-30T16:49:11.976860+0000","last_undegraded":"2023-09-30T16:49:11.976860+0000","last_fullsized":"2023-09-30T16:49:11.976860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:24.961600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597835+0000","last_change":"2023-09-30T16:49:10.619518+0000","last_active":"2023-09-30T16:49:11.597835+0000","last_peered":"2023-09-30T16:49:11.597835+0000","last_clean":"2023-09-30T16:49:11.597835+0000","last_became_active":"2023-09-30T16:49:10.619041+0000","last_became_peered":"2023-09-30T16:49:10.619041+0000","last_unstale":"2023-09-30T16:49:11.597835+0000","last_undegraded":"2023-09-30T16:49:11.597835+0000","last_fullsized":"2023-09-30T16:49:11.597835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:34:06.083677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601356+0000","last_change":"2023-09-30T16:49:10.623431+0000","last_active":"2023-09-30T16:49:11.601356+0000","last_peered":"2023-09-30T16:49:11.601356+0000","last_clean":"2023-09-30T16:49:11.601356+0000","last_became_active":"2023-09-30T16:49:10.623009+0000","last_became_peered":"2023-09-30T16:49:10.623009+0000","last_unstale":"2023-09-30T16:49:11.601356+0000","last_undegraded":"2023-09-30T16:49:11.601356+0000","last_fullsized":"2023-09-30T16:49:11.601356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601808+0000","last_change":"2023-09-30T16:49:10.639015+0000","last_active":"2023-09-30T16:49:11.601808+0000","last_peered":"2023-09-30T16:49:11.601808+0000","last_clean":"2023-09-30T16:49:11.601808+0000","last_became_active":"2023-09-30T16:49:10.638680+0000","last_became_peered":"2023-09-30T16:49:10.638680+0000","last_unstale":"2023-09-30T16:49:11.601808+0000","last_undegraded":"2023-09-30T16:49:11.601808+0000","last_fullsized":"2023-09-30T16:49:11.601808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976602+0000","last_change":"2023-09-30T16:49:10.623827+0000","last_active":"2023-09-30T16:49:11.976602+0000","last_peered":"2023-09-30T16:49:11.976602+0000","last_clean":"2023-09-30T16:49:11.976602+0000","last_became_active":"2023-09-30T16:49:10.623133+0000","last_became_peered":"2023-09-30T16:49:10.623133+0000","last_unstale":"2023-09-30T16:49:11.976602+0000","last_undegraded":"2023-09-30T16:49:11.976602+0000","last_fullsized":"2023-09-30T16:49:11.976602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976867+0000","last_change":"2023-09-30T16:49:10.632416+0000","last_active":"2023-09-30T16:49:11.976867+0000","last_peered":"2023-09-30T16:49:11.976867+0000","last_clean":"2023-09-30T16:49:11.976867+0000","last_became_active":"2023-09-30T16:49:10.631982+0000","last_became_peered":"2023-09-30T16:49:10.631982+0000","last_unstale":"2023-09-30T16:49:11.976867+0000","last_undegraded":"2023-09-30T16:49:11.976867+0000","last_fullsized":"2023-09-30T16:49:11.976867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975991+0000","last_change":"2023-09-30T16:49:10.624572+0000","last_active":"2023-09-30T16:49:11.975991+0000","last_peered":"2023-09-30T16:49:11.975991+0000","last_clean":"2023-09-30T16:49:11.975991+0000","last_became_active":"2023-09-30T16:49:10.624284+0000","last_became_peered":"2023-09-30T16:49:10.624284+0000","last_unstale":"2023-09-30T16:49:11.975991+0000","last_undegraded":"2023-09-30T16:49:11.975991+0000","last_fullsized":"2023-09-30T16:49:11.975991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.596894+0000","last_change":"2023-09-30T16:49:10.614544+0000","last_active":"2023-09-30T16:49:11.596894+0000","last_peered":"2023-09-30T16:49:11.596894+0000","last_clean":"2023-09-30T16:49:11.596894+0000","last_became_active":"2023-09-30T16:49:10.614152+0000","last_became_peered":"2023-09-30T16:49:10.614152+0000","last_unstale":"2023-09-30T16:49:11.596894+0000","last_undegraded":"2023-09-30T16:49:11.596894+0000","last_fullsized":"2023-09-30T16:49:11.596894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976846+0000","last_change":"2023-09-30T16:49:09.619255+0000","last_active":"2023-09-30T16:49:11.976846+0000","last_peered":"2023-09-30T16:49:11.976846+0000","last_clean":"2023-09-30T16:49:11.976846+0000","last_became_active":"2023-09-30T16:49:09.618555+0000","last_became_peered":"2023-09-30T16:49:09.618555+0000","last_unstale":"2023-09-30T16:49:11.976846+0000","last_undegraded":"2023-09-30T16:49:11.976846+0000","last_fullsized":"2023-09-30T16:49:11.976846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601602+0000","last_change":"2023-09-30T16:49:10.634574+0000","last_active":"2023-09-30T16:49:11.601602+0000","last_peered":"2023-09-30T16:49:11.601602+0000","last_clean":"2023-09-30T16:49:11.601602+0000","last_became_active":"2023-09-30T16:49:10.634290+0000","last_became_peered":"2023-09-30T16:49:10.634290+0000","last_unstale":"2023-09-30T16:49:11.601602+0000","last_undegraded":"2023-09-30T16:49:11.601602+0000","last_fullsized":"2023-09-30T16:49:11.601602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977368+0000","last_change":"2023-09-30T16:49:09.591524+0000","last_active":"2023-09-30T16:49:11.977368+0000","last_peered":"2023-09-30T16:49:11.977368+0000","last_clean":"2023-09-30T16:49:11.977368+0000","last_became_active":"2023-09-30T16:49:09.591196+0000","last_became_peered":"2023-09-30T16:49:09.591196+0000","last_unstale":"2023-09-30T16:49:11.977368+0000","last_undegraded":"2023-09-30T16:49:11.977368+0000","last_fullsized":"2023-09-30T16:49:11.977368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:05.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601646+0000","last_change":"2023-09-30T16:49:09.593605+0000","last_active":"2023-09-30T16:49:11.601646+0000","last_peered":"2023-09-30T16:49:11.601646+0000","last_clean":"2023-09-30T16:49:11.601646+0000","last_became_active":"2023-09-30T16:49:09.592556+0000","last_became_peered":"2023-09-30T16:49:09.592556+0000","last_unstale":"2023-09-30T16:49:11.601646+0000","last_undegraded":"2023-09-30T16:49:11.601646+0000","last_fullsized":"2023-09-30T16:49:11.601646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:22.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977552+0000","last_change":"2023-09-30T16:49:10.626630+0000","last_active":"2023-09-30T16:49:11.977552+0000","last_peered":"2023-09-30T16:49:11.977552+0000","last_clean":"2023-09-30T16:49:11.977552+0000","last_became_active":"2023-09-30T16:49:10.626316+0000","last_became_peered":"2023-09-30T16:49:10.626316+0000","last_unstale":"2023-09-30T16:49:11.977552+0000","last_undegraded":"2023-09-30T16:49:11.977552+0000","last_fullsized":"2023-09-30T16:49:11.977552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:38.419701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978195+0000","last_change":"2023-09-30T16:49:09.594246+0000","last_active":"2023-09-30T16:49:11.978195+0000","last_peered":"2023-09-30T16:49:11.978195+0000","last_clean":"2023-09-30T16:49:11.978195+0000","last_became_active":"2023-09-30T16:49:09.593915+0000","last_became_peered":"2023-09-30T16:49:09.593915+0000","last_unstale":"2023-09-30T16:49:11.978195+0000","last_undegraded":"2023-09-30T16:49:11.978195+0000","last_fullsized":"2023-09-30T16:49:11.978195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601785+0000","last_change":"2023-09-30T16:49:10.626401+0000","last_active":"2023-09-30T16:49:11.601785+0000","last_peered":"2023-09-30T16:49:11.601785+0000","last_clean":"2023-09-30T16:49:11.601785+0000","last_became_active":"2023-09-30T16:49:10.621995+0000","last_became_peered":"2023-09-30T16:49:10.621995+0000","last_unstale":"2023-09-30T16:49:11.601785+0000","last_undegraded":"2023-09-30T16:49:11.601785+0000","last_fullsized":"2023-09-30T16:49:11.601785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.613752+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.613471+0000","last_became_peered":"2023-09-30T16:49:10.613471+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:50.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978231+0000","last_change":"2023-09-30T16:49:09.592279+0000","last_active":"2023-09-30T16:49:11.978231+0000","last_peered":"2023-09-30T16:49:11.978231+0000","last_clean":"2023-09-30T16:49:11.978231+0000","last_became_active":"2023-09-30T16:49:09.591878+0000","last_became_peered":"2023-09-30T16:49:09.591878+0000","last_unstale":"2023-09-30T16:49:11.978231+0000","last_undegraded":"2023-09-30T16:49:11.978231+0000","last_fullsized":"2023-09-30T16:49:11.978231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.044504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977588+0000","last_change":"2023-09-30T16:49:10.628129+0000","last_active":"2023-09-30T16:49:11.977588+0000","last_peered":"2023-09-30T16:49:11.977588+0000","last_clean":"2023-09-30T16:49:11.977588+0000","last_became_active":"2023-09-30T16:49:10.627840+0000","last_became_peered":"2023-09-30T16:49:10.627840+0000","last_unstale":"2023-09-30T16:49:11.977588+0000","last_undegraded":"2023-09-30T16:49:11.977588+0000","last_fullsized":"2023-09-30T16:49:11.977588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:05:15.929844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977128+0000","last_change":"2023-09-30T16:49:09.612101+0000","last_active":"2023-09-30T16:49:11.977128+0000","last_peered":"2023-09-30T16:49:11.977128+0000","last_clean":"2023-09-30T16:49:11.977128+0000","last_became_active":"2023-09-30T16:49:09.611560+0000","last_became_peered":"2023-09-30T16:49:09.611560+0000","last_unstale":"2023-09-30T16:49:11.977128+0000","last_undegraded":"2023-09-30T16:49:11.977128+0000","last_fullsized":"2023-09-30T16:49:11.977128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:15.187430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976893+0000","last_change":"2023-09-30T16:49:10.619592+0000","last_active":"2023-09-30T16:49:11.976893+0000","last_peered":"2023-09-30T16:49:11.976893+0000","last_clean":"2023-09-30T16:49:11.976893+0000","last_became_active":"2023-09-30T16:49:10.619251+0000","last_became_peered":"2023-09-30T16:49:10.619251+0000","last_unstale":"2023-09-30T16:49:11.976893+0000","last_undegraded":"2023-09-30T16:49:11.976893+0000","last_fullsized":"2023-09-30T16:49:11.976893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597687+0000","last_change":"2023-09-30T16:49:09.606217+0000","last_active":"2023-09-30T16:49:11.597687+0000","last_peered":"2023-09-30T16:49:11.597687+0000","last_clean":"2023-09-30T16:49:11.597687+0000","last_became_active":"2023-09-30T16:49:09.605883+0000","last_became_peered":"2023-09-30T16:49:09.605883+0000","last_unstale":"2023-09-30T16:49:11.597687+0000","last_undegraded":"2023-09-30T16:49:11.597687+0000","last_fullsized":"2023-09-30T16:49:11.597687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:20:46.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977809+0000","last_change":"2023-09-30T16:49:10.633013+0000","last_active":"2023-09-30T16:49:11.977809+0000","last_peered":"2023-09-30T16:49:11.977809+0000","last_clean":"2023-09-30T16:49:11.977809+0000","last_became_active":"2023-09-30T16:49:10.626780+0000","last_became_peered":"2023-09-30T16:49:10.626780+0000","last_unstale":"2023-09-30T16:49:11.977809+0000","last_undegraded":"2023-09-30T16:49:11.977809+0000","last_fullsized":"2023-09-30T16:49:11.977809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:14:01.374332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977545+0000","last_change":"2023-09-30T16:49:09.601823+0000","last_active":"2023-09-30T16:49:11.977545+0000","last_peered":"2023-09-30T16:49:11.977545+0000","last_clean":"2023-09-30T16:49:11.977545+0000","last_became_active":"2023-09-30T16:49:09.600844+0000","last_became_peered":"2023-09-30T16:49:09.600844+0000","last_unstale":"2023-09-30T16:49:11.977545+0000","last_undegraded":"2023-09-30T16:49:11.977545+0000","last_fullsized":"2023-09-30T16:49:11.977545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:12:56.898098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601684+0000","last_change":"2023-09-30T16:49:10.619205+0000","last_active":"2023-09-30T16:49:11.601684+0000","last_peered":"2023-09-30T16:49:11.601684+0000","last_clean":"2023-09-30T16:49:11.601684+0000","last_became_active":"2023-09-30T16:49:10.618841+0000","last_became_peered":"2023-09-30T16:49:10.618841+0000","last_unstale":"2023-09-30T16:49:11.601684+0000","last_undegraded":"2023-09-30T16:49:11.601684+0000","last_fullsized":"2023-09-30T16:49:11.601684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977431+0000","last_change":"2023-09-30T16:49:09.596896+0000","last_active":"2023-09-30T16:49:11.977431+0000","last_peered":"2023-09-30T16:49:11.977431+0000","last_clean":"2023-09-30T16:49:11.977431+0000","last_became_active":"2023-09-30T16:49:09.596566+0000","last_became_peered":"2023-09-30T16:49:09.596566+0000","last_unstale":"2023-09-30T16:49:11.977431+0000","last_undegraded":"2023-09-30T16:49:11.977431+0000","last_fullsized":"2023-09-30T16:49:11.977431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:13.982791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979825+0000","last_change":"2023-09-30T16:49:10.637755+0000","last_active":"2023-09-30T16:49:11.979825+0000","last_peered":"2023-09-30T16:49:11.979825+0000","last_clean":"2023-09-30T16:49:11.979825+0000","last_became_active":"2023-09-30T16:49:10.637423+0000","last_became_peered":"2023-09-30T16:49:10.637423+0000","last_unstale":"2023-09-30T16:49:11.979825+0000","last_undegraded":"2023-09-30T16:49:11.979825+0000","last_fullsized":"2023-09-30T16:49:11.979825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:08.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976207+0000","last_change":"2023-09-30T16:49:09.595029+0000","last_active":"2023-09-30T16:49:11.976207+0000","last_peered":"2023-09-30T16:49:11.976207+0000","last_clean":"2023-09-30T16:49:11.976207+0000","last_became_active":"2023-09-30T16:49:09.594386+0000","last_became_peered":"2023-09-30T16:49:09.594386+0000","last_unstale":"2023-09-30T16:49:11.976207+0000","last_undegraded":"2023-09-30T16:49:11.976207+0000","last_fullsized":"2023-09-30T16:49:11.976207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:00.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602079+0000","last_change":"2023-09-30T16:49:09.598236+0000","last_active":"2023-09-30T16:49:11.602079+0000","last_peered":"2023-09-30T16:49:11.602079+0000","last_clean":"2023-09-30T16:49:11.602079+0000","last_became_active":"2023-09-30T16:49:09.597544+0000","last_became_peered":"2023-09-30T16:49:09.597544+0000","last_unstale":"2023-09-30T16:49:11.602079+0000","last_undegraded":"2023-09-30T16:49:11.602079+0000","last_fullsized":"2023-09-30T16:49:11.602079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:55.567056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978555+0000","last_change":"2023-09-30T16:49:10.617486+0000","last_active":"2023-09-30T16:49:11.978555+0000","last_peered":"2023-09-30T16:49:11.978555+0000","last_clean":"2023-09-30T16:49:11.978555+0000","last_became_active":"2023-09-30T16:49:10.617170+0000","last_became_peered":"2023-09-30T16:49:10.617170+0000","last_unstale":"2023-09-30T16:49:11.978555+0000","last_undegraded":"2023-09-30T16:49:11.978555+0000","last_fullsized":"2023-09-30T16:49:11.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:12.868894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978921+0000","last_change":"2023-09-30T16:49:09.614260+0000","last_active":"2023-09-30T16:49:11.978921+0000","last_peered":"2023-09-30T16:49:11.978921+0000","last_clean":"2023-09-30T16:49:11.978921+0000","last_became_active":"2023-09-30T16:49:09.613910+0000","last_became_peered":"2023-09-30T16:49:09.613910+0000","last_unstale":"2023-09-30T16:49:11.978921+0000","last_undegraded":"2023-09-30T16:49:11.978921+0000","last_fullsized":"2023-09-30T16:49:11.978921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598019+0000","last_change":"2023-09-30T16:49:10.631809+0000","last_active":"2023-09-30T16:49:11.598019+0000","last_peered":"2023-09-30T16:49:11.598019+0000","last_clean":"2023-09-30T16:49:11.598019+0000","last_became_active":"2023-09-30T16:49:10.631420+0000","last_became_peered":"2023-09-30T16:49:10.631420+0000","last_unstale":"2023-09-30T16:49:11.598019+0000","last_undegraded":"2023-09-30T16:49:11.598019+0000","last_fullsized":"2023-09-30T16:49:11.598019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:14.134423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602272+0000","last_change":"2023-09-30T16:49:09.624546+0000","last_active":"2023-09-30T16:49:11.602272+0000","last_peered":"2023-09-30T16:49:11.602272+0000","last_clean":"2023-09-30T16:49:11.602272+0000","last_became_active":"2023-09-30T16:49:09.623841+0000","last_became_peered":"2023-09-30T16:49:09.623841+0000","last_unstale":"2023-09-30T16:49:11.602272+0000","last_undegraded":"2023-09-30T16:49:11.602272+0000","last_fullsized":"2023-09-30T16:49:11.602272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:20.760273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978769+0000","last_change":"2023-09-30T16:49:10.638625+0000","last_active":"2023-09-30T16:49:11.978769+0000","last_peered":"2023-09-30T16:49:11.978769+0000","last_clean":"2023-09-30T16:49:11.978769+0000","last_became_active":"2023-09-30T16:49:10.638153+0000","last_became_peered":"2023-09-30T16:49:10.638153+0000","last_unstale":"2023-09-30T16:49:11.978769+0000","last_undegraded":"2023-09-30T16:49:11.978769+0000","last_fullsized":"2023-09-30T16:49:11.978769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976605+0000","last_change":"2023-09-30T16:49:09.604750+0000","last_active":"2023-09-30T16:49:11.976605+0000","last_peered":"2023-09-30T16:49:11.976605+0000","last_clean":"2023-09-30T16:49:11.976605+0000","last_became_active":"2023-09-30T16:49:09.600838+0000","last_became_peered":"2023-09-30T16:49:09.600838+0000","last_unstale":"2023-09-30T16:49:11.976605+0000","last_undegraded":"2023-09-30T16:49:11.976605+0000","last_fullsized":"2023-09-30T16:49:11.976605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977679+0000","last_change":"2023-09-30T16:49:10.637559+0000","last_active":"2023-09-30T16:49:11.977679+0000","last_peered":"2023-09-30T16:49:11.977679+0000","last_clean":"2023-09-30T16:49:11.977679+0000","last_became_active":"2023-09-30T16:49:10.630340+0000","last_became_peered":"2023-09-30T16:49:10.630340+0000","last_unstale":"2023-09-30T16:49:11.977679+0000","last_undegraded":"2023-09-30T16:49:11.977679+0000","last_fullsized":"2023-09-30T16:49:11.977679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:27.229031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601934+0000","last_change":"2023-09-30T16:49:09.600440+0000","last_active":"2023-09-30T16:49:11.601934+0000","last_peered":"2023-09-30T16:49:11.601934+0000","last_clean":"2023-09-30T16:49:11.601934+0000","last_became_active":"2023-09-30T16:49:09.599554+0000","last_became_peered":"2023-09-30T16:49:09.599554+0000","last_unstale":"2023-09-30T16:49:11.601934+0000","last_undegraded":"2023-09-30T16:49:11.601934+0000","last_fullsized":"2023-09-30T16:49:11.601934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979354+0000","last_change":"2023-09-30T16:49:10.620991+0000","last_active":"2023-09-30T16:49:11.979354+0000","last_peered":"2023-09-30T16:49:11.979354+0000","last_clean":"2023-09-30T16:49:11.979354+0000","last_became_active":"2023-09-30T16:49:10.620738+0000","last_became_peered":"2023-09-30T16:49:10.620738+0000","last_unstale":"2023-09-30T16:49:11.979354+0000","last_undegraded":"2023-09-30T16:49:11.979354+0000","last_fullsized":"2023-09-30T16:49:11.979354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:31.181804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.980054+0000","last_change":"2023-09-30T16:49:09.594466+0000","last_active":"2023-09-30T16:49:11.980054+0000","last_peered":"2023-09-30T16:49:11.980054+0000","last_clean":"2023-09-30T16:49:11.980054+0000","last_became_active":"2023-09-30T16:49:09.593975+0000","last_became_peered":"2023-09-30T16:49:09.593975+0000","last_unstale":"2023-09-30T16:49:11.980054+0000","last_undegraded":"2023-09-30T16:49:11.980054+0000","last_fullsized":"2023-09-30T16:49:11.980054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:24.904253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601532+0000","last_change":"2023-09-30T16:49:10.617041+0000","last_active":"2023-09-30T16:49:11.601532+0000","last_peered":"2023-09-30T16:49:11.601532+0000","last_clean":"2023-09-30T16:49:11.601532+0000","last_became_active":"2023-09-30T16:49:10.616673+0000","last_became_peered":"2023-09-30T16:49:10.616673+0000","last_unstale":"2023-09-30T16:49:11.601532+0000","last_undegraded":"2023-09-30T16:49:11.601532+0000","last_fullsized":"2023-09-30T16:49:11.601532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979257+0000","last_change":"2023-09-30T16:49:09.619350+0000","last_active":"2023-09-30T16:49:11.979257+0000","last_peered":"2023-09-30T16:49:11.979257+0000","last_clean":"2023-09-30T16:49:11.979257+0000","last_became_active":"2023-09-30T16:49:09.619032+0000","last_became_peered":"2023-09-30T16:49:09.619032+0000","last_unstale":"2023-09-30T16:49:11.979257+0000","last_undegraded":"2023-09-30T16:49:11.979257+0000","last_fullsized":"2023-09-30T16:49:11.979257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.600797+0000","last_change":"2023-09-30T16:49:10.618387+0000","last_active":"2023-09-30T16:49:11.600797+0000","last_peered":"2023-09-30T16:49:11.600797+0000","last_clean":"2023-09-30T16:49:11.600797+0000","last_became_active":"2023-09-30T16:49:10.618048+0000","last_became_peered":"2023-09-30T16:49:10.618048+0000","last_unstale":"2023-09-30T16:49:11.600797+0000","last_undegraded":"2023-09-30T16:49:11.600797+0000","last_fullsized":"2023-09-30T16:49:11.600797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:31.999294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977896+0000","last_change":"2023-09-30T16:49:09.620418+0000","last_active":"2023-09-30T16:49:11.977896+0000","last_peered":"2023-09-30T16:49:11.977896+0000","last_clean":"2023-09-30T16:49:11.977896+0000","last_became_active":"2023-09-30T16:49:09.619799+0000","last_became_peered":"2023-09-30T16:49:09.619799+0000","last_unstale":"2023-09-30T16:49:11.977896+0000","last_undegraded":"2023-09-30T16:49:11.977896+0000","last_fullsized":"2023-09-30T16:49:11.977896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:38.582461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977037+0000","last_change":"2023-09-30T16:49:10.629792+0000","last_active":"2023-09-30T16:49:11.977037+0000","last_peered":"2023-09-30T16:49:11.977037+0000","last_clean":"2023-09-30T16:49:11.977037+0000","last_became_active":"2023-09-30T16:49:10.629460+0000","last_became_peered":"2023-09-30T16:49:10.629460+0000","last_unstale":"2023-09-30T16:49:11.977037+0000","last_undegraded":"2023-09-30T16:49:11.977037+0000","last_fullsized":"2023-09-30T16:49:11.977037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:20:56.822877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977632+0000","last_change":"2023-09-30T16:49:09.603654+0000","last_active":"2023-09-30T16:49:11.977632+0000","last_peered":"2023-09-30T16:49:11.977632+0000","last_clean":"2023-09-30T16:49:11.977632+0000","last_became_active":"2023-09-30T16:49:09.603267+0000","last_became_peered":"2023-09-30T16:49:09.603267+0000","last_unstale":"2023-09-30T16:49:11.977632+0000","last_undegraded":"2023-09-30T16:49:11.977632+0000","last_fullsized":"2023-09-30T16:49:11.977632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:26.219476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977808+0000","last_change":"2023-09-30T16:49:10.636453+0000","last_active":"2023-09-30T16:49:11.977808+0000","last_peered":"2023-09-30T16:49:11.977808+0000","last_clean":"2023-09-30T16:49:11.977808+0000","last_became_active":"2023-09-30T16:49:10.635319+0000","last_became_peered":"2023-09-30T16:49:10.635319+0000","last_unstale":"2023-09-30T16:49:11.977808+0000","last_undegraded":"2023-09-30T16:49:11.977808+0000","last_fullsized":"2023-09-30T16:49:11.977808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976636+0000","last_change":"2023-09-30T16:49:09.618129+0000","last_active":"2023-09-30T16:49:11.976636+0000","last_peered":"2023-09-30T16:49:11.976636+0000","last_clean":"2023-09-30T16:49:11.976636+0000","last_became_active":"2023-09-30T16:49:09.616087+0000","last_became_peered":"2023-09-30T16:49:09.616087+0000","last_unstale":"2023-09-30T16:49:11.976636+0000","last_undegraded":"2023-09-30T16:49:11.976636+0000","last_fullsized":"2023-09-30T16:49:11.976636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597311+0000","last_change":"2023-09-30T16:49:10.618572+0000","last_active":"2023-09-30T16:49:11.597311+0000","last_peered":"2023-09-30T16:49:11.597311+0000","last_clean":"2023-09-30T16:49:11.597311+0000","last_became_active":"2023-09-30T16:49:10.618246+0000","last_became_peered":"2023-09-30T16:49:10.618246+0000","last_unstale":"2023-09-30T16:49:11.597311+0000","last_undegraded":"2023-09-30T16:49:11.597311+0000","last_fullsized":"2023-09-30T16:49:11.597311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979624+0000","last_change":"2023-09-30T16:49:09.611197+0000","last_active":"2023-09-30T16:49:11.979624+0000","last_peered":"2023-09-30T16:49:11.979624+0000","last_clean":"2023-09-30T16:49:11.979624+0000","last_became_active":"2023-09-30T16:49:09.610929+0000","last_became_peered":"2023-09-30T16:49:09.610929+0000","last_unstale":"2023-09-30T16:49:11.979624+0000","last_undegraded":"2023-09-30T16:49:11.979624+0000","last_fullsized":"2023-09-30T16:49:11.979624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:49.375737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601989+0000","last_change":"2023-09-30T16:49:10.632399+0000","last_active":"2023-09-30T16:49:11.601989+0000","last_peered":"2023-09-30T16:49:11.601989+0000","last_clean":"2023-09-30T16:49:11.601989+0000","last_became_active":"2023-09-30T16:49:10.632044+0000","last_became_peered":"2023-09-30T16:49:10.632044+0000","last_unstale":"2023-09-30T16:49:11.601989+0000","last_undegraded":"2023-09-30T16:49:11.601989+0000","last_fullsized":"2023-09-30T16:49:11.601989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602392+0000","last_change":"2023-09-30T16:49:09.598092+0000","last_active":"2023-09-30T16:49:11.602392+0000","last_peered":"2023-09-30T16:49:11.602392+0000","last_clean":"2023-09-30T16:49:11.602392+0000","last_became_active":"2023-09-30T16:49:09.597294+0000","last_became_peered":"2023-09-30T16:49:09.597294+0000","last_unstale":"2023-09-30T16:49:11.602392+0000","last_undegraded":"2023-09-30T16:49:11.602392+0000","last_fullsized":"2023-09-30T16:49:11.602392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602370+0000","last_change":"2023-09-30T16:49:10.628648+0000","last_active":"2023-09-30T16:49:11.602370+0000","last_peered":"2023-09-30T16:49:11.602370+0000","last_clean":"2023-09-30T16:49:11.602370+0000","last_became_active":"2023-09-30T16:49:10.619172+0000","last_became_peered":"2023-09-30T16:49:10.619172+0000","last_unstale":"2023-09-30T16:49:11.602370+0000","last_undegraded":"2023-09-30T16:49:11.602370+0000","last_fullsized":"2023-09-30T16:49:11.602370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978385+0000","last_change":"2023-09-30T16:49:09.591867+0000","last_active":"2023-09-30T16:49:11.978385+0000","last_peered":"2023-09-30T16:49:11.978385+0000","last_clean":"2023-09-30T16:49:11.978385+0000","last_became_active":"2023-09-30T16:49:09.591062+0000","last_became_peered":"2023-09-30T16:49:09.591062+0000","last_unstale":"2023-09-30T16:49:11.978385+0000","last_undegraded":"2023-09-30T16:49:11.978385+0000","last_fullsized":"2023-09-30T16:49:11.978385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:35.797259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602280+0000","last_change":"2023-09-30T16:49:10.621227+0000","last_active":"2023-09-30T16:49:11.602280+0000","last_peered":"2023-09-30T16:49:11.602280+0000","last_clean":"2023-09-30T16:49:11.602280+0000","last_became_active":"2023-09-30T16:49:10.620861+0000","last_became_peered":"2023-09-30T16:49:10.620861+0000","last_unstale":"2023-09-30T16:49:11.602280+0000","last_undegraded":"2023-09-30T16:49:11.602280+0000","last_fullsized":"2023-09-30T16:49:11.602280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975957+0000","last_change":"2023-09-30T16:49:09.593530+0000","last_active":"2023-09-30T16:49:11.975957+0000","last_peered":"2023-09-30T16:49:11.975957+0000","last_clean":"2023-09-30T16:49:11.975957+0000","last_became_active":"2023-09-30T16:49:09.593238+0000","last_became_peered":"2023-09-30T16:49:09.593238+0000","last_unstale":"2023-09-30T16:49:11.975957+0000","last_undegraded":"2023-09-30T16:49:11.975957+0000","last_fullsized":"2023-09-30T16:49:11.975957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:13.124869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978879+0000","last_change":"2023-09-30T16:49:10.629665+0000","last_active":"2023-09-30T16:49:11.978879+0000","last_peered":"2023-09-30T16:49:11.978879+0000","last_clean":"2023-09-30T16:49:11.978879+0000","last_became_active":"2023-09-30T16:49:10.629348+0000","last_became_peered":"2023-09-30T16:49:10.629348+0000","last_unstale":"2023-09-30T16:49:11.978879+0000","last_undegraded":"2023-09-30T16:49:11.978879+0000","last_fullsized":"2023-09-30T16:49:11.978879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:20:08.861216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602018+0000","last_change":"2023-09-30T16:49:09.595063+0000","last_active":"2023-09-30T16:49:11.602018+0000","last_peered":"2023-09-30T16:49:11.602018+0000","last_clean":"2023-09-30T16:49:11.602018+0000","last_became_active":"2023-09-30T16:49:09.592082+0000","last_became_peered":"2023-09-30T16:49:09.592082+0000","last_unstale":"2023-09-30T16:49:11.602018+0000","last_undegraded":"2023-09-30T16:49:11.602018+0000","last_fullsized":"2023-09-30T16:49:11.602018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:48.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602131+0000","last_change":"2023-09-30T16:49:10.626413+0000","last_active":"2023-09-30T16:49:11.602131+0000","last_peered":"2023-09-30T16:49:11.602131+0000","last_clean":"2023-09-30T16:49:11.602131+0000","last_became_active":"2023-09-30T16:49:10.626088+0000","last_became_peered":"2023-09-30T16:49:10.626088+0000","last_unstale":"2023-09-30T16:49:11.602131+0000","last_undegraded":"2023-09-30T16:49:11.602131+0000","last_fullsized":"2023-09-30T16:49:11.602131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601518+0000","last_change":"2023-09-30T16:49:09.617357+0000","last_active":"2023-09-30T16:49:11.601518+0000","last_peered":"2023-09-30T16:49:11.601518+0000","last_clean":"2023-09-30T16:49:11.601518+0000","last_became_active":"2023-09-30T16:49:09.616658+0000","last_became_peered":"2023-09-30T16:49:09.616658+0000","last_unstale":"2023-09-30T16:49:11.601518+0000","last_undegraded":"2023-09-30T16:49:11.601518+0000","last_fullsized":"2023-09-30T16:49:11.601518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:00.055876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977595+0000","last_change":"2023-09-30T16:49:10.620209+0000","last_active":"2023-09-30T16:49:11.977595+0000","last_peered":"2023-09-30T16:49:11.977595+0000","last_clean":"2023-09-30T16:49:11.977595+0000","last_became_active":"2023-09-30T16:49:10.619843+0000","last_became_peered":"2023-09-30T16:49:10.619843+0000","last_unstale":"2023-09-30T16:49:11.977595+0000","last_undegraded":"2023-09-30T16:49:11.977595+0000","last_fullsized":"2023-09-30T16:49:11.977595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979943+0000","last_change":"2023-09-30T16:49:09.594732+0000","last_active":"2023-09-30T16:49:11.979943+0000","last_peered":"2023-09-30T16:49:11.979943+0000","last_clean":"2023-09-30T16:49:11.979943+0000","last_became_active":"2023-09-30T16:49:09.594408+0000","last_became_peered":"2023-09-30T16:49:09.594408+0000","last_unstale":"2023-09-30T16:49:11.979943+0000","last_undegraded":"2023-09-30T16:49:11.979943+0000","last_fullsized":"2023-09-30T16:49:11.979943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:13.049354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977210+0000","last_change":"2023-09-30T16:49:10.624221+0000","last_active":"2023-09-30T16:49:11.977210+0000","last_peered":"2023-09-30T16:49:11.977210+0000","last_clean":"2023-09-30T16:49:11.977210+0000","last_became_active":"2023-09-30T16:49:10.623805+0000","last_became_peered":"2023-09-30T16:49:10.623805+0000","last_unstale":"2023-09-30T16:49:11.977210+0000","last_undegraded":"2023-09-30T16:49:11.977210+0000","last_fullsized":"2023-09-30T16:49:11.977210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979180+0000","last_change":"2023-09-30T16:49:10.635402+0000","last_active":"2023-09-30T16:49:11.979180+0000","last_peered":"2023-09-30T16:49:11.979180+0000","last_clean":"2023-09-30T16:49:11.979180+0000","last_became_active":"2023-09-30T16:49:10.634645+0000","last_became_peered":"2023-09-30T16:49:10.634645+0000","last_unstale":"2023-09-30T16:49:11.979180+0000","last_undegraded":"2023-09-30T16:49:11.979180+0000","last_fullsized":"2023-09-30T16:49:11.979180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:06.779362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977933+0000","last_change":"2023-09-30T16:49:09.591559+0000","last_active":"2023-09-30T16:49:11.977933+0000","last_peered":"2023-09-30T16:49:11.977933+0000","last_clean":"2023-09-30T16:49:11.977933+0000","last_became_active":"2023-09-30T16:49:09.591265+0000","last_became_peered":"2023-09-30T16:49:09.591265+0000","last_unstale":"2023-09-30T16:49:11.977933+0000","last_undegraded":"2023-09-30T16:49:11.977933+0000","last_fullsized":"2023-09-30T16:49:11.977933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978073+0000","last_change":"2023-09-30T16:49:09.591796+0000","last_active":"2023-09-30T16:49:11.978073+0000","last_peered":"2023-09-30T16:49:11.978073+0000","last_clean":"2023-09-30T16:49:11.978073+0000","last_became_active":"2023-09-30T16:49:09.591474+0000","last_became_peered":"2023-09-30T16:49:09.591474+0000","last_unstale":"2023-09-30T16:49:11.978073+0000","last_undegraded":"2023-09-30T16:49:11.978073+0000","last_fullsized":"2023-09-30T16:49:11.978073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:45.706321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977248+0000","last_change":"2023-09-30T16:49:10.628239+0000","last_active":"2023-09-30T16:49:11.977248+0000","last_peered":"2023-09-30T16:49:11.977248+0000","last_clean":"2023-09-30T16:49:11.977248+0000","last_became_active":"2023-09-30T16:49:10.627915+0000","last_became_peered":"2023-09-30T16:49:10.627915+0000","last_unstale":"2023-09-30T16:49:11.977248+0000","last_undegraded":"2023-09-30T16:49:11.977248+0000","last_fullsized":"2023-09-30T16:49:11.977248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:40:55.750019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:09.612990+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:09.606939+0000","last_became_peered":"2023-09-30T16:49:09.606939+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:00.151397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977818+0000","last_change":"2023-09-30T16:49:10.631974+0000","last_active":"2023-09-30T16:49:11.977818+0000","last_peered":"2023-09-30T16:49:11.977818+0000","last_clean":"2023-09-30T16:49:11.977818+0000","last_became_active":"2023-09-30T16:49:10.631388+0000","last_became_peered":"2023-09-30T16:49:10.631388+0000","last_unstale":"2023-09-30T16:49:11.977818+0000","last_undegraded":"2023-09-30T16:49:11.977818+0000","last_fullsized":"2023-09-30T16:49:11.977818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:01:27.558052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602467+0000","last_change":"2023-09-30T16:49:09.606230+0000","last_active":"2023-09-30T16:49:11.602467+0000","last_peered":"2023-09-30T16:49:11.602467+0000","last_clean":"2023-09-30T16:49:11.602467+0000","last_became_active":"2023-09-30T16:49:09.605614+0000","last_became_peered":"2023-09-30T16:49:09.605614+0000","last_unstale":"2023-09-30T16:49:11.602467+0000","last_undegraded":"2023-09-30T16:49:11.602467+0000","last_fullsized":"2023-09-30T16:49:11.602467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:30.989740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":74251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":74833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":658389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:16.548 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T16:49:16.543+0000 7fcad8c6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T16:49:17.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:49:17.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:49:19.128 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:19.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.259+0000 7fe16f000640 1 Processor -- start 2023-09-30T16:49:19.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.259+0000 7fe16f000640 1 -- start start 2023-09-30T16:49:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16f000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 0x7fe168070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16f000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1680ce770 con 0x7fe1680b63e0 2023-09-30T16:49:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16f000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1680cea10 con 0x7fe1680b2310 2023-09-30T16:49:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16f000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680b3ef0 con 0x7fe16815a9e0 2023-09-30T16:49:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe167fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe1680b63e0 0x7fe1680b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39936/0 (socket says 172.21.15.52:39936) 2023-09-30T16:49:19.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe167fff640 1 -- 172.21.15.52:0/2639934888 learned_addr learned my addr 172.21.15.52:0/2639934888 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 0x7fe168070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624126637 0 0) 0x7fe1680ce770 con 0x7fe1680b63e0 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe154003530 con 0x7fe1680b63e0 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1495434583 0 0) 0x7fe154003530 con 0x7fe1680b63e0 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 msgr2=0x7fe168070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 0x7fe168070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 >> v1:172.21.15.186:6789/0 conn(0x7fe1680b2310 legacy=0x7fe1680cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680cecf0 con 0x7fe1680b63e0 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fe150001680 con 0x7fe1680b63e0 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 >> v1:172.21.15.52:6789/0 conn(0x7fe1680b63e0 legacy=0x7fe1680b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe154003a20 0x7fe154003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 0x7fe1540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154004d10 0x7fe154005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680b3ef0 con 0x7fe154003a20 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15400bb20 con 0x7fe154004d10 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15400bce0 con 0x7fe16815a9e0 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe154003a20 0x7fe154003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe167fff640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 0x7fe1540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16d59d640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154004d10 0x7fe154005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 -- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 msgr2=0x7fe1540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:19.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe16815a9e0 0x7fe1540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 -- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154004d10 msgr2=0x7fe154005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:19.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154004d10 0x7fe154005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.263+0000 7fe16cd9c640 1 -- 172.21.15.52:0/2639934888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe154003530 con 0x7fe154003a20 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe154003a20 0x7fe154003e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe158009ae0 tx=0x7fe15801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823c551904feb55c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580a6510 con 0x7fe154003a20 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1580a6670 con 0x7fe154003a20 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe1677fe640 1 -- 172.21.15.52:0/2639934888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580a6a20 con 0x7fe154003a20 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- 172.21.15.52:0/2639934888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe154003a20 msgr2=0x7fe154003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 --2- 172.21.15.52:0/2639934888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe154003a20 0x7fe154003e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe158009ae0 tx=0x7fe15801ca20 comp rx=0 tx=0).stop 2023-09-30T16:49:19.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16d59d640 1 -- 172.21.15.52:0/2639934888 reap_dead start 2023-09-30T16:49:19.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- 172.21.15.52:0/2639934888 shutdown_connections 2023-09-30T16:49:19.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- 172.21.15.52:0/2639934888 >> 172.21.15.52:0/2639934888 conn(0x7fe1680cd310 msgr2=0x7fe1680cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:19.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- 172.21.15.52:0/2639934888 shutdown_connections 2023-09-30T16:49:19.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- 172.21.15.52:0/2639934888 wait complete. 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 Processor -- start 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- start start 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154003a20 0x7fe1680c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 0x7fe1680ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1680ca640 0x7fe168157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680c6980 con 0x7fe168153140 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe168154250 con 0x7fe154003a20 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16f000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe168153640 con 0x7fe1680ca640 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 0x7fe1680ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 0x7fe1680ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53870/0 (socket says 172.21.15.52:53870) 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 -- 172.21.15.52:0/760924307 learned_addr learned my addr 172.21.15.52:0/760924307 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16d59d640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1680ca640 0x7fe168157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154003a20 0x7fe1680c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 -- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1680ca640 msgr2=0x7fe168157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1680ca640 0x7fe168157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 -- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154003a20 msgr2=0x7fe1680c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154003a20 0x7fe1680c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.267+0000 7fe167fff640 1 -- 172.21.15.52:0/760924307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168153920 con 0x7fe168153140 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe167fff640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 0x7fe1680ca100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1500017b0 tx=0x7fe15000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000ee60 con 0x7fe168153140 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000c870 con 0x7fe168153140 2023-09-30T16:49:19.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe168153c00 con 0x7fe168153140 2023-09-30T16:49:19.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000cc20 con 0x7fe168153140 2023-09-30T16:49:19.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1681580b0 con 0x7fe168153140 2023-09-30T16:49:19.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe168066750 con 0x7fe168153140 2023-09-30T16:49:19.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe150013420 con 0x7fe168153140 2023-09-30T16:49:19.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe1657fa640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe148066190 0x7fe148068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe150083510 con 0x7fe168153140 2023-09-30T16:49:19.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe148066190 0x7fe148068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.271+0000 7fe16cd9c640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe148066190 0x7fe148068650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1580af000 tx=0x7fe1580046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:19.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.275+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe150050bc0 con 0x7fe168153140 2023-09-30T16:49:19.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.427+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe168070c60 con 0x7fe148066190 2023-09-30T16:49:19.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe1657fa640 1 -- 172.21.15.52:0/760924307 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264646 (secure 0 0 0) 0x7fe15800f080 con 0x7fe148066190 2023-09-30T16:49:19.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:19.456 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe148066190 msgr2=0x7fe148068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe148066190 0x7fe148068650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1580af000 tx=0x7fe1580046d0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 msgr2=0x7fe1680ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 0x7fe1680ca100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1500017b0 tx=0x7fe15000ec10 comp rx=0 tx=0).stop 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 shutdown_connections 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe148066190 0x7fe148068650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1680ca640 0x7fe168157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe168153140 0x7fe1680ca100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 --2- 172.21.15.52:0/760924307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe154003a20 0x7fe1680c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 >> 172.21.15.52:0/760924307 conn(0x7fe1680cd310 msgr2=0x7fe1680b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:19.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 shutdown_connections 2023-09-30T16:49:19.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.451+0000 7fe16f000640 1 -- 172.21.15.52:0/760924307 wait complete. 2023-09-30T16:49:19.474 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-30T16:49:17.458708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235692,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739028,"statfs":{"total":773094113280,"available":772852764672,"internally_reserved":0,"allocated":2945024,"data_stored":1773264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.889173"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978658+0000","last_change":"2023-09-30T16:49:10.633322+0000","last_active":"2023-09-30T16:49:11.978658+0000","last_peered":"2023-09-30T16:49:11.978658+0000","last_clean":"2023-09-30T16:49:11.978658+0000","last_became_active":"2023-09-30T16:49:10.631135+0000","last_became_peered":"2023-09-30T16:49:10.631135+0000","last_unstale":"2023-09-30T16:49:11.978658+0000","last_undegraded":"2023-09-30T16:49:11.978658+0000","last_fullsized":"2023-09-30T16:49:11.978658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976757+0000","last_change":"2023-09-30T16:49:10.632204+0000","last_active":"2023-09-30T16:49:11.976757+0000","last_peered":"2023-09-30T16:49:11.976757+0000","last_clean":"2023-09-30T16:49:11.976757+0000","last_became_active":"2023-09-30T16:49:10.631691+0000","last_became_peered":"2023-09-30T16:49:10.631691+0000","last_unstale":"2023-09-30T16:49:11.976757+0000","last_undegraded":"2023-09-30T16:49:11.976757+0000","last_fullsized":"2023-09-30T16:49:11.976757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:56:24.913821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976467+0000","last_change":"2023-09-30T16:49:10.629832+0000","last_active":"2023-09-30T16:49:11.976467+0000","last_peered":"2023-09-30T16:49:11.976467+0000","last_clean":"2023-09-30T16:49:11.976467+0000","last_became_active":"2023-09-30T16:49:10.629449+0000","last_became_peered":"2023-09-30T16:49:10.629449+0000","last_unstale":"2023-09-30T16:49:11.976467+0000","last_undegraded":"2023-09-30T16:49:11.976467+0000","last_fullsized":"2023-09-30T16:49:11.976467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.604692+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.603126+0000","last_became_peered":"2023-09-30T16:49:10.603126+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:34.821952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:10.633644+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:10.630535+0000","last_became_peered":"2023-09-30T16:49:10.630535+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:25.913808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597358+0000","last_change":"2023-09-30T16:49:10.604995+0000","last_active":"2023-09-30T16:49:11.597358+0000","last_peered":"2023-09-30T16:49:11.597358+0000","last_clean":"2023-09-30T16:49:11.597358+0000","last_became_active":"2023-09-30T16:49:10.603075+0000","last_became_peered":"2023-09-30T16:49:10.603075+0000","last_unstale":"2023-09-30T16:49:11.597358+0000","last_undegraded":"2023-09-30T16:49:11.597358+0000","last_fullsized":"2023-09-30T16:49:11.597358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976179+0000","last_change":"2023-09-30T16:49:10.630597+0000","last_active":"2023-09-30T16:49:11.976179+0000","last_peered":"2023-09-30T16:49:11.976179+0000","last_clean":"2023-09-30T16:49:11.976179+0000","last_became_active":"2023-09-30T16:49:10.626842+0000","last_became_peered":"2023-09-30T16:49:10.626842+0000","last_unstale":"2023-09-30T16:49:11.976179+0000","last_undegraded":"2023-09-30T16:49:11.976179+0000","last_fullsized":"2023-09-30T16:49:11.976179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:25:42.884890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977750+0000","last_change":"2023-09-30T16:49:10.633003+0000","last_active":"2023-09-30T16:49:11.977750+0000","last_peered":"2023-09-30T16:49:11.977750+0000","last_clean":"2023-09-30T16:49:11.977750+0000","last_became_active":"2023-09-30T16:49:10.632147+0000","last_became_peered":"2023-09-30T16:49:10.632147+0000","last_unstale":"2023-09-30T16:49:11.977750+0000","last_undegraded":"2023-09-30T16:49:11.977750+0000","last_fullsized":"2023-09-30T16:49:11.977750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:51:01.956500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978014+0000","last_change":"2023-09-30T16:49:10.633201+0000","last_active":"2023-09-30T16:49:11.978014+0000","last_peered":"2023-09-30T16:49:11.978014+0000","last_clean":"2023-09-30T16:49:11.978014+0000","last_became_active":"2023-09-30T16:49:10.631149+0000","last_became_peered":"2023-09-30T16:49:10.631149+0000","last_unstale":"2023-09-30T16:49:11.978014+0000","last_undegraded":"2023-09-30T16:49:11.978014+0000","last_fullsized":"2023-09-30T16:49:11.978014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977411+0000","last_change":"2023-09-30T16:49:10.633919+0000","last_active":"2023-09-30T16:49:11.977411+0000","last_peered":"2023-09-30T16:49:11.977411+0000","last_clean":"2023-09-30T16:49:11.977411+0000","last_became_active":"2023-09-30T16:49:10.633415+0000","last_became_peered":"2023-09-30T16:49:10.633415+0000","last_unstale":"2023-09-30T16:49:11.977411+0000","last_undegraded":"2023-09-30T16:49:11.977411+0000","last_fullsized":"2023-09-30T16:49:11.977411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:06.308183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976984+0000","last_change":"2023-09-30T16:49:10.638963+0000","last_active":"2023-09-30T16:49:11.976984+0000","last_peered":"2023-09-30T16:49:11.976984+0000","last_clean":"2023-09-30T16:49:11.976984+0000","last_became_active":"2023-09-30T16:49:10.638232+0000","last_became_peered":"2023-09-30T16:49:10.638232+0000","last_unstale":"2023-09-30T16:49:11.976984+0000","last_undegraded":"2023-09-30T16:49:11.976984+0000","last_fullsized":"2023-09-30T16:49:11.976984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:14.058908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601136+0000","last_change":"2023-09-30T16:49:10.635159+0000","last_active":"2023-09-30T16:49:11.601136+0000","last_peered":"2023-09-30T16:49:11.601136+0000","last_clean":"2023-09-30T16:49:11.601136+0000","last_became_active":"2023-09-30T16:49:10.634816+0000","last_became_peered":"2023-09-30T16:49:10.634816+0000","last_unstale":"2023-09-30T16:49:11.601136+0000","last_undegraded":"2023-09-30T16:49:11.601136+0000","last_fullsized":"2023-09-30T16:49:11.601136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:56.576610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601222+0000","last_change":"2023-09-30T16:49:10.623197+0000","last_active":"2023-09-30T16:49:11.601222+0000","last_peered":"2023-09-30T16:49:11.601222+0000","last_clean":"2023-09-30T16:49:11.601222+0000","last_became_active":"2023-09-30T16:49:10.622869+0000","last_became_peered":"2023-09-30T16:49:10.622869+0000","last_unstale":"2023-09-30T16:49:11.601222+0000","last_undegraded":"2023-09-30T16:49:11.601222+0000","last_fullsized":"2023-09-30T16:49:11.601222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:50.982816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976170+0000","last_change":"2023-09-30T16:49:10.636242+0000","last_active":"2023-09-30T16:49:11.976170+0000","last_peered":"2023-09-30T16:49:11.976170+0000","last_clean":"2023-09-30T16:49:11.976170+0000","last_became_active":"2023-09-30T16:49:10.635932+0000","last_became_peered":"2023-09-30T16:49:10.635932+0000","last_unstale":"2023-09-30T16:49:11.976170+0000","last_undegraded":"2023-09-30T16:49:11.976170+0000","last_fullsized":"2023-09-30T16:49:11.976170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977806+0000","last_change":"2023-09-30T16:49:10.617833+0000","last_active":"2023-09-30T16:49:11.977806+0000","last_peered":"2023-09-30T16:49:11.977806+0000","last_clean":"2023-09-30T16:49:11.977806+0000","last_became_active":"2023-09-30T16:49:10.617311+0000","last_became_peered":"2023-09-30T16:49:10.617311+0000","last_unstale":"2023-09-30T16:49:11.977806+0000","last_undegraded":"2023-09-30T16:49:11.977806+0000","last_fullsized":"2023-09-30T16:49:11.977806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978520+0000","last_change":"2023-09-30T16:49:10.635091+0000","last_active":"2023-09-30T16:49:11.978520+0000","last_peered":"2023-09-30T16:49:11.978520+0000","last_clean":"2023-09-30T16:49:11.978520+0000","last_became_active":"2023-09-30T16:49:10.633981+0000","last_became_peered":"2023-09-30T16:49:10.633981+0000","last_unstale":"2023-09-30T16:49:11.978520+0000","last_undegraded":"2023-09-30T16:49:11.978520+0000","last_fullsized":"2023-09-30T16:49:11.978520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:09:36.748081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977435+0000","last_change":"2023-09-30T16:49:10.628753+0000","last_active":"2023-09-30T16:49:11.977435+0000","last_peered":"2023-09-30T16:49:11.977435+0000","last_clean":"2023-09-30T16:49:11.977435+0000","last_became_active":"2023-09-30T16:49:10.628478+0000","last_became_peered":"2023-09-30T16:49:10.628478+0000","last_unstale":"2023-09-30T16:49:11.977435+0000","last_undegraded":"2023-09-30T16:49:11.977435+0000","last_fullsized":"2023-09-30T16:49:11.977435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979513+0000","last_change":"2023-09-30T16:49:10.629633+0000","last_active":"2023-09-30T16:49:11.979513+0000","last_peered":"2023-09-30T16:49:11.979513+0000","last_clean":"2023-09-30T16:49:11.979513+0000","last_became_active":"2023-09-30T16:49:10.629202+0000","last_became_peered":"2023-09-30T16:49:10.629202+0000","last_unstale":"2023-09-30T16:49:11.979513+0000","last_undegraded":"2023-09-30T16:49:11.979513+0000","last_fullsized":"2023-09-30T16:49:11.979513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:21:16.999794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977323+0000","last_change":"2023-09-30T16:49:10.638755+0000","last_active":"2023-09-30T16:49:11.977323+0000","last_peered":"2023-09-30T16:49:11.977323+0000","last_clean":"2023-09-30T16:49:11.977323+0000","last_became_active":"2023-09-30T16:49:10.637877+0000","last_became_peered":"2023-09-30T16:49:10.637877+0000","last_unstale":"2023-09-30T16:49:11.977323+0000","last_undegraded":"2023-09-30T16:49:11.977323+0000","last_fullsized":"2023-09-30T16:49:11.977323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:14.992346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601810+0000","last_change":"2023-09-30T16:49:10.604164+0000","last_active":"2023-09-30T16:49:11.601810+0000","last_peered":"2023-09-30T16:49:11.601810+0000","last_clean":"2023-09-30T16:49:11.601810+0000","last_became_active":"2023-09-30T16:49:10.603748+0000","last_became_peered":"2023-09-30T16:49:10.603748+0000","last_unstale":"2023-09-30T16:49:11.601810+0000","last_undegraded":"2023-09-30T16:49:11.601810+0000","last_fullsized":"2023-09-30T16:49:11.601810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976548+0000","last_change":"2023-09-30T16:49:10.622204+0000","last_active":"2023-09-30T16:49:11.976548+0000","last_peered":"2023-09-30T16:49:11.976548+0000","last_clean":"2023-09-30T16:49:11.976548+0000","last_became_active":"2023-09-30T16:49:10.621777+0000","last_became_peered":"2023-09-30T16:49:10.621777+0000","last_unstale":"2023-09-30T16:49:11.976548+0000","last_undegraded":"2023-09-30T16:49:11.976548+0000","last_fullsized":"2023-09-30T16:49:11.976548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978154+0000","last_change":"2023-09-30T16:49:10.630731+0000","last_active":"2023-09-30T16:49:11.978154+0000","last_peered":"2023-09-30T16:49:11.978154+0000","last_clean":"2023-09-30T16:49:11.978154+0000","last_became_active":"2023-09-30T16:49:10.630397+0000","last_became_peered":"2023-09-30T16:49:10.630397+0000","last_unstale":"2023-09-30T16:49:11.978154+0000","last_undegraded":"2023-09-30T16:49:11.978154+0000","last_fullsized":"2023-09-30T16:49:11.978154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:56:20.514299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976860+0000","last_change":"2023-09-30T16:49:10.632997+0000","last_active":"2023-09-30T16:49:11.976860+0000","last_peered":"2023-09-30T16:49:11.976860+0000","last_clean":"2023-09-30T16:49:11.976860+0000","last_became_active":"2023-09-30T16:49:10.631924+0000","last_became_peered":"2023-09-30T16:49:10.631924+0000","last_unstale":"2023-09-30T16:49:11.976860+0000","last_undegraded":"2023-09-30T16:49:11.976860+0000","last_fullsized":"2023-09-30T16:49:11.976860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:24.961600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597835+0000","last_change":"2023-09-30T16:49:10.619518+0000","last_active":"2023-09-30T16:49:11.597835+0000","last_peered":"2023-09-30T16:49:11.597835+0000","last_clean":"2023-09-30T16:49:11.597835+0000","last_became_active":"2023-09-30T16:49:10.619041+0000","last_became_peered":"2023-09-30T16:49:10.619041+0000","last_unstale":"2023-09-30T16:49:11.597835+0000","last_undegraded":"2023-09-30T16:49:11.597835+0000","last_fullsized":"2023-09-30T16:49:11.597835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:34:06.083677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601356+0000","last_change":"2023-09-30T16:49:10.623431+0000","last_active":"2023-09-30T16:49:11.601356+0000","last_peered":"2023-09-30T16:49:11.601356+0000","last_clean":"2023-09-30T16:49:11.601356+0000","last_became_active":"2023-09-30T16:49:10.623009+0000","last_became_peered":"2023-09-30T16:49:10.623009+0000","last_unstale":"2023-09-30T16:49:11.601356+0000","last_undegraded":"2023-09-30T16:49:11.601356+0000","last_fullsized":"2023-09-30T16:49:11.601356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601808+0000","last_change":"2023-09-30T16:49:10.639015+0000","last_active":"2023-09-30T16:49:11.601808+0000","last_peered":"2023-09-30T16:49:11.601808+0000","last_clean":"2023-09-30T16:49:11.601808+0000","last_became_active":"2023-09-30T16:49:10.638680+0000","last_became_peered":"2023-09-30T16:49:10.638680+0000","last_unstale":"2023-09-30T16:49:11.601808+0000","last_undegraded":"2023-09-30T16:49:11.601808+0000","last_fullsized":"2023-09-30T16:49:11.601808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976602+0000","last_change":"2023-09-30T16:49:10.623827+0000","last_active":"2023-09-30T16:49:11.976602+0000","last_peered":"2023-09-30T16:49:11.976602+0000","last_clean":"2023-09-30T16:49:11.976602+0000","last_became_active":"2023-09-30T16:49:10.623133+0000","last_became_peered":"2023-09-30T16:49:10.623133+0000","last_unstale":"2023-09-30T16:49:11.976602+0000","last_undegraded":"2023-09-30T16:49:11.976602+0000","last_fullsized":"2023-09-30T16:49:11.976602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976867+0000","last_change":"2023-09-30T16:49:10.632416+0000","last_active":"2023-09-30T16:49:11.976867+0000","last_peered":"2023-09-30T16:49:11.976867+0000","last_clean":"2023-09-30T16:49:11.976867+0000","last_became_active":"2023-09-30T16:49:10.631982+0000","last_became_peered":"2023-09-30T16:49:10.631982+0000","last_unstale":"2023-09-30T16:49:11.976867+0000","last_undegraded":"2023-09-30T16:49:11.976867+0000","last_fullsized":"2023-09-30T16:49:11.976867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975991+0000","last_change":"2023-09-30T16:49:10.624572+0000","last_active":"2023-09-30T16:49:11.975991+0000","last_peered":"2023-09-30T16:49:11.975991+0000","last_clean":"2023-09-30T16:49:11.975991+0000","last_became_active":"2023-09-30T16:49:10.624284+0000","last_became_peered":"2023-09-30T16:49:10.624284+0000","last_unstale":"2023-09-30T16:49:11.975991+0000","last_undegraded":"2023-09-30T16:49:11.975991+0000","last_fullsized":"2023-09-30T16:49:11.975991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.596894+0000","last_change":"2023-09-30T16:49:10.614544+0000","last_active":"2023-09-30T16:49:11.596894+0000","last_peered":"2023-09-30T16:49:11.596894+0000","last_clean":"2023-09-30T16:49:11.596894+0000","last_became_active":"2023-09-30T16:49:10.614152+0000","last_became_peered":"2023-09-30T16:49:10.614152+0000","last_unstale":"2023-09-30T16:49:11.596894+0000","last_undegraded":"2023-09-30T16:49:11.596894+0000","last_fullsized":"2023-09-30T16:49:11.596894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976846+0000","last_change":"2023-09-30T16:49:09.619255+0000","last_active":"2023-09-30T16:49:11.976846+0000","last_peered":"2023-09-30T16:49:11.976846+0000","last_clean":"2023-09-30T16:49:11.976846+0000","last_became_active":"2023-09-30T16:49:09.618555+0000","last_became_peered":"2023-09-30T16:49:09.618555+0000","last_unstale":"2023-09-30T16:49:11.976846+0000","last_undegraded":"2023-09-30T16:49:11.976846+0000","last_fullsized":"2023-09-30T16:49:11.976846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601602+0000","last_change":"2023-09-30T16:49:10.634574+0000","last_active":"2023-09-30T16:49:11.601602+0000","last_peered":"2023-09-30T16:49:11.601602+0000","last_clean":"2023-09-30T16:49:11.601602+0000","last_became_active":"2023-09-30T16:49:10.634290+0000","last_became_peered":"2023-09-30T16:49:10.634290+0000","last_unstale":"2023-09-30T16:49:11.601602+0000","last_undegraded":"2023-09-30T16:49:11.601602+0000","last_fullsized":"2023-09-30T16:49:11.601602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977368+0000","last_change":"2023-09-30T16:49:09.591524+0000","last_active":"2023-09-30T16:49:11.977368+0000","last_peered":"2023-09-30T16:49:11.977368+0000","last_clean":"2023-09-30T16:49:11.977368+0000","last_became_active":"2023-09-30T16:49:09.591196+0000","last_became_peered":"2023-09-30T16:49:09.591196+0000","last_unstale":"2023-09-30T16:49:11.977368+0000","last_undegraded":"2023-09-30T16:49:11.977368+0000","last_fullsized":"2023-09-30T16:49:11.977368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:05.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601646+0000","last_change":"2023-09-30T16:49:09.593605+0000","last_active":"2023-09-30T16:49:11.601646+0000","last_peered":"2023-09-30T16:49:11.601646+0000","last_clean":"2023-09-30T16:49:11.601646+0000","last_became_active":"2023-09-30T16:49:09.592556+0000","last_became_peered":"2023-09-30T16:49:09.592556+0000","last_unstale":"2023-09-30T16:49:11.601646+0000","last_undegraded":"2023-09-30T16:49:11.601646+0000","last_fullsized":"2023-09-30T16:49:11.601646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:22.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977552+0000","last_change":"2023-09-30T16:49:10.626630+0000","last_active":"2023-09-30T16:49:11.977552+0000","last_peered":"2023-09-30T16:49:11.977552+0000","last_clean":"2023-09-30T16:49:11.977552+0000","last_became_active":"2023-09-30T16:49:10.626316+0000","last_became_peered":"2023-09-30T16:49:10.626316+0000","last_unstale":"2023-09-30T16:49:11.977552+0000","last_undegraded":"2023-09-30T16:49:11.977552+0000","last_fullsized":"2023-09-30T16:49:11.977552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:38.419701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978195+0000","last_change":"2023-09-30T16:49:09.594246+0000","last_active":"2023-09-30T16:49:11.978195+0000","last_peered":"2023-09-30T16:49:11.978195+0000","last_clean":"2023-09-30T16:49:11.978195+0000","last_became_active":"2023-09-30T16:49:09.593915+0000","last_became_peered":"2023-09-30T16:49:09.593915+0000","last_unstale":"2023-09-30T16:49:11.978195+0000","last_undegraded":"2023-09-30T16:49:11.978195+0000","last_fullsized":"2023-09-30T16:49:11.978195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601785+0000","last_change":"2023-09-30T16:49:10.626401+0000","last_active":"2023-09-30T16:49:11.601785+0000","last_peered":"2023-09-30T16:49:11.601785+0000","last_clean":"2023-09-30T16:49:11.601785+0000","last_became_active":"2023-09-30T16:49:10.621995+0000","last_became_peered":"2023-09-30T16:49:10.621995+0000","last_unstale":"2023-09-30T16:49:11.601785+0000","last_undegraded":"2023-09-30T16:49:11.601785+0000","last_fullsized":"2023-09-30T16:49:11.601785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.613752+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.613471+0000","last_became_peered":"2023-09-30T16:49:10.613471+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:50.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978231+0000","last_change":"2023-09-30T16:49:09.592279+0000","last_active":"2023-09-30T16:49:11.978231+0000","last_peered":"2023-09-30T16:49:11.978231+0000","last_clean":"2023-09-30T16:49:11.978231+0000","last_became_active":"2023-09-30T16:49:09.591878+0000","last_became_peered":"2023-09-30T16:49:09.591878+0000","last_unstale":"2023-09-30T16:49:11.978231+0000","last_undegraded":"2023-09-30T16:49:11.978231+0000","last_fullsized":"2023-09-30T16:49:11.978231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.044504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977588+0000","last_change":"2023-09-30T16:49:10.628129+0000","last_active":"2023-09-30T16:49:11.977588+0000","last_peered":"2023-09-30T16:49:11.977588+0000","last_clean":"2023-09-30T16:49:11.977588+0000","last_became_active":"2023-09-30T16:49:10.627840+0000","last_became_peered":"2023-09-30T16:49:10.627840+0000","last_unstale":"2023-09-30T16:49:11.977588+0000","last_undegraded":"2023-09-30T16:49:11.977588+0000","last_fullsized":"2023-09-30T16:49:11.977588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:05:15.929844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977128+0000","last_change":"2023-09-30T16:49:09.612101+0000","last_active":"2023-09-30T16:49:11.977128+0000","last_peered":"2023-09-30T16:49:11.977128+0000","last_clean":"2023-09-30T16:49:11.977128+0000","last_became_active":"2023-09-30T16:49:09.611560+0000","last_became_peered":"2023-09-30T16:49:09.611560+0000","last_unstale":"2023-09-30T16:49:11.977128+0000","last_undegraded":"2023-09-30T16:49:11.977128+0000","last_fullsized":"2023-09-30T16:49:11.977128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:15.187430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976893+0000","last_change":"2023-09-30T16:49:10.619592+0000","last_active":"2023-09-30T16:49:11.976893+0000","last_peered":"2023-09-30T16:49:11.976893+0000","last_clean":"2023-09-30T16:49:11.976893+0000","last_became_active":"2023-09-30T16:49:10.619251+0000","last_became_peered":"2023-09-30T16:49:10.619251+0000","last_unstale":"2023-09-30T16:49:11.976893+0000","last_undegraded":"2023-09-30T16:49:11.976893+0000","last_fullsized":"2023-09-30T16:49:11.976893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597687+0000","last_change":"2023-09-30T16:49:09.606217+0000","last_active":"2023-09-30T16:49:11.597687+0000","last_peered":"2023-09-30T16:49:11.597687+0000","last_clean":"2023-09-30T16:49:11.597687+0000","last_became_active":"2023-09-30T16:49:09.605883+0000","last_became_peered":"2023-09-30T16:49:09.605883+0000","last_unstale":"2023-09-30T16:49:11.597687+0000","last_undegraded":"2023-09-30T16:49:11.597687+0000","last_fullsized":"2023-09-30T16:49:11.597687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:20:46.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977809+0000","last_change":"2023-09-30T16:49:10.633013+0000","last_active":"2023-09-30T16:49:11.977809+0000","last_peered":"2023-09-30T16:49:11.977809+0000","last_clean":"2023-09-30T16:49:11.977809+0000","last_became_active":"2023-09-30T16:49:10.626780+0000","last_became_peered":"2023-09-30T16:49:10.626780+0000","last_unstale":"2023-09-30T16:49:11.977809+0000","last_undegraded":"2023-09-30T16:49:11.977809+0000","last_fullsized":"2023-09-30T16:49:11.977809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:14:01.374332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977545+0000","last_change":"2023-09-30T16:49:09.601823+0000","last_active":"2023-09-30T16:49:11.977545+0000","last_peered":"2023-09-30T16:49:11.977545+0000","last_clean":"2023-09-30T16:49:11.977545+0000","last_became_active":"2023-09-30T16:49:09.600844+0000","last_became_peered":"2023-09-30T16:49:09.600844+0000","last_unstale":"2023-09-30T16:49:11.977545+0000","last_undegraded":"2023-09-30T16:49:11.977545+0000","last_fullsized":"2023-09-30T16:49:11.977545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:12:56.898098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601684+0000","last_change":"2023-09-30T16:49:10.619205+0000","last_active":"2023-09-30T16:49:11.601684+0000","last_peered":"2023-09-30T16:49:11.601684+0000","last_clean":"2023-09-30T16:49:11.601684+0000","last_became_active":"2023-09-30T16:49:10.618841+0000","last_became_peered":"2023-09-30T16:49:10.618841+0000","last_unstale":"2023-09-30T16:49:11.601684+0000","last_undegraded":"2023-09-30T16:49:11.601684+0000","last_fullsized":"2023-09-30T16:49:11.601684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977431+0000","last_change":"2023-09-30T16:49:09.596896+0000","last_active":"2023-09-30T16:49:11.977431+0000","last_peered":"2023-09-30T16:49:11.977431+0000","last_clean":"2023-09-30T16:49:11.977431+0000","last_became_active":"2023-09-30T16:49:09.596566+0000","last_became_peered":"2023-09-30T16:49:09.596566+0000","last_unstale":"2023-09-30T16:49:11.977431+0000","last_undegraded":"2023-09-30T16:49:11.977431+0000","last_fullsized":"2023-09-30T16:49:11.977431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:13.982791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979825+0000","last_change":"2023-09-30T16:49:10.637755+0000","last_active":"2023-09-30T16:49:11.979825+0000","last_peered":"2023-09-30T16:49:11.979825+0000","last_clean":"2023-09-30T16:49:11.979825+0000","last_became_active":"2023-09-30T16:49:10.637423+0000","last_became_peered":"2023-09-30T16:49:10.637423+0000","last_unstale":"2023-09-30T16:49:11.979825+0000","last_undegraded":"2023-09-30T16:49:11.979825+0000","last_fullsized":"2023-09-30T16:49:11.979825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:08.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976207+0000","last_change":"2023-09-30T16:49:09.595029+0000","last_active":"2023-09-30T16:49:11.976207+0000","last_peered":"2023-09-30T16:49:11.976207+0000","last_clean":"2023-09-30T16:49:11.976207+0000","last_became_active":"2023-09-30T16:49:09.594386+0000","last_became_peered":"2023-09-30T16:49:09.594386+0000","last_unstale":"2023-09-30T16:49:11.976207+0000","last_undegraded":"2023-09-30T16:49:11.976207+0000","last_fullsized":"2023-09-30T16:49:11.976207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:00.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602079+0000","last_change":"2023-09-30T16:49:09.598236+0000","last_active":"2023-09-30T16:49:11.602079+0000","last_peered":"2023-09-30T16:49:11.602079+0000","last_clean":"2023-09-30T16:49:11.602079+0000","last_became_active":"2023-09-30T16:49:09.597544+0000","last_became_peered":"2023-09-30T16:49:09.597544+0000","last_unstale":"2023-09-30T16:49:11.602079+0000","last_undegraded":"2023-09-30T16:49:11.602079+0000","last_fullsized":"2023-09-30T16:49:11.602079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:55.567056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978555+0000","last_change":"2023-09-30T16:49:10.617486+0000","last_active":"2023-09-30T16:49:11.978555+0000","last_peered":"2023-09-30T16:49:11.978555+0000","last_clean":"2023-09-30T16:49:11.978555+0000","last_became_active":"2023-09-30T16:49:10.617170+0000","last_became_peered":"2023-09-30T16:49:10.617170+0000","last_unstale":"2023-09-30T16:49:11.978555+0000","last_undegraded":"2023-09-30T16:49:11.978555+0000","last_fullsized":"2023-09-30T16:49:11.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:12.868894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978921+0000","last_change":"2023-09-30T16:49:09.614260+0000","last_active":"2023-09-30T16:49:11.978921+0000","last_peered":"2023-09-30T16:49:11.978921+0000","last_clean":"2023-09-30T16:49:11.978921+0000","last_became_active":"2023-09-30T16:49:09.613910+0000","last_became_peered":"2023-09-30T16:49:09.613910+0000","last_unstale":"2023-09-30T16:49:11.978921+0000","last_undegraded":"2023-09-30T16:49:11.978921+0000","last_fullsized":"2023-09-30T16:49:11.978921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598019+0000","last_change":"2023-09-30T16:49:10.631809+0000","last_active":"2023-09-30T16:49:11.598019+0000","last_peered":"2023-09-30T16:49:11.598019+0000","last_clean":"2023-09-30T16:49:11.598019+0000","last_became_active":"2023-09-30T16:49:10.631420+0000","last_became_peered":"2023-09-30T16:49:10.631420+0000","last_unstale":"2023-09-30T16:49:11.598019+0000","last_undegraded":"2023-09-30T16:49:11.598019+0000","last_fullsized":"2023-09-30T16:49:11.598019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:14.134423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602272+0000","last_change":"2023-09-30T16:49:09.624546+0000","last_active":"2023-09-30T16:49:11.602272+0000","last_peered":"2023-09-30T16:49:11.602272+0000","last_clean":"2023-09-30T16:49:11.602272+0000","last_became_active":"2023-09-30T16:49:09.623841+0000","last_became_peered":"2023-09-30T16:49:09.623841+0000","last_unstale":"2023-09-30T16:49:11.602272+0000","last_undegraded":"2023-09-30T16:49:11.602272+0000","last_fullsized":"2023-09-30T16:49:11.602272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:20.760273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978769+0000","last_change":"2023-09-30T16:49:10.638625+0000","last_active":"2023-09-30T16:49:11.978769+0000","last_peered":"2023-09-30T16:49:11.978769+0000","last_clean":"2023-09-30T16:49:11.978769+0000","last_became_active":"2023-09-30T16:49:10.638153+0000","last_became_peered":"2023-09-30T16:49:10.638153+0000","last_unstale":"2023-09-30T16:49:11.978769+0000","last_undegraded":"2023-09-30T16:49:11.978769+0000","last_fullsized":"2023-09-30T16:49:11.978769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976605+0000","last_change":"2023-09-30T16:49:09.604750+0000","last_active":"2023-09-30T16:49:11.976605+0000","last_peered":"2023-09-30T16:49:11.976605+0000","last_clean":"2023-09-30T16:49:11.976605+0000","last_became_active":"2023-09-30T16:49:09.600838+0000","last_became_peered":"2023-09-30T16:49:09.600838+0000","last_unstale":"2023-09-30T16:49:11.976605+0000","last_undegraded":"2023-09-30T16:49:11.976605+0000","last_fullsized":"2023-09-30T16:49:11.976605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977679+0000","last_change":"2023-09-30T16:49:10.637559+0000","last_active":"2023-09-30T16:49:11.977679+0000","last_peered":"2023-09-30T16:49:11.977679+0000","last_clean":"2023-09-30T16:49:11.977679+0000","last_became_active":"2023-09-30T16:49:10.630340+0000","last_became_peered":"2023-09-30T16:49:10.630340+0000","last_unstale":"2023-09-30T16:49:11.977679+0000","last_undegraded":"2023-09-30T16:49:11.977679+0000","last_fullsized":"2023-09-30T16:49:11.977679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:27.229031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601934+0000","last_change":"2023-09-30T16:49:09.600440+0000","last_active":"2023-09-30T16:49:11.601934+0000","last_peered":"2023-09-30T16:49:11.601934+0000","last_clean":"2023-09-30T16:49:11.601934+0000","last_became_active":"2023-09-30T16:49:09.599554+0000","last_became_peered":"2023-09-30T16:49:09.599554+0000","last_unstale":"2023-09-30T16:49:11.601934+0000","last_undegraded":"2023-09-30T16:49:11.601934+0000","last_fullsized":"2023-09-30T16:49:11.601934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979354+0000","last_change":"2023-09-30T16:49:10.620991+0000","last_active":"2023-09-30T16:49:11.979354+0000","last_peered":"2023-09-30T16:49:11.979354+0000","last_clean":"2023-09-30T16:49:11.979354+0000","last_became_active":"2023-09-30T16:49:10.620738+0000","last_became_peered":"2023-09-30T16:49:10.620738+0000","last_unstale":"2023-09-30T16:49:11.979354+0000","last_undegraded":"2023-09-30T16:49:11.979354+0000","last_fullsized":"2023-09-30T16:49:11.979354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:31.181804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.980054+0000","last_change":"2023-09-30T16:49:09.594466+0000","last_active":"2023-09-30T16:49:11.980054+0000","last_peered":"2023-09-30T16:49:11.980054+0000","last_clean":"2023-09-30T16:49:11.980054+0000","last_became_active":"2023-09-30T16:49:09.593975+0000","last_became_peered":"2023-09-30T16:49:09.593975+0000","last_unstale":"2023-09-30T16:49:11.980054+0000","last_undegraded":"2023-09-30T16:49:11.980054+0000","last_fullsized":"2023-09-30T16:49:11.980054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:24.904253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601532+0000","last_change":"2023-09-30T16:49:10.617041+0000","last_active":"2023-09-30T16:49:11.601532+0000","last_peered":"2023-09-30T16:49:11.601532+0000","last_clean":"2023-09-30T16:49:11.601532+0000","last_became_active":"2023-09-30T16:49:10.616673+0000","last_became_peered":"2023-09-30T16:49:10.616673+0000","last_unstale":"2023-09-30T16:49:11.601532+0000","last_undegraded":"2023-09-30T16:49:11.601532+0000","last_fullsized":"2023-09-30T16:49:11.601532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979257+0000","last_change":"2023-09-30T16:49:09.619350+0000","last_active":"2023-09-30T16:49:11.979257+0000","last_peered":"2023-09-30T16:49:11.979257+0000","last_clean":"2023-09-30T16:49:11.979257+0000","last_became_active":"2023-09-30T16:49:09.619032+0000","last_became_peered":"2023-09-30T16:49:09.619032+0000","last_unstale":"2023-09-30T16:49:11.979257+0000","last_undegraded":"2023-09-30T16:49:11.979257+0000","last_fullsized":"2023-09-30T16:49:11.979257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.600797+0000","last_change":"2023-09-30T16:49:10.618387+0000","last_active":"2023-09-30T16:49:11.600797+0000","last_peered":"2023-09-30T16:49:11.600797+0000","last_clean":"2023-09-30T16:49:11.600797+0000","last_became_active":"2023-09-30T16:49:10.618048+0000","last_became_peered":"2023-09-30T16:49:10.618048+0000","last_unstale":"2023-09-30T16:49:11.600797+0000","last_undegraded":"2023-09-30T16:49:11.600797+0000","last_fullsized":"2023-09-30T16:49:11.600797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:31.999294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977896+0000","last_change":"2023-09-30T16:49:09.620418+0000","last_active":"2023-09-30T16:49:11.977896+0000","last_peered":"2023-09-30T16:49:11.977896+0000","last_clean":"2023-09-30T16:49:11.977896+0000","last_became_active":"2023-09-30T16:49:09.619799+0000","last_became_peered":"2023-09-30T16:49:09.619799+0000","last_unstale":"2023-09-30T16:49:11.977896+0000","last_undegraded":"2023-09-30T16:49:11.977896+0000","last_fullsized":"2023-09-30T16:49:11.977896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:38.582461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977037+0000","last_change":"2023-09-30T16:49:10.629792+0000","last_active":"2023-09-30T16:49:11.977037+0000","last_peered":"2023-09-30T16:49:11.977037+0000","last_clean":"2023-09-30T16:49:11.977037+0000","last_became_active":"2023-09-30T16:49:10.629460+0000","last_became_peered":"2023-09-30T16:49:10.629460+0000","last_unstale":"2023-09-30T16:49:11.977037+0000","last_undegraded":"2023-09-30T16:49:11.977037+0000","last_fullsized":"2023-09-30T16:49:11.977037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:20:56.822877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977632+0000","last_change":"2023-09-30T16:49:09.603654+0000","last_active":"2023-09-30T16:49:11.977632+0000","last_peered":"2023-09-30T16:49:11.977632+0000","last_clean":"2023-09-30T16:49:11.977632+0000","last_became_active":"2023-09-30T16:49:09.603267+0000","last_became_peered":"2023-09-30T16:49:09.603267+0000","last_unstale":"2023-09-30T16:49:11.977632+0000","last_undegraded":"2023-09-30T16:49:11.977632+0000","last_fullsized":"2023-09-30T16:49:11.977632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:26.219476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977808+0000","last_change":"2023-09-30T16:49:10.636453+0000","last_active":"2023-09-30T16:49:11.977808+0000","last_peered":"2023-09-30T16:49:11.977808+0000","last_clean":"2023-09-30T16:49:11.977808+0000","last_became_active":"2023-09-30T16:49:10.635319+0000","last_became_peered":"2023-09-30T16:49:10.635319+0000","last_unstale":"2023-09-30T16:49:11.977808+0000","last_undegraded":"2023-09-30T16:49:11.977808+0000","last_fullsized":"2023-09-30T16:49:11.977808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976636+0000","last_change":"2023-09-30T16:49:09.618129+0000","last_active":"2023-09-30T16:49:11.976636+0000","last_peered":"2023-09-30T16:49:11.976636+0000","last_clean":"2023-09-30T16:49:11.976636+0000","last_became_active":"2023-09-30T16:49:09.616087+0000","last_became_peered":"2023-09-30T16:49:09.616087+0000","last_unstale":"2023-09-30T16:49:11.976636+0000","last_undegraded":"2023-09-30T16:49:11.976636+0000","last_fullsized":"2023-09-30T16:49:11.976636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597311+0000","last_change":"2023-09-30T16:49:10.618572+0000","last_active":"2023-09-30T16:49:11.597311+0000","last_peered":"2023-09-30T16:49:11.597311+0000","last_clean":"2023-09-30T16:49:11.597311+0000","last_became_active":"2023-09-30T16:49:10.618246+0000","last_became_peered":"2023-09-30T16:49:10.618246+0000","last_unstale":"2023-09-30T16:49:11.597311+0000","last_undegraded":"2023-09-30T16:49:11.597311+0000","last_fullsized":"2023-09-30T16:49:11.597311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979624+0000","last_change":"2023-09-30T16:49:09.611197+0000","last_active":"2023-09-30T16:49:11.979624+0000","last_peered":"2023-09-30T16:49:11.979624+0000","last_clean":"2023-09-30T16:49:11.979624+0000","last_became_active":"2023-09-30T16:49:09.610929+0000","last_became_peered":"2023-09-30T16:49:09.610929+0000","last_unstale":"2023-09-30T16:49:11.979624+0000","last_undegraded":"2023-09-30T16:49:11.979624+0000","last_fullsized":"2023-09-30T16:49:11.979624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:49.375737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601989+0000","last_change":"2023-09-30T16:49:10.632399+0000","last_active":"2023-09-30T16:49:11.601989+0000","last_peered":"2023-09-30T16:49:11.601989+0000","last_clean":"2023-09-30T16:49:11.601989+0000","last_became_active":"2023-09-30T16:49:10.632044+0000","last_became_peered":"2023-09-30T16:49:10.632044+0000","last_unstale":"2023-09-30T16:49:11.601989+0000","last_undegraded":"2023-09-30T16:49:11.601989+0000","last_fullsized":"2023-09-30T16:49:11.601989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602392+0000","last_change":"2023-09-30T16:49:09.598092+0000","last_active":"2023-09-30T16:49:11.602392+0000","last_peered":"2023-09-30T16:49:11.602392+0000","last_clean":"2023-09-30T16:49:11.602392+0000","last_became_active":"2023-09-30T16:49:09.597294+0000","last_became_peered":"2023-09-30T16:49:09.597294+0000","last_unstale":"2023-09-30T16:49:11.602392+0000","last_undegraded":"2023-09-30T16:49:11.602392+0000","last_fullsized":"2023-09-30T16:49:11.602392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602370+0000","last_change":"2023-09-30T16:49:10.628648+0000","last_active":"2023-09-30T16:49:11.602370+0000","last_peered":"2023-09-30T16:49:11.602370+0000","last_clean":"2023-09-30T16:49:11.602370+0000","last_became_active":"2023-09-30T16:49:10.619172+0000","last_became_peered":"2023-09-30T16:49:10.619172+0000","last_unstale":"2023-09-30T16:49:11.602370+0000","last_undegraded":"2023-09-30T16:49:11.602370+0000","last_fullsized":"2023-09-30T16:49:11.602370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978385+0000","last_change":"2023-09-30T16:49:09.591867+0000","last_active":"2023-09-30T16:49:11.978385+0000","last_peered":"2023-09-30T16:49:11.978385+0000","last_clean":"2023-09-30T16:49:11.978385+0000","last_became_active":"2023-09-30T16:49:09.591062+0000","last_became_peered":"2023-09-30T16:49:09.591062+0000","last_unstale":"2023-09-30T16:49:11.978385+0000","last_undegraded":"2023-09-30T16:49:11.978385+0000","last_fullsized":"2023-09-30T16:49:11.978385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:35.797259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602280+0000","last_change":"2023-09-30T16:49:10.621227+0000","last_active":"2023-09-30T16:49:11.602280+0000","last_peered":"2023-09-30T16:49:11.602280+0000","last_clean":"2023-09-30T16:49:11.602280+0000","last_became_active":"2023-09-30T16:49:10.620861+0000","last_became_peered":"2023-09-30T16:49:10.620861+0000","last_unstale":"2023-09-30T16:49:11.602280+0000","last_undegraded":"2023-09-30T16:49:11.602280+0000","last_fullsized":"2023-09-30T16:49:11.602280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975957+0000","last_change":"2023-09-30T16:49:09.593530+0000","last_active":"2023-09-30T16:49:11.975957+0000","last_peered":"2023-09-30T16:49:11.975957+0000","last_clean":"2023-09-30T16:49:11.975957+0000","last_became_active":"2023-09-30T16:49:09.593238+0000","last_became_peered":"2023-09-30T16:49:09.593238+0000","last_unstale":"2023-09-30T16:49:11.975957+0000","last_undegraded":"2023-09-30T16:49:11.975957+0000","last_fullsized":"2023-09-30T16:49:11.975957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:13.124869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978879+0000","last_change":"2023-09-30T16:49:10.629665+0000","last_active":"2023-09-30T16:49:11.978879+0000","last_peered":"2023-09-30T16:49:11.978879+0000","last_clean":"2023-09-30T16:49:11.978879+0000","last_became_active":"2023-09-30T16:49:10.629348+0000","last_became_peered":"2023-09-30T16:49:10.629348+0000","last_unstale":"2023-09-30T16:49:11.978879+0000","last_undegraded":"2023-09-30T16:49:11.978879+0000","last_fullsized":"2023-09-30T16:49:11.978879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:20:08.861216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602018+0000","last_change":"2023-09-30T16:49:09.595063+0000","last_active":"2023-09-30T16:49:11.602018+0000","last_peered":"2023-09-30T16:49:11.602018+0000","last_clean":"2023-09-30T16:49:11.602018+0000","last_became_active":"2023-09-30T16:49:09.592082+0000","last_became_peered":"2023-09-30T16:49:09.592082+0000","last_unstale":"2023-09-30T16:49:11.602018+0000","last_undegraded":"2023-09-30T16:49:11.602018+0000","last_fullsized":"2023-09-30T16:49:11.602018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:48.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602131+0000","last_change":"2023-09-30T16:49:10.626413+0000","last_active":"2023-09-30T16:49:11.602131+0000","last_peered":"2023-09-30T16:49:11.602131+0000","last_clean":"2023-09-30T16:49:11.602131+0000","last_became_active":"2023-09-30T16:49:10.626088+0000","last_became_peered":"2023-09-30T16:49:10.626088+0000","last_unstale":"2023-09-30T16:49:11.602131+0000","last_undegraded":"2023-09-30T16:49:11.602131+0000","last_fullsized":"2023-09-30T16:49:11.602131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601518+0000","last_change":"2023-09-30T16:49:09.617357+0000","last_active":"2023-09-30T16:49:11.601518+0000","last_peered":"2023-09-30T16:49:11.601518+0000","last_clean":"2023-09-30T16:49:11.601518+0000","last_became_active":"2023-09-30T16:49:09.616658+0000","last_became_peered":"2023-09-30T16:49:09.616658+0000","last_unstale":"2023-09-30T16:49:11.601518+0000","last_undegraded":"2023-09-30T16:49:11.601518+0000","last_fullsized":"2023-09-30T16:49:11.601518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:00.055876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977595+0000","last_change":"2023-09-30T16:49:10.620209+0000","last_active":"2023-09-30T16:49:11.977595+0000","last_peered":"2023-09-30T16:49:11.977595+0000","last_clean":"2023-09-30T16:49:11.977595+0000","last_became_active":"2023-09-30T16:49:10.619843+0000","last_became_peered":"2023-09-30T16:49:10.619843+0000","last_unstale":"2023-09-30T16:49:11.977595+0000","last_undegraded":"2023-09-30T16:49:11.977595+0000","last_fullsized":"2023-09-30T16:49:11.977595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979943+0000","last_change":"2023-09-30T16:49:09.594732+0000","last_active":"2023-09-30T16:49:11.979943+0000","last_peered":"2023-09-30T16:49:11.979943+0000","last_clean":"2023-09-30T16:49:11.979943+0000","last_became_active":"2023-09-30T16:49:09.594408+0000","last_became_peered":"2023-09-30T16:49:09.594408+0000","last_unstale":"2023-09-30T16:49:11.979943+0000","last_undegraded":"2023-09-30T16:49:11.979943+0000","last_fullsized":"2023-09-30T16:49:11.979943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:13.049354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977210+0000","last_change":"2023-09-30T16:49:10.624221+0000","last_active":"2023-09-30T16:49:11.977210+0000","last_peered":"2023-09-30T16:49:11.977210+0000","last_clean":"2023-09-30T16:49:11.977210+0000","last_became_active":"2023-09-30T16:49:10.623805+0000","last_became_peered":"2023-09-30T16:49:10.623805+0000","last_unstale":"2023-09-30T16:49:11.977210+0000","last_undegraded":"2023-09-30T16:49:11.977210+0000","last_fullsized":"2023-09-30T16:49:11.977210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979180+0000","last_change":"2023-09-30T16:49:10.635402+0000","last_active":"2023-09-30T16:49:11.979180+0000","last_peered":"2023-09-30T16:49:11.979180+0000","last_clean":"2023-09-30T16:49:11.979180+0000","last_became_active":"2023-09-30T16:49:10.634645+0000","last_became_peered":"2023-09-30T16:49:10.634645+0000","last_unstale":"2023-09-30T16:49:11.979180+0000","last_undegraded":"2023-09-30T16:49:11.979180+0000","last_fullsized":"2023-09-30T16:49:11.979180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:06.779362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977933+0000","last_change":"2023-09-30T16:49:09.591559+0000","last_active":"2023-09-30T16:49:11.977933+0000","last_peered":"2023-09-30T16:49:11.977933+0000","last_clean":"2023-09-30T16:49:11.977933+0000","last_became_active":"2023-09-30T16:49:09.591265+0000","last_became_peered":"2023-09-30T16:49:09.591265+0000","last_unstale":"2023-09-30T16:49:11.977933+0000","last_undegraded":"2023-09-30T16:49:11.977933+0000","last_fullsized":"2023-09-30T16:49:11.977933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978073+0000","last_change":"2023-09-30T16:49:09.591796+0000","last_active":"2023-09-30T16:49:11.978073+0000","last_peered":"2023-09-30T16:49:11.978073+0000","last_clean":"2023-09-30T16:49:11.978073+0000","last_became_active":"2023-09-30T16:49:09.591474+0000","last_became_peered":"2023-09-30T16:49:09.591474+0000","last_unstale":"2023-09-30T16:49:11.978073+0000","last_undegraded":"2023-09-30T16:49:11.978073+0000","last_fullsized":"2023-09-30T16:49:11.978073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:45.706321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977248+0000","last_change":"2023-09-30T16:49:10.628239+0000","last_active":"2023-09-30T16:49:11.977248+0000","last_peered":"2023-09-30T16:49:11.977248+0000","last_clean":"2023-09-30T16:49:11.977248+0000","last_became_active":"2023-09-30T16:49:10.627915+0000","last_became_peered":"2023-09-30T16:49:10.627915+0000","last_unstale":"2023-09-30T16:49:11.977248+0000","last_undegraded":"2023-09-30T16:49:11.977248+0000","last_fullsized":"2023-09-30T16:49:11.977248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:40:55.750019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:09.612990+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:09.606939+0000","last_became_peered":"2023-09-30T16:49:09.606939+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:00.151397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977818+0000","last_change":"2023-09-30T16:49:10.631974+0000","last_active":"2023-09-30T16:49:11.977818+0000","last_peered":"2023-09-30T16:49:11.977818+0000","last_clean":"2023-09-30T16:49:11.977818+0000","last_became_active":"2023-09-30T16:49:10.631388+0000","last_became_peered":"2023-09-30T16:49:10.631388+0000","last_unstale":"2023-09-30T16:49:11.977818+0000","last_undegraded":"2023-09-30T16:49:11.977818+0000","last_fullsized":"2023-09-30T16:49:11.977818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:01:27.558052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602467+0000","last_change":"2023-09-30T16:49:09.606230+0000","last_active":"2023-09-30T16:49:11.602467+0000","last_peered":"2023-09-30T16:49:11.602467+0000","last_clean":"2023-09-30T16:49:11.602467+0000","last_became_active":"2023-09-30T16:49:09.605614+0000","last_became_peered":"2023-09-30T16:49:09.605614+0000","last_unstale":"2023-09-30T16:49:11.602467+0000","last_undegraded":"2023-09-30T16:49:11.602467+0000","last_fullsized":"2023-09-30T16:49:11.602467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:30.989740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":74251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":74833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":658389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:19.481 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T16:49:19.481 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T16:49:19.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T16:49:19.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T16:49:19.482 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T16:49:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e8a61640 1 Processor -- start 2023-09-30T16:49:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e8a61640 1 -- start start 2023-09-30T16:49:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e8a61640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6e4158ff0 0x7fe6e40b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e8a61640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40b0a40 con 0x7fe6e406cd10 2023-09-30T16:49:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e8a61640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40cc320 con 0x7fe6e40b05e0 2023-09-30T16:49:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e8a61640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e406d2a0 con 0x7fe6e4158ff0 2023-09-30T16:49:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6e4158ff0 0x7fe6e40b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6e4158ff0 0x7fe6e40b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53884/0 (socket says 172.21.15.52:53884) 2023-09-30T16:49:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 -- 172.21.15.52:0/196993790 learned_addr learned my addr 172.21.15.52:0/196993790 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 -- 172.21.15.52:0/196993790 >> v1:172.21.15.186:6789/0 conn(0x7fe6e40b05e0 legacy=0x7fe6e406c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 -- 172.21.15.52:0/196993790 >> v1:172.21.15.52:6789/0 conn(0x7fe6e406cd10 legacy=0x7fe6e40cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e159a640 1 -- 172.21.15.52:0/196993790 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352945566 0 0) 0x7fe6e40b0a40 con 0x7fe6e406cd10 2023-09-30T16:49:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 -- 172.21.15.52:0/196993790 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e406d580 con 0x7fe6e4158ff0 2023-09-30T16:49:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.635+0000 7fe6e259c640 1 --2- 172.21.15.52:0/196993790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e40b00a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400bb10 tx=0x7fe6d401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decc331c6531d0c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e159a640 1 -- 172.21.15.52:0/196993790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40a7bc0 con 0x7fe6e4158ff0 2023-09-30T16:49:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e159a640 1 -- 172.21.15.52:0/196993790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d40a7d20 con 0x7fe6e4158ff0 2023-09-30T16:49:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e159a640 1 -- 172.21.15.52:0/196993790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40af660 con 0x7fe6e4158ff0 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/196993790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 msgr2=0x7fe6e40b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/196993790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e40b00a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400bb10 tx=0x7fe6d401eb50 comp rx=0 tx=0).stop 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/196993790 shutdown_connections 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/196993790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e40b00a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/196993790 >> 172.21.15.52:0/196993790 conn(0x7fe6e406a5f0 msgr2=0x7fe6e40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/196993790 shutdown_connections 2023-09-30T16:49:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/196993790 wait complete. 2023-09-30T16:49:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 Processor -- start 2023-09-30T16:49:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- start start 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6e406cd10 0x7fe6e40cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6e40b05e0 0x7fe6e414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e41488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e414a8d0 con 0x7fe6e4158ff0 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e414abb0 con 0x7fe6e406cd10 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e414ae90 con 0x7fe6e40b05e0 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e41488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e41488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53890/0 (socket says 172.21.15.52:53890) 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 -- 172.21.15.52:0/2926854467 learned_addr learned my addr 172.21.15.52:0/2926854467 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e259c640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6e406cd10 0x7fe6e40cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e1d9b640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6e40b05e0 0x7fe6e414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 -- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6e40b05e0 msgr2=0x7fe6e414bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6e40b05e0 0x7fe6e414bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 -- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6e406cd10 msgr2=0x7fe6e40cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6e406cd10 0x7fe6e40cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 -- 172.21.15.52:0/2926854467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d400b770 con 0x7fe6e4158ff0 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e1d9b640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6e40b05e0 0x7fe6e414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e2d9d640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e41488e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc001570 tx=0x7fe6dc00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc003db0 con 0x7fe6e4158ff0 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc005070 con 0x7fe6e4158ff0 2023-09-30T16:49:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc005420 con 0x7fe6e4158ff0 2023-09-30T16:49:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e414b170 con 0x7fe6e4158ff0 2023-09-30T16:49:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.639+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e414b730 con 0x7fe6e4158ff0 2023-09-30T16:49:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.643+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e414b950 con 0x7fe6e4158ff0 2023-09-30T16:49:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.643+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe6dc005580 con 0x7fe6e4158ff0 2023-09-30T16:49:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.643+0000 7fe6d2ffd640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe6c4066160 0x7fe6c4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.643+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6dc083370 con 0x7fe6e4158ff0 2023-09-30T16:49:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.643+0000 7fe6e259c640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe6c4066160 0x7fe6c4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.643+0000 7fe6e259c640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe6c4066160 0x7fe6c4068620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40b1000 tx=0x7fe6d40a9070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:19.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.647+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe6dc050990 con 0x7fe6e4158ff0 2023-09-30T16:49:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.843+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe6e40740a0 con 0x7fe6e4158ff0 2023-09-30T16:49:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6d2ffd640 1 -- 172.21.15.52:0/2926854467 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164042 (secure 0 0 0) 0x7fe6dc053fb0 con 0x7fe6e4158ff0 2023-09-30T16:49:19.851 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe6c4066160 msgr2=0x7fe6c4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe6c4066160 0x7fe6c4068620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40b1000 tx=0x7fe6d40a9070 comp rx=0 tx=0).stop 2023-09-30T16:49:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 msgr2=0x7fe6e41488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e41488e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc001570 tx=0x7fe6dc00cd20 comp rx=0 tx=0).stop 2023-09-30T16:49:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 shutdown_connections 2023-09-30T16:49:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe6c4066160 0x7fe6c4068620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4158ff0 0x7fe6e41488e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6e40b05e0 0x7fe6e414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 --2- 172.21.15.52:0/2926854467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6e406cd10 0x7fe6e40cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 >> 172.21.15.52:0/2926854467 conn(0x7fe6e406a5f0 msgr2=0x7fe6e40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 shutdown_connections 2023-09-30T16:49:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.847+0000 7fe6e8a61640 1 -- 172.21.15.52:0/2926854467 wait complete. 2023-09-30T16:49:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1582402253},{"type":"v1","addr":"172.21.15.186:6833","nonce":1582402253}]},"active_addr":"172.21.15.186:6833/1582402253","active_change":"2023-09-30T16:48:57.445646+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":713137990}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":2840473608}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":1117713249}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":2071515235}]}]} 2023-09-30T16:49:19.872 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T16:49:19.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T16:49:19.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:19.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.987+0000 7fbcd7671640 1 Processor -- start 2023-09-30T16:49:19.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd7671640 1 -- start start 2023-09-30T16:49:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd7671640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbcd0159c60 0x7fbcd00cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd7671640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd0069f30 con 0x7fbcd00ca070 2023-09-30T16:49:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd7671640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd00ce680 con 0x7fbcd00c94f0 2023-09-30T16:49:19.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd7671640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd00ce960 con 0x7fbcd0159c60 2023-09-30T16:49:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd5c0e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbcd00ca070 0x7fbcd006a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39948/0 (socket says 172.21.15.52:39948) 2023-09-30T16:49:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd5c0e640 1 -- 172.21.15.52:0/411164764 learned_addr learned my addr 172.21.15.52:0/411164764 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:19.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 --2- 172.21.15.52:0/411164764 >> v2:172.21.15.186:3300/0 conn(0x7fbcd0159c60 0x7fbcd00cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024864161 0 0) 0x7fbcd0069f30 con 0x7fbcd00ca070 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcbc003530 con 0x7fbcd00ca070 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 361096201 0 0) 0x7fbcbc003530 con 0x7fbcd00ca070 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 >> v2:172.21.15.186:3300/0 conn(0x7fbcd0159c60 msgr2=0x7fbcd00cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 --2- 172.21.15.52:0/411164764 >> v2:172.21.15.186:3300/0 conn(0x7fbcd0159c60 0x7fbcd00cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 >> v1:172.21.15.186:6789/0 conn(0x7fbcd00c94f0 legacy=0x7fbcd00c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00cec40 con 0x7fbcd00ca070 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fbcc8001a00 con 0x7fbcd00ca070 2023-09-30T16:49:19.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 >> v1:172.21.15.52:6789/0 conn(0x7fbcd00ca070 legacy=0x7fbcd006a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcbc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcbc0047d0 0x7fbcbc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcbc005200 0x7fbcbc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00ce960 con 0x7fbcbc0039f0 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc00c160 con 0x7fbcbc0047d0 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc00c320 con 0x7fbcbc005200 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcbc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:19.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd4c0c640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcbc0047d0 0x7fbcbc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd5c0e640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcbc005200 0x7fbcbc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 -- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcbc005200 msgr2=0x7fbcbc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcbc005200 0x7fbcbc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 -- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcbc0047d0 msgr2=0x7fbcbc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcbc0047d0 0x7fbcbc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd540d640 1 -- 172.21.15.52:0/411164764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc003530 con 0x7fbcbc0039f0 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd5c0e640 1 -- 172.21.15.52:0/411164764 reap_dead start 2023-09-30T16:49:20.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.991+0000 7fbcd4c0c640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcbc0047d0 0x7fbcbc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcbc003e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009ae0 tx=0x7fbccc01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b086cb8e013deec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0a64a0 con 0x7fbcbc0039f0 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc0a6600 con 0x7fbcbc0039f0 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcc7fff640 1 -- 172.21.15.52:0/411164764 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0a69b0 con 0x7fbcbc0039f0 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- 172.21.15.52:0/411164764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 msgr2=0x7fbcbc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcbc003e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009ae0 tx=0x7fbccc01c9b0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- 172.21.15.52:0/411164764 shutdown_connections 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 --2- 172.21.15.52:0/411164764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcbc003e10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- 172.21.15.52:0/411164764 >> 172.21.15.52:0/411164764 conn(0x7fbcd00b0b80 msgr2=0x7fbcd00b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- 172.21.15.52:0/411164764 shutdown_connections 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- 172.21.15.52:0/411164764 wait complete. 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 Processor -- start 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- start start 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcd014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcd00b1c70 0x7fbcd00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcd00b20f0 0x7fbcd00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00b2f60 con 0x7fbcbc0039f0 2023-09-30T16:49:20.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd015a8c0 con 0x7fbcd00b1c70 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd7671640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd015a590 con 0x7fbcd00b20f0 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcd014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcd014ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53902/0 (socket says 172.21.15.52:53902) 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 -- 172.21.15.52:0/3052458132 learned_addr learned my addr 172.21.15.52:0/3052458132 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd5c0e640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcd00b20f0 0x7fbcd00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd4c0c640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcd00b1c70 0x7fbcd00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 -- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcd00b20f0 msgr2=0x7fbcd00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcd00b20f0 0x7fbcd00ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 -- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcd00b1c70 msgr2=0x7fbcd00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcd00b1c70 0x7fbcd00ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd540d640 1 -- 172.21.15.52:0/3052458132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00b26c0 con 0x7fbcbc0039f0 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd5c0e640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcd00b20f0 0x7fbcd00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.995+0000 7fbcd4c0c640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcd00b1c70 0x7fbcd00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcd540d640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcd014ac90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009ae0 tx=0x7fbcbc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0a6ea0 con 0x7fbcbc0039f0 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc0a7480 con 0x7fbcbc0039f0 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd00b29a0 con 0x7fbcbc0039f0 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0a7810 con 0x7fbcbc0039f0 2023-09-30T16:49:20.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd0157f50 con 0x7fbcbc0039f0 2023-09-30T16:49:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd0158140 con 0x7fbcbc0039f0 2023-09-30T16:49:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fbccc0a7970 con 0x7fbcbc0039f0 2023-09-30T16:49:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcc5ffb640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbcb4066190 0x7fbcb4068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbccc11df40 con 0x7fbcbc0039f0 2023-09-30T16:49:20.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcd4c0c640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbcb4066190 0x7fbcb4068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:19.999+0000 7fbcd4c0c640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbcb4066190 0x7fbcb4068650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0157a90 tx=0x7fbcc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.003+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fbccc0eb560 con 0x7fbcbc0039f0 2023-09-30T16:49:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.159+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcd015a6d0 con 0x7fbcbc0039f0 2023-09-30T16:49:20.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcc5ffb640 1 -- 172.21.15.52:0/3052458132 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fbccc0eeb80 con 0x7fbcbc0039f0 2023-09-30T16:49:20.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:20.167 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbcb4066190 msgr2=0x7fbcb4068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbcb4066190 0x7fbcb4068650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0157a90 tx=0x7fbcc0009040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 msgr2=0x7fbcd014ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcd014ac90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009ae0 tx=0x7fbcbc005800 comp rx=0 tx=0).stop 2023-09-30T16:49:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 shutdown_connections 2023-09-30T16:49:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbcb4066190 0x7fbcb4068650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbcd00b20f0 0x7fbcd00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcd00b1c70 0x7fbcd00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 --2- 172.21.15.52:0/3052458132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcbc0039f0 0x7fbcd014ac90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 >> 172.21.15.52:0/3052458132 conn(0x7fbcd00b0b80 msgr2=0x7fbcd00c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 shutdown_connections 2023-09-30T16:49:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.163+0000 7fbcd7671640 1 -- 172.21.15.52:0/3052458132 wait complete. 2023-09-30T16:49:20.186 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T16:49:20.186 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:20.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 Processor -- start 2023-09-30T16:49:20.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 -- start start 2023-09-30T16:49:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fde0815a9d0 0x7fde0815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 0x7fde080b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080b0a30 con 0x7fde0806d650 2023-09-30T16:49:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0806c240 con 0x7fde0815a9d0 2023-09-30T16:49:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0ebeb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815adb0 con 0x7fde080b00a0 2023-09-30T16:49:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde07fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fde0806d650 0x7fde080b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39958/0 (socket says 172.21.15.52:39958) 2023-09-30T16:49:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde07fff640 1 -- 172.21.15.52:0/3348480336 learned_addr learned my addr 172.21.15.52:0/3348480336 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 0x7fde080b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0c987640 1 --2- 172.21.15.52:0/3348480336 >> v2:172.21.15.186:3300/0 conn(0x7fde0815a9d0 0x7fde0815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782072178 0 0) 0x7fddfc001120 con 0x7fde0806d650 2023-09-30T16:49:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003530 con 0x7fde0806d650 2023-09-30T16:49:20.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403879315 0 0) 0x7fddf0003530 con 0x7fde0806d650 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 msgr2=0x7fde080b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 0x7fde080b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 >> v2:172.21.15.186:3300/0 conn(0x7fde0815a9d0 msgr2=0x7fde0815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 --2- 172.21.15.52:0/3348480336 >> v2:172.21.15.186:3300/0 conn(0x7fde0815a9d0 0x7fde0815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0815ea90 con 0x7fde0806d650 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fddfc001830 con 0x7fde0806d650 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 >> v1:172.21.15.52:6789/0 conn(0x7fde0806d650 legacy=0x7fde080b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 0x7fddf00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddf0003fc0 0x7fddf00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fddf0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0806c240 con 0x7fddf0004d10 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815adb0 con 0x7fddf0003fc0 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000ba10 con 0x7fde080b00a0 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fddf0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 -- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 msgr2=0x7fddf00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080b00a0 0x7fddf00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 -- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddf0003fc0 msgr2=0x7fddf00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde07fff640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddf0003fc0 0x7fddf00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddf0003fc0 0x7fddf00047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.303+0000 7fde0d188640 1 -- 172.21.15.52:0/3348480336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003530 con 0x7fddf0004d10 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0d188640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fddf0005190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde00009fc0 tx=0x7fde0001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd7e7ce9c0a5c4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde000a5cb0 con 0x7fddf0004d10 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000f040 con 0x7fddf0004d10 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde077fe640 1 -- 172.21.15.52:0/3348480336 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde000ad680 con 0x7fddf0004d10 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- 172.21.15.52:0/3348480336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 msgr2=0x7fddf0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/3348480336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fddf0005190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde00009fc0 tx=0x7fde0001cca0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0d188640 1 -- 172.21.15.52:0/3348480336 reap_dead start 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- 172.21.15.52:0/3348480336 shutdown_connections 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- 172.21.15.52:0/3348480336 >> 172.21.15.52:0/3348480336 conn(0x7fde0806a5f0 msgr2=0x7fde080ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- 172.21.15.52:0/3348480336 shutdown_connections 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- 172.21.15.52:0/3348480336 wait complete. 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 Processor -- start 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- start start 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fde081f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080a7ec0 0x7fde0814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde0815b140 0x7fde0815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081f07b0 con 0x7fddf0004d10 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815bb00 con 0x7fde0815b140 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0ebeb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080c62d0 con 0x7fde080a7ec0 2023-09-30T16:49:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0c987640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fde081f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0c987640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fde081f4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53916/0 (socket says 172.21.15.52:53916) 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.307+0000 7fde0c987640 1 -- 172.21.15.52:0/267558925 learned_addr learned my addr 172.21.15.52:0/267558925 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0d188640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde0815b140 0x7fde0815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde07fff640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080a7ec0 0x7fde0814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0c987640 1 -- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080a7ec0 msgr2=0x7fde0814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0c987640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080a7ec0 0x7fde0814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0c987640 1 -- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde0815b140 msgr2=0x7fde0815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0c987640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde0815b140 0x7fde0815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0c987640 1 -- 172.21.15.52:0/267558925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080c6520 con 0x7fddf0004d10 2023-09-30T16:49:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0c987640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fde081f4830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddf800e7c0 tx=0x7fddf800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800eed0 con 0x7fddf0004d10 2023-09-30T16:49:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800c940 con 0x7fddf0004d10 2023-09-30T16:49:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800ccf0 con 0x7fddf0004d10 2023-09-30T16:49:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde080c6800 con 0x7fddf0004d10 2023-09-30T16:49:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde080c6dc0 con 0x7fddf0004d10 2023-09-30T16:49:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde080740a0 con 0x7fddf0004d10 2023-09-30T16:49:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fddf8013470 con 0x7fddf0004d10 2023-09-30T16:49:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde057fa640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fddf4066190 0x7fddf4068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddf8083a50 con 0x7fddf0004d10 2023-09-30T16:49:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde07fff640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fddf4066190 0x7fddf4068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.311+0000 7fde07fff640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fddf4066190 0x7fddf4068650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001960 tx=0x7fddfc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.315+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fddf8051100 con 0x7fddf0004d10 2023-09-30T16:49:20.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.467+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde080cf0e0 con 0x7fddf0004d10 2023-09-30T16:49:20.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde057fa640 1 -- 172.21.15.52:0/267558925 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fddf8054720 con 0x7fddf0004d10 2023-09-30T16:49:20.475 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:20.475 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fddf4066190 msgr2=0x7fddf4068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fddf4066190 0x7fddf4068650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001960 tx=0x7fddfc009040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 msgr2=0x7fde081f4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fde081f4830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddf800e7c0 tx=0x7fddf800ec80 comp rx=0 tx=0).stop 2023-09-30T16:49:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 shutdown_connections 2023-09-30T16:49:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fddf4066190 0x7fddf4068650 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde0815b140 0x7fde0815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde080a7ec0 0x7fde0814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 --2- 172.21.15.52:0/267558925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0004d10 0x7fde081f4830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 >> 172.21.15.52:0/267558925 conn(0x7fde0806a5f0 msgr2=0x7fde08159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 shutdown_connections 2023-09-30T16:49:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.471+0000 7fde0ebeb640 1 -- 172.21.15.52:0/267558925 wait complete. 2023-09-30T16:49:20.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T16:49:20.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T16:49:20.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T16:49:20.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T16:49:20.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-30T16:49:20.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-30T16:49:20.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-30T16:49:20.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-30T16:49:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 Processor -- start 2023-09-30T16:49:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 Processor -- start 2023-09-30T16:49:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 -- start start 2023-09-30T16:49:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa900033d10 0x7fa9000eb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900048200 0x7fa9000eb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa900047bd0 0x7fa900005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9000ec020 con 0x7fa900033d10 2023-09-30T16:49:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90004f200 con 0x7fa900047bd0 2023-09-30T16:49:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90c8ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90004f4e0 con 0x7fa900048200 2023-09-30T16:49:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 -- start start 2023-09-30T16:49:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efed4158b70 0x7efed415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed406c7d0 0x7efed40c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed4158f50 con 0x7efed4070520 2023-09-30T16:49:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed415d5a0 con 0x7efed4158b70 2023-09-30T16:49:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efedbd35640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40709a0 con 0x7efed406c7d0 2023-09-30T16:49:20.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa900033d10 0x7fa9000eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 Processor -- start 2023-09-30T16:49:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa900033d10 0x7fa9000eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53918/0 (socket says 172.21.15.52:53918) 2023-09-30T16:49:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 -- 172.21.15.52:0/3802804386 learned_addr learned my addr 172.21.15.52:0/3802804386 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa905d9b640 1 --2- 172.21.15.52:0/3802804386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900048200 0x7fa9000eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efeda2d2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed406c7d0 0x7efed40c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa906d9d640 1 --2- 172.21.15.52:0/3802804386 >> v2:172.21.15.186:3300/0 conn(0x7fa900047bd0 0x7fa900005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed9ad1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efed4158b70 0x7efed415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed9ad1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efed4158b70 0x7efed415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57414/0 (socket says 172.21.15.52:57414) 2023-09-30T16:49:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed92d0640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7efed4070520 0x7efed406c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:51040/0 (socket says 172.21.15.52:51040) 2023-09-30T16:49:20.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed92d0640 1 -- 172.21.15.52:0/522181899 learned_addr learned my addr 172.21.15.52:0/522181899 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 -- 172.21.15.52:0/3802804386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900048200 msgr2=0x7fa9000eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 --2- 172.21.15.52:0/3802804386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900048200 0x7fa9000eb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 -- 172.21.15.52:0/3802804386 >> v2:172.21.15.186:3300/0 conn(0x7fa900047bd0 msgr2=0x7fa900005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 --2- 172.21.15.52:0/3802804386 >> v2:172.21.15.186:3300/0 conn(0x7fa900047bd0 0x7fa900005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fa90659c640 1 -- 172.21.15.52:0/3802804386 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900054100 con 0x7fa900033d10 2023-09-30T16:49:20.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 -- start start 2023-09-30T16:49:20.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7f91a270c640 1 Processor -- start 2023-09-30T16:49:20.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7f4f42e17640 1 Processor -- start 2023-09-30T16:49:20.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc53c0cea50 0x7fc53c141d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc53c0659f0 0x7fc53c142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7f4f42e17640 1 -- start start 2023-09-30T16:49:20.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c06dfc0 con 0x7fc53c142bd0 2023-09-30T16:49:20.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c06e2a0 con 0x7fc53c0cea50 2023-09-30T16:49:20.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc5434ec640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c06e580 con 0x7fc53c0659f0 2023-09-30T16:49:20.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc541288640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc53c0cea50 0x7fc53c141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc541288640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc53c0cea50 0x7fc53c141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53928/0 (socket says 172.21.15.52:53928) 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc541a89640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc53c142bd0 0x7fc53c070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39968/0 (socket says 172.21.15.52:39968) 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7fc541288640 1 -- 172.21.15.52:0/825794067 learned_addr learned my addr 172.21.15.52:0/825794067 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fc540a87640 1 --2- 172.21.15.52:0/825794067 >> v2:172.21.15.186:3300/0 conn(0x7fc53c0659f0 0x7fc53c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed9ad1640 1 -- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed406c7d0 msgr2=0x7efed40c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed9ad1640 1 --2- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed406c7d0 0x7efed40c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed9ad1640 1 -- 172.21.15.52:0/522181899 >> v1:172.21.15.186:6789/0 conn(0x7efed4070520 legacy=0x7efed406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7efed9ad1640 1 -- 172.21.15.52:0/522181899 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4070c80 con 0x7efed4158b70 2023-09-30T16:49:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fc541288640 1 -- 172.21.15.52:0/825794067 >> v2:172.21.15.186:3300/0 conn(0x7fc53c0659f0 msgr2=0x7fc53c142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fc541288640 1 --2- 172.21.15.52:0/825794067 >> v2:172.21.15.186:3300/0 conn(0x7fc53c0659f0 0x7fc53c142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fc541288640 1 -- 172.21.15.52:0/825794067 >> v1:172.21.15.52:6789/0 conn(0x7fc53c142bd0 legacy=0x7fc53c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fc541288640 1 -- 172.21.15.52:0/825794067 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c06e860 con 0x7fc53c0cea50 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7f91a270c640 1 -- start start 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a270c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0ced00 0x7f919c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a270c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f919c0b4f50 0x7f919c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a270c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0cb700 con 0x7f919c159b70 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a270c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c0ce290 con 0x7f919c0b4f50 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a270c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c159f50 con 0x7f919c0ced00 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a0ca9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f919c0b4f50 0x7f919c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f919bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f919c159b70 0x7f919c0ce5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:51054/0 (socket says 172.21.15.52:51054) 2023-09-30T16:49:20.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f919bfff640 1 -- 172.21.15.52:0/622792326 learned_addr learned my addr 172.21.15.52:0/622792326 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf80cce640 1 Processor -- start 2023-09-30T16:49:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf80cce640 1 -- start start 2023-09-30T16:49:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a0ca9640 1 -- 172.21.15.52:0/622792326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0ced00 msgr2=0x7f919c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f919b7fe640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0ced00 0x7f919c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f42e17640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4f340df1f0 0x7f4f340e0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a0ca9640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0ced00 0x7f919c0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a0ca9640 1 -- 172.21.15.52:0/622792326 >> v1:172.21.15.186:6789/0 conn(0x7f919c159b70 legacy=0x7f919c0ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f91a0ca9640 1 -- 172.21.15.52:0/622792326 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c072020 con 0x7f919c0b4f50 2023-09-30T16:49:20.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f919b7fe640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0ced00 0x7f919c0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f42e17640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4f340e34a0 0x7f4f340060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f42e17640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f340e0760 con 0x7f4f34054100 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4f340df1f0 0x7f4f340e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fa90659c640 1 --2- 172.21.15.52:0/3802804386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900033d10 0x7fa9000eb150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009870 tx=0x7fa8f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07c3c2016b08378 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fa90559a640 1 -- 172.21.15.52:0/3802804386 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80ab600 con 0x7fa900033d10 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fa90559a640 1 -- 172.21.15.52:0/3802804386 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f80a7050 con 0x7fa900033d10 2023-09-30T16:49:20.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fa90559a640 1 -- 172.21.15.52:0/3802804386 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80ab980 con 0x7fa900033d10 2023-09-30T16:49:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7f7e2ee1b640 1 Processor -- start 2023-09-30T16:49:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.671+0000 7f7e2ee1b640 1 -- start start 2023-09-30T16:49:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2ee1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e2003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7efed9ad1640 1 --2- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed4158b70 0x7efed415d060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efec40097c0 tx=0x7efec401e630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3e3a522dd5118c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2ee1b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7e201048a0 0x7f7e20104d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2ee1b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e20005ff0 0x7f7e20006480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2ee1b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e20037be0 con 0x7f7e20005ff0 2023-09-30T16:49:20.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2ee1b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e20053150 con 0x7f7e201048a0 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2ee1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20105240 con 0x7f7e20100d10 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e20005ff0 0x7f7e20006480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7e20005ff0 0x7f7e20006480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53954/0 (socket says 172.21.15.52:53954) 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 -- 172.21.15.52:0/1296587830 learned_addr learned my addr 172.21.15.52:0/1296587830 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2de19640 1 --2- 172.21.15.52:0/1296587830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e2003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2d618640 1 --2- 172.21.15.52:0/1296587830 >> v2:172.21.15.186:3300/0 conn(0x7f7e201048a0 0x7f7e20104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 -- 172.21.15.52:0/1296587830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 msgr2=0x7f7e2003a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 --2- 172.21.15.52:0/1296587830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e2003a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 -- 172.21.15.52:0/1296587830 >> v2:172.21.15.186:3300/0 conn(0x7f7e201048a0 msgr2=0x7f7e20104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 --2- 172.21.15.52:0/1296587830 >> v2:172.21.15.186:3300/0 conn(0x7f7e201048a0 0x7f7e20104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f7e2e61a640 1 -- 172.21.15.52:0/1296587830 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20007470 con 0x7f7e20005ff0 2023-09-30T16:49:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4f340df1f0 0x7f4f340e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53956/0 (socket says 172.21.15.52:53956) 2023-09-30T16:49:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 -- 172.21.15.52:0/801923822 learned_addr learned my addr 172.21.15.52:0/801923822 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f44079640 1 --2- 172.21.15.52:0/801923822 >> v2:172.21.15.186:3300/0 conn(0x7f4f340e34a0 0x7f4f340060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f34052dc0 con 0x7f4f340df1f0 2023-09-30T16:49:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340df5d0 con 0x7f4f340e34a0 2023-09-30T16:49:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7efed8acf640 1 -- 172.21.15.52:0/522181899 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec40aa620 con 0x7efed4158b70 2023-09-30T16:49:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf80cce640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf740e7790 0x7fdf74007960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf80cce640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf74054440 con 0x7fdf740483d0 2023-09-30T16:49:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf80cce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740074d0 con 0x7fdf7404fd40 2023-09-30T16:49:20.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf80cce640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf74006ef0 con 0x7fdf740e7790 2023-09-30T16:49:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fc541288640 1 --2- 172.21.15.52:0/825794067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0cea50 0x7fc53c141d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc53400d150 tx=0x7fc53401f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb65e7e7f125ac2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf7b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf740e7790 0x7fdf74007960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf7b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf740e7790 0x7fdf74007960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57466/0 (socket says 172.21.15.52:57466) 2023-09-30T16:49:20.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fdf7b7fe640 1 -- 172.21.15.52:0/1614223718 learned_addr learned my addr 172.21.15.52:0/1614223718 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 -- 172.21.15.52:0/801923822 >> v2:172.21.15.186:3300/0 conn(0x7f4f340e34a0 msgr2=0x7f4f340060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 --2- 172.21.15.52:0/801923822 >> v2:172.21.15.186:3300/0 conn(0x7f4f340e34a0 0x7f4f340060b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 -- 172.21.15.52:0/801923822 >> v1:172.21.15.186:6789/0 conn(0x7f4f34054100 legacy=0x7f4f340e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7f4f41e15640 1 -- 172.21.15.52:0/801923822 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34053060 con 0x7f4f340df1f0 2023-09-30T16:49:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fa90c8ee640 1 -- 172.21.15.52:0/3802804386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900033d10 msgr2=0x7fa9000eb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/3802804386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900033d10 0x7fa9000eb150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009870 tx=0x7fa8f801c470 comp rx=0 tx=0).stop 2023-09-30T16:49:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7efed8acf640 1 -- 172.21.15.52:0/522181899 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec40aa780 con 0x7efed4158b70 2023-09-30T16:49:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.675+0000 7efed8acf640 1 -- 172.21.15.52:0/522181899 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec40aab10 con 0x7efed4158b70 2023-09-30T16:49:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed4158b70 msgr2=0x7efed415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 --2- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed4158b70 0x7efed415d060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efec40097c0 tx=0x7efec401e630 comp rx=0 tx=0).stop 2023-09-30T16:49:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc533fff640 1 -- 172.21.15.52:0/825794067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400b2d0 con 0x7fc53c0cea50 2023-09-30T16:49:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc533fff640 1 -- 172.21.15.52:0/825794067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53400b430 con 0x7fc53c0cea50 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- 172.21.15.52:0/3802804386 shutdown_connections 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/3802804386 >> v2:172.21.15.186:3300/0 conn(0x7fa900047bd0 0x7fa900005ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/3802804386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900048200 0x7fa9000eb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/3802804386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900033d10 0x7fa9000eb150 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- 172.21.15.52:0/3802804386 >> 172.21.15.52:0/3802804386 conn(0x7fa900054b10 msgr2=0x7fa900054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- 172.21.15.52:0/3802804386 shutdown_connections 2023-09-30T16:49:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- 172.21.15.52:0/3802804386 wait complete. 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 -- 172.21.15.52:0/825794067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0cea50 msgr2=0x7fc53c141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- 172.21.15.52:0/522181899 shutdown_connections 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 --2- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed406c7d0 0x7efed40c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 --2- 172.21.15.52:0/522181899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed4158b70 0x7efed415d060 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efec40097c0 tx=0x7efec401e630 comp rx=0 tx=0).stop 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- 172.21.15.52:0/522181899 >> 172.21.15.52:0/522181899 conn(0x7efed40ce4b0 msgr2=0x7efed40ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- 172.21.15.52:0/522181899 shutdown_connections 2023-09-30T16:49:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- 172.21.15.52:0/522181899 wait complete. 2023-09-30T16:49:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e96df640 1 Processor -- start 2023-09-30T16:49:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e96df640 1 -- start start 2023-09-30T16:49:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fdf7b7fe640 1 -- 172.21.15.52:0/1614223718 >> v1:172.21.15.186:6789/0 conn(0x7fdf7404fd40 legacy=0x7fdf74037ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T16:49:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fdf7b7fe640 1 -- 172.21.15.52:0/1614223718 >> v1:172.21.15.52:6789/0 conn(0x7fdf740483d0 legacy=0x7fdf7404f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fdf7b7fe640 1 -- 172.21.15.52:0/1614223718 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74054a50 con 0x7fdf740e7790 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc533fff640 1 -- 172.21.15.52:0/825794067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400b2d0 con 0x7fc53c0cea50 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 --2- 172.21.15.52:0/825794067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0cea50 0x7fc53c141d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc53400d150 tx=0x7fc53401f600 comp rx=0 tx=0).stop 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 -- 172.21.15.52:0/825794067 shutdown_connections 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 --2- 172.21.15.52:0/825794067 >> v2:172.21.15.186:3300/0 conn(0x7fc53c0659f0 0x7fc53c142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 --2- 172.21.15.52:0/825794067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0cea50 0x7fc53c141d90 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc53400d150 tx=0x7fc53401f600 comp rx=0 tx=0).stop 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 -- 172.21.15.52:0/825794067 >> 172.21.15.52:0/825794067 conn(0x7fc53c0cbb80 msgr2=0x7fc53c0cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 Processor -- start 2023-09-30T16:49:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e96df640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e96df640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40cc6d0 con 0x7f85e4158cc0 2023-09-30T16:49:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e96df640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e415d2a0 con 0x7f85e40c9c20 2023-09-30T16:49:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e96df640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c90c0 con 0x7f85e41588e0 2023-09-30T16:49:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 Processor -- start 2023-09-30T16:49:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 -- 172.21.15.52:0/825794067 shutdown_connections 2023-09-30T16:49:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- start start 2023-09-30T16:49:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f91a0ca9640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c0b4f50 0x7f919c0cbb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9194009d90 tx=0x7f919401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45d58df477989d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f7e2e61a640 1 --2- 172.21.15.52:0/1296587830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 0x7f7e20006480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007be0 tx=0x7f7e18027420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882cba4b404491e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f7e2ce17640 1 -- 172.21.15.52:0/1296587830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180b7600 con 0x7f7e20005ff0 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f7e2ce17640 1 -- 172.21.15.52:0/1296587830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e180b3050 con 0x7f7e20005ff0 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f7e2ce17640 1 -- 172.21.15.52:0/1296587830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180b7980 con 0x7f7e20005ff0 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa900033d10 0x7fa9000e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900047bd0 0x7fa9000391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900048200 0x7fa9000e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000d4e00 con 0x7fa900048200 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- start start 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed406c7d0 0x7efed40acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed4070520 0x7efed40b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efed40b3070 0x7efed40a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed41f99f0 con 0x7efed40b3070 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40b36a0 con 0x7efed406c7d0 2023-09-30T16:49:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efedbd35640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40b3980 con 0x7efed4070520 2023-09-30T16:49:20.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000d5290 con 0x7fa900033d10 2023-09-30T16:49:20.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fa90c8ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000d41f0 con 0x7fa900047bd0 2023-09-30T16:49:20.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efed9ad1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed406c7d0 0x7efed40acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efed9ad1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed406c7d0 0x7efed40acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57472/0 (socket says 172.21.15.52:57472) 2023-09-30T16:49:20.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efed92d0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed4070520 0x7efed40b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efed9ad1640 1 -- 172.21.15.52:0/1083786399 learned_addr learned my addr 172.21.15.52:0/1083786399 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fc5434ec640 1 -- 172.21.15.52:0/825794067 wait complete. 2023-09-30T16:49:20.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f919affd640 1 -- 172.21.15.52:0/622792326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940af600 con 0x7f919c0b4f50 2023-09-30T16:49:20.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f919affd640 1 -- 172.21.15.52:0/622792326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91940ab050 con 0x7f919c0b4f50 2023-09-30T16:49:20.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f919affd640 1 -- 172.21.15.52:0/622792326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940af980 con 0x7f919c0b4f50 2023-09-30T16:49:20.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7efeda2d2640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efed40b3070 0x7efed40a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f4f41e15640 1 --2- 172.21.15.52:0/801923822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f340e0220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e160 tx=0x7f4f3801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed66e99c4963ece server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e2ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e2ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46548/0 (socket says 172.21.15.52:46548) 2023-09-30T16:49:20.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e2ffd640 1 -- 172.21.15.52:0/3995379554 learned_addr learned my addr 172.21.15.52:0/3995379554 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e2ffd640 1 -- 172.21.15.52:0/3995379554 >> v1:172.21.15.186:6789/0 conn(0x7f85e40c9c20 legacy=0x7f85e415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e2ffd640 1 -- 172.21.15.52:0/3995379554 >> v1:172.21.15.52:6789/0 conn(0x7f85e4158cc0 legacy=0x7f85e40c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:20.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7f85e2ffd640 1 -- 172.21.15.52:0/3995379554 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40cc970 con 0x7f85e41588e0 2023-09-30T16:49:20.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.679+0000 7fdf7b7fe640 1 --2- 172.21.15.52:0/1614223718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf740e7790 0x7fdf74007960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009870 tx=0x7fdf6801c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1938e984e9f2eaf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f40e13640 1 -- 172.21.15.52:0/801923822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380aa630 con 0x7f4f340df1f0 2023-09-30T16:49:20.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f40e13640 1 -- 172.21.15.52:0/801923822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f380aa790 con 0x7f4f340df1f0 2023-09-30T16:49:20.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f40e13640 1 -- 172.21.15.52:0/801923822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380aab20 con 0x7f4f340df1f0 2023-09-30T16:49:20.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 Processor -- start 2023-09-30T16:49:20.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf7a7fc640 1 -- 172.21.15.52:0/1614223718 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf680ad640 con 0x7fdf740e7790 2023-09-30T16:49:20.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900048200 0x7fa9000e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa905d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900047bd0 0x7fa9000391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900048200 0x7fa9000e9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53970/0 (socket says 172.21.15.52:53970) 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa905d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900047bd0 0x7fa9000391f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46570/0 (socket says 172.21.15.52:46570) 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 -- 172.21.15.52:0/2231188804 learned_addr learned my addr 172.21.15.52:0/2231188804 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeda2d2640 1 -- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed4070520 msgr2=0x7efed40b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeda2d2640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efed4070520 0x7efed40b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeda2d2640 1 -- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed406c7d0 msgr2=0x7efed40acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeda2d2640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efed406c7d0 0x7efed40acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeda2d2640 1 -- 172.21.15.52:0/1083786399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009420 con 0x7efed40b3070 2023-09-30T16:49:20.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 -- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900047bd0 msgr2=0x7fa9000391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900047bd0 0x7fa9000391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 -- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa900033d10 msgr2=0x7fa9000e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa900033d10 0x7fa9000e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 -- 172.21.15.52:0/2231188804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80094d0 con 0x7fa900048200 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- 172.21.15.52:0/622792326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c0b4f50 msgr2=0x7f919c0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c0b4f50 0x7f919c0cbb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9194009d90 tx=0x7f919401f130 comp rx=0 tx=0).stop 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- 172.21.15.52:0/622792326 shutdown_connections 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c0b4f50 0x7f919c0cbb90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 --2- 172.21.15.52:0/622792326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0ced00 0x7f919c0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- 172.21.15.52:0/622792326 >> 172.21.15.52:0/622792326 conn(0x7f919c06d320 msgr2=0x7f919c06d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa906d9d640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900048200 0x7fa9000e9650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00e850 tx=0x7fa8fc00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- 172.21.15.52:0/622792326 shutdown_connections 2023-09-30T16:49:20.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 msgr2=0x7f4f340e0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 --2- 172.21.15.52:0/801923822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f340e0220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e160 tx=0x7f4f3801e6e0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00c940 con 0x7fa900048200 2023-09-30T16:49:20.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc00caa0 con 0x7fa900048200 2023-09-30T16:49:20.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00ce30 con 0x7fa900048200 2023-09-30T16:49:20.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeda2d2640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efed40b3070 0x7efed40a74d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efed40724a0 tx=0x7efecc00d600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf7a7fc640 1 -- 172.21.15.52:0/1614223718 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf680ad7a0 con 0x7fdf740e7790 2023-09-30T16:49:20.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf7a7fc640 1 -- 172.21.15.52:0/1614223718 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf680adb30 con 0x7fdf740e7790 2023-09-30T16:49:20.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf80cce640 1 -- 172.21.15.52:0/1614223718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf740e7790 msgr2=0x7fdf74007960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf80cce640 1 --2- 172.21.15.52:0/1614223718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf740e7790 0x7fdf74007960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009870 tx=0x7fdf6801c4c0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 -- start start 2023-09-30T16:49:20.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0659f0 0x7fc53c1312c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c142bd0 0x7fc53c13bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc013660 con 0x7efed40b3070 2023-09-30T16:49:20.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc0137c0 con 0x7efed40b3070 2023-09-30T16:49:20.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc013b50 con 0x7efed40b3070 2023-09-30T16:49:20.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed4143750 con 0x7efed40b3070 2023-09-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c1397d0 0x7fc53c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b3d00 con 0x7fc53c0659f0 2023-09-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c13c080 con 0x7fc53c1397d0 2023-09-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b33a0 con 0x7fc53c142bd0 2023-09-30T16:49:20.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4143d10 con 0x7efed40b3070 2023-09-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- 172.21.15.52:0/622792326 wait complete. 2023-09-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 shutdown_connections 2023-09-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 --2- 172.21.15.52:0/801923822 >> v2:172.21.15.186:3300/0 conn(0x7f4f340e34a0 0x7f4f340060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 --2- 172.21.15.52:0/801923822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f340e0220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 >> 172.21.15.52:0/801923822 conn(0x7f4f34054ce0 msgr2=0x7f4f340550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc540a87640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c142bd0 0x7fc53c13bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc540a87640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c142bd0 0x7fc53c13bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46572/0 (socket says 172.21.15.52:46572) 2023-09-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc540a87640 1 -- 172.21.15.52:0/1611951290 learned_addr learned my addr 172.21.15.52:0/1611951290 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c1397d0 0x7fc53c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 shutdown_connections 2023-09-30T16:49:20.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541288640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0659f0 0x7fc53c1312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f4f42e17640 1 -- 172.21.15.52:0/801923822 wait complete. 2023-09-30T16:49:20.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf80cce640 1 -- 172.21.15.52:0/1614223718 shutdown_connections 2023-09-30T16:49:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf80cce640 1 --2- 172.21.15.52:0/1614223718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf740e7790 0x7fdf74007960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fdf80cce640 1 -- 172.21.15.52:0/1614223718 >> 172.21.15.52:0/1614223718 conn(0x7fdf7400a560 msgr2=0x7fdf7400a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 Processor -- start 2023-09-30T16:49:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 -- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c142bd0 msgr2=0x7fc53c13bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c142bd0 0x7fc53c13bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 -- 172.21.15.52:0/1611951290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0659f0 msgr2=0x7fc53c1312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0659f0 0x7fc53c1312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 -- 172.21.15.52:0/1611951290 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53400bd40 con 0x7fc53c1397d0 2023-09-30T16:49:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541288640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c0659f0 0x7fc53c1312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:49:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f85e2ffd640 1 --2- 172.21.15.52:0/3995379554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40cd170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85dc007a60 tx=0x7f85dc0253b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1e1ab34860608a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/1296587830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 msgr2=0x7f7e20006480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/1296587830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 0x7f7e20006480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007be0 tx=0x7f7e18027420 comp rx=0 tx=0).stop 2023-09-30T16:49:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc541a89640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c1397d0 0x7fc53c0b4120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c3c0 tx=0x7fc53800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f85e1ffb640 1 -- 172.21.15.52:0/3995379554 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b5650 con 0x7f85e41588e0 2023-09-30T16:49:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f85e1ffb640 1 -- 172.21.15.52:0/3995379554 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0b57b0 con 0x7f85e41588e0 2023-09-30T16:49:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f85e1ffb640 1 -- 172.21.15.52:0/3995379554 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b5b80 con 0x7f85e41588e0 2023-09-30T16:49:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380074e0 con 0x7fc53c1397d0 2023-09-30T16:49:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538007640 con 0x7fc53c1397d0 2023-09-30T16:49:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538004a10 con 0x7fc53c1397d0 2023-09-30T16:49:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0c4140 con 0x7fc53c1397d0 2023-09-30T16:49:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0b3640 con 0x7fc53c1397d0 2023-09-30T16:49:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- start start 2023-09-30T16:49:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9000d44d0 con 0x7fa900048200 2023-09-30T16:49:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9000d4a90 con 0x7fa900048200 2023-09-30T16:49:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 Processor -- start 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0b4f50 0x7f919c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f919c0ced00 0x7f919c0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c159b70 0x7f919c151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c61c0 con 0x7f919c159b70 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c8df0 con 0x7f919c0ced00 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7f91a270c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c90d0 con 0x7f919c0b4f50 2023-09-30T16:49:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fdf80cce640 1 -- 172.21.15.52:0/1614223718 shutdown_connections 2023-09-30T16:49:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 -- 172.21.15.52:0/3995379554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 msgr2=0x7f85e40cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 --2- 172.21.15.52:0/3995379554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40cd170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85dc007a60 tx=0x7f85dc0253b0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0b4f50 0x7f919c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0b4f50 0x7f919c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46584/0 (socket says 172.21.15.52:46584) 2023-09-30T16:49:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 -- 172.21.15.52:0/4039434367 learned_addr learned my addr 172.21.15.52:0/4039434367 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 -- 172.21.15.52:0/3995379554 shutdown_connections 2023-09-30T16:49:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 --2- 172.21.15.52:0/3995379554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40cd170 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 -- 172.21.15.52:0/3995379554 >> 172.21.15.52:0/3995379554 conn(0x7f85e406a460 msgr2=0x7f85e40caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 -- 172.21.15.52:0/3995379554 shutdown_connections 2023-09-30T16:49:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 -- 172.21.15.52:0/3995379554 wait complete. 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 -- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f919c0ced00 msgr2=0x7f919c0b3770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f919c0ced00 0x7f919c0b3770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 -- 172.21.15.52:0/4039434367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c159b70 msgr2=0x7f919c151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c159b70 0x7f919c151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 -- 172.21.15.52:0/4039434367 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009a70 con 0x7f919c0b4f50 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f919bfff640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0b4f50 0x7f919c0b44e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c500 tx=0x7f918c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa900054830 con 0x7fa900048200 2023-09-30T16:49:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c005cf0 con 0x7f919c0b4f50 2023-09-30T16:49:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fc538004b70 con 0x7fc53c1397d0 2023-09-30T16:49:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc53c0c3fc0 con 0x7fc53c1397d0 2023-09-30T16:49:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c005e50 con 0x7f919c0b4f50 2023-09-30T16:49:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fdf80cce640 1 -- 172.21.15.52:0/1614223718 wait complete. 2023-09-30T16:49:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 -- start start 2023-09-30T16:49:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f91a270c640 1 -- 172.21.15.52:0/4039434367 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c0c93b0 con 0x7f919c0b4f50 2023-09-30T16:49:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f91a270c640 1 -- 172.21.15.52:0/4039434367 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c0b4a20 con 0x7f919c0b4f50 2023-09-30T16:49:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0072f0 con 0x7f919c0b4f50 2023-09-30T16:49:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc531ffb640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc520066160 0x7fc520068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 Processor -- start 2023-09-30T16:49:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f91a270c640 1 -- 172.21.15.52:0/4039434367 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f917c000fd0 con 0x7f919c0b4f50 2023-09-30T16:49:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5380832d0 con 0x7fc53c1397d0 2023-09-30T16:49:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc531ffb640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7fc52006e300 0x7fc520070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 --> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc520070dd0 con 0x7fc52006e300 2023-09-30T16:49:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc538050730 con 0x7fc53c1397d0 2023-09-30T16:49:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 -- start start 2023-09-30T16:49:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc541288640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc520066160 0x7fc520068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc540a87640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7fc52006e300 0x7fc520070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa8fc013470 con 0x7fa900048200 2023-09-30T16:49:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fdf80cce640 1 Processor -- start 2023-09-30T16:49:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fa8f6ffd640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa8e80661b0 0x7fa8e8068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.683+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7efecc013cb0 con 0x7efed40b3070 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efebc000fd0 con 0x7efed40b3070 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efeca7fc640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efeb8066190 0x7efeb8068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efecc084a80 con 0x7efed40b3070 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efeca7fc640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7efeb806e330 0x7efeb8070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 --> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efeb8070e00 con 0x7efeb806e330 2023-09-30T16:49:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efed92d0640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7efeb806e330 0x7efeb8070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efed9ad1640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efeb8066190 0x7efeb8068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7efed92d0640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7efeb806e330 0x7efeb8070750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fc540a87640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7fc52006e300 0x7fc520070720 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e40c9c20 0x7f85e4149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f85e96df640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fa90659c640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa8e80661b0 0x7fa8e8068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f34054100 0x7f4f340d6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f34049940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f340e34a0 0x7f4f340ddd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3404ac20 con 0x7f4f340df1f0 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340d6800 con 0x7f4f340e34a0 2023-09-30T16:49:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f42e17640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340d6ae0 con 0x7f4f34054100 2023-09-30T16:49:20.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f41e15640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f34054100 0x7f4f340d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f41e15640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f34054100 0x7f4f340d6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46598/0 (socket says 172.21.15.52:46598) 2023-09-30T16:49:20.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7f4f41e15640 1 -- 172.21.15.52:0/2978499328 learned_addr learned my addr 172.21.15.52:0/2978499328 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7efed9ad1640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efeb8066190 0x7efeb8068650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efec401e670 tx=0x7efec4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41614640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f34049940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e40c9c20 0x7f85e4149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e40c9c20 0x7f85e4149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53994/0 (socket says 172.21.15.52:53994) 2023-09-30T16:49:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f918c007450 con 0x7f919c0b4f50 2023-09-30T16:49:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41e15640 1 -- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f340e34a0 msgr2=0x7f4f340ddd30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T16:49:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41e15640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f340e34a0 0x7f4f340ddd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41e15640 1 -- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 msgr2=0x7f4f34049940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41e15640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f34049940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.687+0000 7fdf80cce640 1 -- start start 2023-09-30T16:49:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41e15640 1 -- 172.21.15.52:0/2978499328 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380094d0 con 0x7f4f34054100 2023-09-30T16:49:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf740483d0 0x7fdf74182dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7404fd40 0x7fdf74044cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf740e7790 0x7fdf74045bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74180010 con 0x7fdf740e7790 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7404dfa0 con 0x7fdf7404fd40 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7404e280 con 0x7fdf740483d0 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf740e7790 0x7fdf74045bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf740483d0 0x7fdf74182dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8fc054df0 con 0x7fa900048200 2023-09-30T16:49:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f4f41614640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f340df1f0 0x7f4f34049940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:20.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf740e7790 0x7fdf74045bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54008/0 (socket says 172.21.15.52:54008) 2023-09-30T16:49:20.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 -- 172.21.15.52:0/2625504744 learned_addr learned my addr 172.21.15.52:0/2625504744 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa8f6ffd640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fa8e806e3d0 0x7fa8e80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 --> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8e8070ea0 con 0x7fa8e806e3d0 2023-09-30T16:49:20.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8fc009630 con 0x7fa900048200 2023-09-30T16:49:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7affd640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7404fd40 0x7fdf74044cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e96df640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85e4158cc0 0x7f85e40ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e96df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c65e0 con 0x7f85e40c9c20 2023-09-30T16:49:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e96df640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e414a710 con 0x7f85e4158cc0 2023-09-30T16:49:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa905d9b640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fa8e806e3d0 0x7fa8e80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e96df640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e414a9f0 con 0x7f85e41588e0 2023-09-30T16:49:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 -- 172.21.15.52:0/1435107731 learned_addr learned my addr 172.21.15.52:0/1435107731 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 -- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf740483d0 msgr2=0x7fdf74182dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf740483d0 0x7fdf74182dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 -- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7404fd40 msgr2=0x7fdf74044cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7404fd40 0x7fdf74044cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 -- 172.21.15.52:0/2625504744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf680094d0 con 0x7fdf740e7790 2023-09-30T16:49:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa90659c640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa8e80661b0 0x7fa8e8068670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80ad000 tx=0x7fa8f8004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f9198ff9640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9188066190 0x7f9188068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f918c083710 con 0x7f919c0b4f50 2023-09-30T16:49:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa905d9b640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fa8e806e3d0 0x7fa8e80707f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e27fc640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f9198ff9640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f918806e330 0x7f9188070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 --> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9188070e00 con 0x7f918806e330 2023-09-30T16:49:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f918c083b60 con 0x7f919c0b4f50 2023-09-30T16:49:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e37fe640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85e4158cc0 0x7f85e40ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 -- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 msgr2=0x7f85e40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85e41588e0 0x7f85e40ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 -- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85e4158cc0 msgr2=0x7f85e40ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85e4158cc0 0x7f85e40ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 -- 172.21.15.52:0/1435107731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc007790 con 0x7f85e40c9c20 2023-09-30T16:49:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e37fe640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85e4158cc0 0x7f85e40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f919b7fe640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9188066190 0x7f9188068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f91a0ca9640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f918806e330 0x7f9188070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fc541288640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc520066160 0x7fc520068620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5340b0000 tx=0x7fc534004ac0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf7bfff640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf740e7790 0x7fdf74045bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c069360 tx=0x7fdf7c067180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f85e2ffd640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e40c9c20 0x7f85e4149d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0b7040 tx=0x7f85dc022150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== osd.4 v2:172.21.15.186:6800/2180915136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc520070dd0 con 0x7fc52006e300 2023-09-30T16:49:20.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== osd.3 v2:172.21.15.52:6809/2535336001 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa8e8070ea0 con 0x7fa8e806e3d0 2023-09-30T16:49:20.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== osd.5 v2:172.21.15.186:6808/3258999792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efeb8070e00 con 0x7efeb806e330 2023-09-30T16:49:20.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c08d070 con 0x7fdf740e7790 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/1296587830 shutdown_connections 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/1296587830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 0x7f7e20006480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/1296587830 >> v2:172.21.15.186:3300/0 conn(0x7f7e201048a0 0x7f7e20104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/1296587830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e2003a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/1296587830 >> 172.21.15.52:0/1296587830 conn(0x7f7e20054c20 msgr2=0x7f7e20055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/1296587830 shutdown_connections 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/1296587830 wait complete. 2023-09-30T16:49:20.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 Processor -- start 2023-09-30T16:49:20.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- start start 2023-09-30T16:49:20.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f91a0ca9640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f918806e330 0x7f9188070750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0723d0 con 0x7fdf740e7790 2023-09-30T16:49:20.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7404e560 con 0x7fdf740e7790 2023-09-30T16:49:20.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c073810 con 0x7fdf740e7790 2023-09-30T16:49:20.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf74183300 con 0x7fdf740e7790 2023-09-30T16:49:20.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf74054d30 con 0x7fdf740e7790 2023-09-30T16:49:20.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f41e15640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f34054100 0x7f4f340d6050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801c330 tx=0x7f4f3801b4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== osd.6 v2:172.21.15.186:6816/2219583678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9188070e00 con 0x7f918806e330 2023-09-30T16:49:20.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380bb430 con 0x7f4f34054100 2023-09-30T16:49:20.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f42e17640 1 -- 172.21.15.52:0/2978499328 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f340d6dc0 con 0x7f4f34054100 2023-09-30T16:49:20.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f380b6070 con 0x7f4f34054100 2023-09-30T16:49:20.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380bb790 con 0x7f4f34054100 2023-09-30T16:49:20.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f42e17640 1 -- 172.21.15.52:0/2978499328 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f340d7380 con 0x7f4f34054100 2023-09-30T16:49:20.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fdf7c073970 con 0x7fdf740e7790 2023-09-30T16:49:20.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf67fff640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf60066160 0x7fdf60068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf7b7fe640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf60066160 0x7fdf60068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f18000fd0 con 0x7f4f34054100 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 0x7f7e200fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e20032da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e201048a0 0x7f7e20034560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20049890 con 0x7f7e20005ff0 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20049400 con 0x7f7e201048a0 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.691+0000 7f7e2ee1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200487f0 con 0x7f7e20100d10 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e20032da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e20032da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46618/0 (socket says 172.21.15.52:46618) 2023-09-30T16:49:20.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 -- 172.21.15.52:0/3189562430 learned_addr learned my addr 172.21.15.52:0/3189562430 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 -- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e201048a0 msgr2=0x7f7e20034560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e201048a0 0x7f7e20034560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 -- 172.21.15.52:0/3189562430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 msgr2=0x7f7e200fe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e20005ff0 0x7f7e200fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 -- 172.21.15.52:0/3189562430 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1800c4d0 con 0x7f7e20100d10 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e2d618640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e20032da0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400e7f0 tx=0x7f7e2400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400c940 con 0x7f7e20100d10 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2400caa0 con 0x7f7e20100d10 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400ce10 con 0x7f7e20100d10 2023-09-30T16:49:20.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b5be0 con 0x7f85e40c9c20 2023-09-30T16:49:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0b5d40 con 0x7f85e40c9c20 2023-09-30T16:49:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc008280 con 0x7f85e40c9c20 2023-09-30T16:49:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf7c0ce410 con 0x7fdf740e7790 2023-09-30T16:49:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf67fff640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7fdf6006e270 0x7fdf60070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 --> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf60070d40 con 0x7fdf6006e270 2023-09-30T16:49:20.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf7c073c20 con 0x7fdf740e7790 2023-09-30T16:49:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf7b7fe640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf60066160 0x7fdf60068620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdf680af000 tx=0x7fdf68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf7affd640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7fdf6006e270 0x7fdf60070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7fdf7affd640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7fdf6006e270 0x7fdf60070690 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f4f380b8030 con 0x7f4f34054100 2023-09-30T16:49:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f327fc640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4f20066160 0x7f4f20068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.695+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f3811e1f0 con 0x7f4f34054100 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== osd.0 v2:172.21.15.52:6824/3968874267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdf60070d40 con 0x7fdf6006e270 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f85e96df640 1 -- 172.21.15.52:0/1435107731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e414acd0 con 0x7f85e40c9c20 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f85dc0b1030 con 0x7f85e40c9c20 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f85cb7fe640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85d0066160 0x7f85d0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f85e96df640 1 -- 172.21.15.52:0/1435107731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e414b290 con 0x7f85e40c9c20 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85e27fc640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85d0066160 0x7f85d0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85dc0fe0d0 con 0x7f85e40c9c20 2023-09-30T16:49:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85c97fa640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7f85bc0015f0 0x7f85bc003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85e27fc640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85d0066160 0x7f85d0068620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85e40c8a60 tx=0x7f85d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 --> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85bc006b50 con 0x7f85bc0015f0 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85e37fe640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7f85bc0015f0 0x7f85bc003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f327fc640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7f4f2006e300 0x7f4f20070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 --> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f20070dd0 con 0x7f4f2006e300 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f3811e5a0 con 0x7f4f34054100 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f44079640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7f4f2006e300 0x7f4f20070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f44079640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7f4f2006e300 0x7f4f20070720 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f41614640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4f20066160 0x7f4f20068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== osd.2 v2:172.21.15.52:6808/2011916612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4f20070dd0 con 0x7f4f2006e300 2023-09-30T16:49:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efecc052130 con 0x7efed40b3070 2023-09-30T16:49:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.699+0000 7f919b7fe640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9188066190 0x7f9188068650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f919c1f9620 tx=0x7f9190008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e20048ad0 con 0x7f7e20100d10 2023-09-30T16:49:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e20049090 con 0x7f7e20100d10 2023-09-30T16:49:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e20052de0 con 0x7f7e20100d10 2023-09-30T16:49:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85e37fe640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7f85bc0015f0 0x7f85bc003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== osd.1 v2:172.21.15.52:6800/2774169000 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f85bc006b50 con 0x7f85bc0015f0 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7e24024480 con 0x7f7e20100d10 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e1e7fc640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7e0c066160 0x7f7e0c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e24094fd0 con 0x7f7e20100d10 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e1e7fc640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7f7e0c06e300 0x7f7e0c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 --> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e0c070dd0 con 0x7f7e0c06e300 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e24095340 con 0x7f7e20100d10 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.703+0000 7f7e2de19640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7e0c066160 0x7f7e0c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.707+0000 7f7e2e61a640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7f7e0c06e300 0x7f7e0c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.707+0000 7f4f41614640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4f20066160 0x7f4f20068620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f340d8790 tx=0x7f4f2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.707+0000 7f7e2de19640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7e0c066160 0x7f7e0c068620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e280695a0 tx=0x7f7e2806d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.707+0000 7f7e2e61a640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7f7e0c06e300 0x7f7e0c070720 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.707+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== osd.7 v2:172.21.15.186:6817/1826627445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7e0c070dd0 con 0x7f7e0c06e300 2023-09-30T16:49:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.715+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 --> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc53c0712b0 con 0x7fc52006e300 2023-09-30T16:49:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc531ffb640 1 -- 172.21.15.52:0/1611951290 <== osd.4 v2:172.21.15.186:6800/2180915136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc52c009970 con 0x7fc52006e300 2023-09-30T16:49:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 --> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efebc002c80 con 0x7efeb806e330 2023-09-30T16:49:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91a270c640 1 -- 172.21.15.52:0/4039434367 --> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f917c002cc0 con 0x7f918806e330 2023-09-30T16:49:20.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7fc52006e300 msgr2=0x7fc520070720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7fc52006e300 0x7fc520070720 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc520066160 msgr2=0x7fc520068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc520066160 0x7fc520068620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5340b0000 tx=0x7fc534004ac0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c1397d0 msgr2=0x7fc53c0b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 --2- 172.21.15.52:0/1611951290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c1397d0 0x7fc53c0b4120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c3c0 tx=0x7fc53800c880 comp rx=0 tx=0).stop 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc541a89640 1 -- 172.21.15.52:0/1611951290 reap_dead start 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 shutdown_connections 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 >> 172.21.15.52:0/1611951290 conn(0x7fc53c0cbb80 msgr2=0x7fc53c0aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 shutdown_connections 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fc5434ec640 1 -- 172.21.15.52:0/1611951290 wait complete. 2023-09-30T16:49:20.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f9198ff9640 1 -- 172.21.15.52:0/4039434367 <== osd.6 v2:172.21.15.186:6816/2219583678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f917c002cc0 con 0x7f918806e330 2023-09-30T16:49:20.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 --> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa90003a8b0 con 0x7fa8e806e3d0 2023-09-30T16:49:20.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efeca7fc640 1 -- 172.21.15.52:0/1083786399 <== osd.5 v2:172.21.15.186:6808/3258999792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efebc002c80 con 0x7efeb806e330 2023-09-30T16:49:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7efeb806e330 msgr2=0x7efeb8070750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7efeb806e330 0x7efeb8070750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efeb8066190 msgr2=0x7efeb8068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efeb8066190 0x7efeb8068650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efec401e670 tx=0x7efec4008040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efed40b3070 msgr2=0x7efed40a74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 --2- 172.21.15.52:0/1083786399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efed40b3070 0x7efed40a74d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efed40724a0 tx=0x7efecc00d600 comp rx=0 tx=0).stop 2023-09-30T16:49:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa8f6ffd640 1 -- 172.21.15.52:0/2231188804 <== osd.3 v2:172.21.15.52:6809/2535336001 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa90003a8b0 con 0x7fa8e806e3d0 2023-09-30T16:49:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efeda2d2640 1 -- 172.21.15.52:0/1083786399 reap_dead start 2023-09-30T16:49:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f918806e330 msgr2=0x7f9188070750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91827fc640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f918806e330 0x7f9188070750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 shutdown_connections 2023-09-30T16:49:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 >> 172.21.15.52:0/1083786399 conn(0x7efed40ce4b0 msgr2=0x7efed415af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9188066190 msgr2=0x7f9188068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fa8e806e3d0 msgr2=0x7fa8e80707f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fa8e806e3d0 0x7fa8e80707f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91827fc640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9188066190 0x7f9188068650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f919c1f9620 tx=0x7f9190008040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa8e80661b0 msgr2=0x7fa8e8068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa8e80661b0 0x7fa8e8068670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80ad000 tx=0x7fa8f8004740 comp rx=0 tx=0).stop 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900048200 msgr2=0x7fa9000e9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 --2- 172.21.15.52:0/2231188804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa900048200 0x7fa9000e9650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00e850 tx=0x7fa8fc00ed10 comp rx=0 tx=0).stop 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa906d9d640 1 -- 172.21.15.52:0/2231188804 reap_dead start 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 shutdown_connections 2023-09-30T16:49:20.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 >> 172.21.15.52:0/2231188804 conn(0x7fa900054b10 msgr2=0x7fa900037210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0b4f50 msgr2=0x7f919c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91827fc640 1 --2- 172.21.15.52:0/4039434367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f919c0b4f50 0x7f919c0b44e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c500 tx=0x7f918c00c9c0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7f91a0ca9640 1 -- 172.21.15.52:0/4039434367 reap_dead start 2023-09-30T16:49:20.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 shutdown_connections 2023-09-30T16:49:20.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.719+0000 7fa90c8ee640 1 -- 172.21.15.52:0/2231188804 wait complete. 2023-09-30T16:49:20.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 shutdown_connections 2023-09-30T16:49:20.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7efedbd35640 1 -- 172.21.15.52:0/1083786399 wait complete. 2023-09-30T16:49:20.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 shutdown_connections 2023-09-30T16:49:20.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 >> 172.21.15.52:0/4039434367 conn(0x7f919c06d320 msgr2=0x7f919c0cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 shutdown_connections 2023-09-30T16:49:20.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7f91827fc640 1 -- 172.21.15.52:0/4039434367 wait complete. 2023-09-30T16:49:20.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.727+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 --> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf74180150 con 0x7fdf6006e270 2023-09-30T16:49:20.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7fdf67fff640 1 -- 172.21.15.52:0/2625504744 <== osd.0 v2:172.21.15.52:6824/3968874267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf74180150 con 0x7fdf6006e270 2023-09-30T16:49:20.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 --> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f18002cc0 con 0x7f4f2006e300 2023-09-30T16:49:20.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f327fc640 1 -- 172.21.15.52:0/2978499328 <== osd.2 v2:172.21.15.52:6808/2011916612 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f18002cc0 con 0x7f4f2006e300 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7f4f2006e300 msgr2=0x7f4f20070720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7f4f2006e300 0x7f4f20070720 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4f20066160 msgr2=0x7f4f20068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4f20066160 0x7f4f20068620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f340d8790 tx=0x7f4f2c009040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f34054100 msgr2=0x7f4f340d6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 --2- 172.21.15.52:0/2978499328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f34054100 0x7f4f340d6050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801c330 tx=0x7f4f3801b4a0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f44079640 1 -- 172.21.15.52:0/2978499328 reap_dead start 2023-09-30T16:49:20.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 shutdown_connections 2023-09-30T16:49:20.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 >> 172.21.15.52:0/2978499328 conn(0x7f4f34054ce0 msgr2=0x7f4f340db6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 shutdown_connections 2023-09-30T16:49:20.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.731+0000 7f4f1ffff640 1 -- 172.21.15.52:0/2978499328 wait complete. 2023-09-30T16:49:20.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7fdf6006e270 msgr2=0x7fdf60070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7fdf6006e270 0x7fdf60070690 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf60066160 msgr2=0x7fdf60068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf60066160 0x7fdf60068620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdf680af000 tx=0x7fdf68008040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf740e7790 msgr2=0x7fdf74045bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 --2- 172.21.15.52:0/2625504744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf740e7790 0x7fdf74045bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c069360 tx=0x7fdf7c067180 comp rx=0 tx=0).stop 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf7bfff640 1 -- 172.21.15.52:0/2625504744 reap_dead start 2023-09-30T16:49:20.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 --> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85bc005c30 con 0x7f85bc0015f0 2023-09-30T16:49:20.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 shutdown_connections 2023-09-30T16:49:20.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 >> 172.21.15.52:0/2625504744 conn(0x7fdf7400a560 msgr2=0x7fdf740389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 shutdown_connections 2023-09-30T16:49:20.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7fdf80cce640 1 -- 172.21.15.52:0/2625504744 wait complete. 2023-09-30T16:49:20.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f85cb7fe640 1 -- 172.21.15.52:0/1435107731 <== osd.1 v2:172.21.15.52:6800/2774169000 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85bc005c30 con 0x7f85bc0015f0 2023-09-30T16:49:20.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 --> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e20007750 con 0x7f7e0c06e300 2023-09-30T16:49:20.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e1e7fc640 1 -- 172.21.15.52:0/3189562430 <== osd.7 v2:172.21.15.186:6817/1826627445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e18004040 con 0x7f7e0c06e300 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7f7e0c06e300 msgr2=0x7f7e0c070720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7f7e0c06e300 0x7f7e0c070720 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7e0c066160 msgr2=0x7f7e0c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7e0c066160 0x7f7e0c068620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e280695a0 tx=0x7f7e2806d040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.735+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 msgr2=0x7f7e20032da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.739+0000 7f7e2ee1b640 1 --2- 172.21.15.52:0/3189562430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e20100d10 0x7f7e20032da0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400e7f0 tx=0x7f7e2400ecb0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.739+0000 7f7e2e61a640 1 -- 172.21.15.52:0/3189562430 reap_dead start 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.739+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 shutdown_connections 2023-09-30T16:49:20.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.739+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 >> 172.21.15.52:0/3189562430 conn(0x7f7e20054c20 msgr2=0x7f7e200535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7f85bc0015f0 msgr2=0x7f85bc003ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7f85bc0015f0 0x7f85bc003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85d0066160 msgr2=0x7f85d0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85d0066160 0x7f85d0068620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85e40c8a60 tx=0x7f85d4008040 comp rx=0 tx=0).stop 2023-09-30T16:49:20.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e40c9c20 msgr2=0x7f85e4149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 --2- 172.21.15.52:0/1435107731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e40c9c20 0x7f85e4149d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0b7040 tx=0x7f85dc022150 comp rx=0 tx=0).stop 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85e37fe640 1 -- 172.21.15.52:0/1435107731 reap_dead start 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 shutdown_connections 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 >> 172.21.15.52:0/1435107731 conn(0x7f85e406a460 msgr2=0x7f85e4152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 shutdown_connections 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.743+0000 7f85c97fa640 1 -- 172.21.15.52:0/1435107731 wait complete. 2023-09-30T16:49:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.751+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 shutdown_connections 2023-09-30T16:49:20.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:20.751+0000 7f7e2ee1b640 1 -- 172.21.15.52:0/3189562430 wait complete. 2023-09-30T16:49:20.791 INFO:teuthology.orchestra.run.smithi052.stdout:60129542152 2023-09-30T16:49:20.792 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-30T16:49:20.793 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:20.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-30T16:49:20.794 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2023-09-30T16:49:20.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-30T16:49:20.795 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-09-30T16:49:20.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T16:49:20.796 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2023-09-30T16:49:20.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T16:49:20.797 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:20.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T16:49:20.798 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-09-30T16:49:20.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T16:49:20.799 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:20.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-30T16:49:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155bfff640 1 Processor -- start 2023-09-30T16:49:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155bfff640 1 -- start start 2023-09-30T16:49:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 Processor -- start 2023-09-30T16:49:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f940a771640 1 Processor -- start 2023-09-30T16:49:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce2759e640 1 Processor -- start 2023-09-30T16:49:21.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 Processor -- start 2023-09-30T16:49:21.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 -- start start 2023-09-30T16:49:21.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 Processor -- start 2023-09-30T16:49:21.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f940a771640 1 -- start start 2023-09-30T16:49:21.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 Processor -- start 2023-09-30T16:49:21.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 -- start start 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 -- start start 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2bb8158b70 0x7f2bb815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb8070520 0x7f2bb806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb8158f50 con 0x7f2bb806c600 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb815d5a0 con 0x7f2bb8158b70 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bbe144640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb806ca70 con 0x7f2bb8070520 2023-09-30T16:49:21.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce2759e640 1 -- start start 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce2759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280cb650 0x7fce280b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce2759e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280c9aa0 con 0x7fce280c1a70 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce2759e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce28165010 con 0x7fce280c1690 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce2759e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c94e0 con 0x7fce280cb650 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce1ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fce280c1a70 0x7fce280caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40014/0 (socket says 172.21.15.52:40014) 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fce1ffff640 1 -- 172.21.15.52:0/1378340855 learned_addr learned my addr 172.21.15.52:0/1378340855 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15540e7130 0x7f1554058220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155bfff640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155403c060 con 0x7f15540e6cd0 2023-09-30T16:49:21.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155bfff640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15540573a0 con 0x7f15540e6650 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155bfff640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1554007000 con 0x7f15540e7130 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155a7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f15540e6cd0 0x7f1554057b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39998/0 (socket says 172.21.15.52:39998) 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f155a7fc640 1 -- 172.21.15.52:0/2847892167 learned_addr learned my addr 172.21.15.52:0/2847892167 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065304640 0 0) 0x7f155403c060 con 0x7f15540e6cd0 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003530 con 0x7f15540e6cd0 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f994ffff640 1 Processor -- start 2023-09-30T16:49:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 -- start start 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e4c033e20 0x7f3e4c0eb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3e4c047ce0 0x7f3e4c052ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0ebeb0 con 0x7f3e4c048310 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ec130 con 0x7f3e4c033e20 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e598cb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c04f310 con 0x7f3e4c047ce0 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e588c9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e4c033e20 0x7f3e4c0eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0fd40c9c30 0x7f0fd40659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0fd4071040 0x7f0fd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40ca010 con 0x7f0fd406a3c0 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd406b7d0 con 0x7f0fd4071040 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd89d3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd41596c0 con 0x7f0fd40c9c30 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd37fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0fd40c9c30 0x7f0fd40659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f940a771640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93fc033d10 0x7f93fc0eb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f940a771640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc0ebda0 con 0x7f93fc048200 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f940a771640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc0ec020 con 0x7f93fc047bd0 2023-09-30T16:49:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f940a771640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc04f200 con 0x7f93fc033d10 2023-09-30T16:49:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f94037fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f93fc048200 0x7f93fc0eb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40008/0 (socket says 172.21.15.52:40008) 2023-09-30T16:49:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f94037fe640 1 -- 172.21.15.52:0/2156446371 learned_addr learned my addr 172.21.15.52:0/2156446371 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f9403fff640 1 --2- 172.21.15.52:0/2156446371 >> v2:172.21.15.52:3300/0 conn(0x7f93fc033d10 0x7f93fc0eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175692333 0 0) 0x7f15540573a0 con 0x7f15540e6650 2023-09-30T16:49:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155403c060 con 0x7f15540e6650 2023-09-30T16:49:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e588c9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e4c033e20 0x7f3e4c0eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54048/0 (socket says 172.21.15.52:54048) 2023-09-30T16:49:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f3e588c9640 1 -- 172.21.15.52:0/2513795431 learned_addr learned my addr 172.21.15.52:0/2513795431 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd37fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0fd40c9c30 0x7f0fd40659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57532/0 (socket says 172.21.15.52:57532) 2023-09-30T16:49:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd37fe640 1 -- 172.21.15.52:0/3722003690 learned_addr learned my addr 172.21.15.52:0/3722003690 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bb7fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f2bb806c600 0x7f2bb806d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:51112/0 (socket says 172.21.15.52:51112) 2023-09-30T16:49:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f2bb7fff640 1 -- 172.21.15.52:0/2075057391 learned_addr learned my addr 172.21.15.52:0/2075057391 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:21.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7f0fd3fff640 1 --2- 172.21.15.52:0/3722003690 >> v2:172.21.15.52:3300/0 conn(0x7f0fd4071040 0x7f0fd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb6ffd640 1 --2- 172.21.15.52:0/2075057391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb8070520 0x7f2bb806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fce26d9d640 1 --2- 172.21.15.52:0/1378340855 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280cb650 0x7fce280b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc53c06c550 0x7fc53c0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c0cbc90 con 0x7fc53c15e870 2023-09-30T16:49:21.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c162130 con 0x7fc53c06c550 2023-09-30T16:49:21.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.002+0000 7fc53b59e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1614b0 con 0x7fc53c0cb820 2023-09-30T16:49:21.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb77fe640 1 --2- 172.21.15.52:0/2075057391 >> v2:172.21.15.186:3300/0 conn(0x7f2bb8158b70 0x7f2bb815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994ffff640 1 -- start start 2023-09-30T16:49:21.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc53a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc53c15e870 0x7fc53c070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40020/0 (socket says 172.21.15.52:40020) 2023-09-30T16:49:21.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc53a59c640 1 -- 172.21.15.52:0/2991664522 learned_addr learned my addr 172.21.15.52:0/2991664522 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:21.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f3e590ca640 1 --2- 172.21.15.52:0/2513795431 >> v2:172.21.15.186:3300/0 conn(0x7f3e4c047ce0 0x7f3e4c052ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc53ad9d640 1 --2- 172.21.15.52:0/2991664522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fce25d9b640 1 -- 172.21.15.52:0/1378340855 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835403212 0 0) 0x7fce18001120 con 0x7fce280c1a70 2023-09-30T16:49:21.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fce25d9b640 1 -- 172.21.15.52:0/1378340855 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce14003530 con 0x7fce280c1a70 2023-09-30T16:49:21.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f0fd37fe640 1 -- 172.21.15.52:0/3722003690 >> v2:172.21.15.52:3300/0 conn(0x7f0fd4071040 msgr2=0x7f0fd406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f0fd37fe640 1 --2- 172.21.15.52:0/3722003690 >> v2:172.21.15.52:3300/0 conn(0x7f0fd4071040 0x7f0fd406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f0fd37fe640 1 -- 172.21.15.52:0/3722003690 >> v1:172.21.15.186:6789/0 conn(0x7f0fd406a3c0 legacy=0x7f0fd4070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f9403fff640 1 -- 172.21.15.52:0/2156446371 >> v1:172.21.15.186:6789/0 conn(0x7f93fc047bd0 legacy=0x7f93fc052ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f9403fff640 1 -- 172.21.15.52:0/2156446371 >> v1:172.21.15.52:6789/0 conn(0x7f93fc048200 legacy=0x7f93fc0eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f9403fff640 1 -- 172.21.15.52:0/2156446371 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc04f4e0 con 0x7f93fc033d10 2023-09-30T16:49:21.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 --2- 172.21.15.52:0/2847892167 >> v2:172.21.15.52:3300/0 conn(0x7f15540e7130 0x7f1554058220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb67fc640 1 -- 172.21.15.52:0/2075057391 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732788510 0 0) 0x7f2bb8158f50 con 0x7f2bb806c600 2023-09-30T16:49:21.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb67fc640 1 -- 172.21.15.52:0/2075057391 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba0003450 con 0x7f2bb806c600 2023-09-30T16:49:21.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202260304 0 0) 0x7f155403c060 con 0x7f15540e6650 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 >> v2:172.21.15.52:3300/0 conn(0x7f15540e7130 msgr2=0x7f1554058220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 --2- 172.21.15.52:0/2847892167 >> v2:172.21.15.52:3300/0 conn(0x7f15540e7130 0x7f1554058220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 >> v1:172.21.15.52:6789/0 conn(0x7f15540e6cd0 legacy=0x7f1554057b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554057680 con 0x7f15540e6650 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f1550001680 con 0x7f15540e6650 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 >> v1:172.21.15.186:6789/0 conn(0x7f15540e6650 legacy=0x7f155403e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1544004bc0 0x7f1544004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1544003770 0x7f1544003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15440141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1554007000 con 0x7f1544003770 2023-09-30T16:49:21.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15440148d0 con 0x7f15440041a0 2023-09-30T16:49:21.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1544014a90 con 0x7f1544004bc0 2023-09-30T16:49:21.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2075057391 >> v2:172.21.15.186:3300/0 conn(0x7f2bb8158b70 msgr2=0x7f2bb815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb6ffd640 1 --2- 172.21.15.52:0/2075057391 >> v2:172.21.15.186:3300/0 conn(0x7f2bb8158b70 0x7f2bb815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2075057391 >> v1:172.21.15.186:6789/0 conn(0x7f2bb806c600 legacy=0x7f2bb806d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2075057391 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80709a0 con 0x7f2bb8070520 2023-09-30T16:49:21.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc539d9b640 1 --2- 172.21.15.52:0/2991664522 >> v2:172.21.15.52:3300/0 conn(0x7fc53c06c550 0x7fc53c0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15440141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155affd640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1544004bc0 0x7f1544004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155a7fc640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1544003770 0x7f1544003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc539d9b640 1 -- 172.21.15.52:0/2991664522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 msgr2=0x7fc53c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc539d9b640 1 --2- 172.21.15.52:0/2991664522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc539d9b640 1 -- 172.21.15.52:0/2991664522 >> v1:172.21.15.52:6789/0 conn(0x7fc53c15e870 legacy=0x7fc53c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fc539d9b640 1 -- 172.21.15.52:0/2991664522 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c161790 con 0x7fc53c06c550 2023-09-30T16:49:21.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f0fd37fe640 1 -- 172.21.15.52:0/3722003690 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd406af30 con 0x7f0fd40c9c30 2023-09-30T16:49:21.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994ffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99480df5e0 0x7f99480542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f994803aee0 0x7f9948050140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 -- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1544004bc0 msgr2=0x7f1544004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1544004bc0 0x7f1544004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 -- 172.21.15.52:0/2847892167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1544003770 msgr2=0x7f1544003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1544003770 0x7f1544003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f155b7fe640 1 -- 172.21.15.52:0/2847892167 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155403c060 con 0x7f15440041a0 2023-09-30T16:49:21.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994ffff640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9948038510 con 0x7f9948050680 2023-09-30T16:49:21.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99480df5e0 0x7f99480542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99480df5e0 0x7f99480542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57562/0 (socket says 172.21.15.52:57562) 2023-09-30T16:49:21.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 -- 172.21.15.52:0/3985033560 learned_addr learned my addr 172.21.15.52:0/3985033560 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9948055210 con 0x7f994803aee0 2023-09-30T16:49:21.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9948050ab0 con 0x7f99480df5e0 2023-09-30T16:49:21.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f3e588c9640 1 -- 172.21.15.52:0/2513795431 >> v2:172.21.15.186:3300/0 conn(0x7f3e4c047ce0 msgr2=0x7f3e4c052ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f3e588c9640 1 --2- 172.21.15.52:0/2513795431 >> v2:172.21.15.186:3300/0 conn(0x7f3e4c047ce0 0x7f3e4c052ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f3e588c9640 1 -- 172.21.15.52:0/2513795431 >> v1:172.21.15.186:6789/0 conn(0x7f3e4c048310 legacy=0x7f3e4c0eb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f3e588c9640 1 -- 172.21.15.52:0/2513795431 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c04f5f0 con 0x7f3e4c033e20 2023-09-30T16:49:21.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 -- 172.21.15.52:0/3985033560 >> v2:172.21.15.52:3300/0 conn(0x7f994803aee0 msgr2=0x7f9948050140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T16:49:21.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fce26d9d640 1 -- 172.21.15.52:0/1378340855 >> v1:172.21.15.186:6789/0 conn(0x7fce280c1690 legacy=0x7fce281654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fce26d9d640 1 -- 172.21.15.52:0/1378340855 >> v1:172.21.15.52:6789/0 conn(0x7fce280c1a70 legacy=0x7fce280caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7fce26d9d640 1 -- 172.21.15.52:0/1378340855 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280c97c0 con 0x7fce280cb650 2023-09-30T16:49:21.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 --2- 172.21.15.52:0/3985033560 >> v2:172.21.15.52:3300/0 conn(0x7f994803aee0 0x7f9948050140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 -- 172.21.15.52:0/3985033560 >> v1:172.21.15.52:6789/0 conn(0x7f9948050680 legacy=0x7f99480e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:21.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.006+0000 7f994effd640 1 -- 172.21.15.52:0/3985033560 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948054970 con 0x7f99480df5e0 2023-09-30T16:49:21.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f9403fff640 1 --2- 172.21.15.52:0/2156446371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc033d10 0x7f93fc0eb150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f940402cb10 tx=0x7f9404096370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3383bccacdb12bd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bb6ffd640 1 --2- 172.21.15.52:0/2075057391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb8070520 0x7f2bb806c0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009d90 tx=0x7f2bb001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1deef2026ce99c94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd37fe640 1 --2- 172.21.15.52:0/3722003690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd40c9c30 0x7f0fd40659f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40cfa30 tx=0x7f0fc401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff73801771f2e575 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce26d9d640 1 --2- 172.21.15.52:0/1378340855 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280cb650 0x7fce280b09e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce20009dc0 tx=0x7fce2001c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef1fc44460c67e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bb67fc640 1 -- 172.21.15.52:0/2075057391 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00a59e0 con 0x7f2bb8070520 2023-09-30T16:49:21.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f9402ffd640 1 -- 172.21.15.52:0/2156446371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404125600 con 0x7f93fc033d10 2023-09-30T16:49:21.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f9402ffd640 1 -- 172.21.15.52:0/2156446371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404121050 con 0x7f93fc033d10 2023-09-30T16:49:21.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f9402ffd640 1 -- 172.21.15.52:0/2156446371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404125960 con 0x7f93fc033d10 2023-09-30T16:49:21.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bb67fc640 1 -- 172.21.15.52:0/2075057391 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00a5b40 con 0x7f2bb8070520 2023-09-30T16:49:21.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bb67fc640 1 -- 172.21.15.52:0/2075057391 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00ad440 con 0x7f2bb8070520 2023-09-30T16:49:21.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce25d9b640 1 -- 172.21.15.52:0/1378340855 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200a6660 con 0x7fce280cb650 2023-09-30T16:49:21.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f155b7fe640 1 -- 172.21.15.52:0/2847892167 reap_dead start 2023-09-30T16:49:21.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc539d9b640 1 --2- 172.21.15.52:0/2991664522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c0cb2e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0097c0 tx=0x7fc52c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2c160daa0b5dd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce25d9b640 1 -- 172.21.15.52:0/1378340855 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce200a67c0 con 0x7fce280cb650 2023-09-30T16:49:21.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce25d9b640 1 -- 172.21.15.52:0/1378340855 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200a6b30 con 0x7fce280cb650 2023-09-30T16:49:21.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f155b7fe640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15440141a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f155c000b70 tx=0x7f155c096730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7492c4314cd3caa1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd27fc640 1 -- 172.21.15.52:0/3722003690 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40a89f0 con 0x7f0fd40c9c30 2023-09-30T16:49:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd27fc640 1 -- 172.21.15.52:0/3722003690 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40a8b50 con 0x7f0fd40c9c30 2023-09-30T16:49:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd27fc640 1 -- 172.21.15.52:0/3722003690 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b0440 con 0x7f0fd40c9c30 2023-09-30T16:49:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c127610 con 0x7f15440041a0 2023-09-30T16:49:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c121070 con 0x7f15440041a0 2023-09-30T16:49:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f1559ffb640 1 -- 172.21.15.52:0/2847892167 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c127970 con 0x7f15440041a0 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 -- 172.21.15.52:0/2075057391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb8070520 msgr2=0x7f2bb806c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 --2- 172.21.15.52:0/2075057391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb8070520 0x7f2bb806c0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009d90 tx=0x7f2bb001c920 comp rx=0 tx=0).stop 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 -- 172.21.15.52:0/2075057391 shutdown_connections 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 --2- 172.21.15.52:0/2075057391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb8070520 0x7f2bb806c0c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 --2- 172.21.15.52:0/2075057391 >> v2:172.21.15.186:3300/0 conn(0x7f2bb8158b70 0x7f2bb815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 -- 172.21.15.52:0/2075057391 >> 172.21.15.52:0/2075057391 conn(0x7f2bb80ce4b0 msgr2=0x7f2bb80ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 -- 172.21.15.52:0/2075057391 shutdown_connections 2023-09-30T16:49:21.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f2bbe144640 1 -- 172.21.15.52:0/2075057391 wait complete. 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 -- 172.21.15.52:0/1378340855 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280cb650 msgr2=0x7fce280b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 --2- 172.21.15.52:0/1378340855 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280cb650 0x7fce280b09e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce20009dc0 tx=0x7fce2001c790 comp rx=0 tx=0).stop 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 -- 172.21.15.52:0/1378340855 shutdown_connections 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 --2- 172.21.15.52:0/1378340855 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280cb650 0x7fce280b09e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 -- 172.21.15.52:0/1378340855 >> 172.21.15.52:0/1378340855 conn(0x7fce2806a400 msgr2=0x7fce2806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 -- 172.21.15.52:0/1378340855 shutdown_connections 2023-09-30T16:49:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fce2759e640 1 -- 172.21.15.52:0/1378340855 wait complete. 2023-09-30T16:49:21.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f155bfff640 1 -- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 msgr2=0x7f15440141a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f155bfff640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15440141a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f155c000b70 tx=0x7f155c096730 comp rx=0 tx=0).stop 2023-09-30T16:49:21.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f994effd640 1 --2- 172.21.15.52:0/3985033560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99480df5e0 0x7f99480542a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f994800b950 tx=0x7f994401d880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a504a0a1119d7b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e588c9640 1 --2- 172.21.15.52:0/2513795431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0eb260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c5e0 tx=0x7f3e4001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7c539464b8fc93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e537fe640 1 -- 172.21.15.52:0/2513795431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400ab600 con 0x7f3e4c033e20 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e537fe640 1 -- 172.21.15.52:0/2513795431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e400a7050 con 0x7f3e4c033e20 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e537fe640 1 -- 172.21.15.52:0/2513795431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400ab980 con 0x7f3e4c033e20 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53959a640 1 -- 172.21.15.52:0/2991664522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0ab650 con 0x7fc53c06c550 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53959a640 1 -- 172.21.15.52:0/2991664522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c0ab7b0 con 0x7fc53c06c550 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53959a640 1 -- 172.21.15.52:0/2991664522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0abb40 con 0x7fc53c06c550 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 -- 172.21.15.52:0/3722003690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd40c9c30 msgr2=0x7f0fd40659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/3722003690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd40c9c30 0x7f0fd40659f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40cfa30 tx=0x7f0fc401ed10 comp rx=0 tx=0).stop 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 -- 172.21.15.52:0/3722003690 shutdown_connections 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/3722003690 >> v2:172.21.15.52:3300/0 conn(0x7f0fd4071040 0x7f0fd406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/3722003690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd40c9c30 0x7f0fd40659f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 -- 172.21.15.52:0/3722003690 >> 172.21.15.52:0/3722003690 conn(0x7f0fd40ced80 msgr2=0x7f0fd40cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 -- 172.21.15.52:0/2156446371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc033d10 msgr2=0x7f93fc0eb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 --2- 172.21.15.52:0/2156446371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc033d10 0x7f93fc0eb150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f940402cb10 tx=0x7f9404096370 comp rx=0 tx=0).stop 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 -- 172.21.15.52:0/2156446371 shutdown_connections 2023-09-30T16:49:21.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 --2- 172.21.15.52:0/2156446371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc033d10 0x7f93fc0eb150 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f940402cb10 tx=0x7f9404096370 comp rx=0 tx=0).stop 2023-09-30T16:49:21.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 -- 172.21.15.52:0/2156446371 >> 172.21.15.52:0/2156446371 conn(0x7f93fc054b10 msgr2=0x7f93fc054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 -- 172.21.15.52:0/3722003690 shutdown_connections 2023-09-30T16:49:21.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 -- 172.21.15.52:0/2991664522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 msgr2=0x7fc53c0cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 --2- 172.21.15.52:0/2991664522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c0cb2e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0097c0 tx=0x7fc52c01c470 comp rx=0 tx=0).stop 2023-09-30T16:49:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 -- 172.21.15.52:0/2156446371 shutdown_connections 2023-09-30T16:49:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f940a771640 1 -- 172.21.15.52:0/2156446371 wait complete. 2023-09-30T16:49:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 -- 172.21.15.52:0/2991664522 shutdown_connections 2023-09-30T16:49:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 --2- 172.21.15.52:0/2991664522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 --2- 172.21.15.52:0/2991664522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c0cb2e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 -- 172.21.15.52:0/2991664522 >> 172.21.15.52:0/2991664522 conn(0x7fc53c069e00 msgr2=0x7fc53c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 -- 172.21.15.52:0/2513795431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 msgr2=0x7f3e4c0eb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2513795431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0eb260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c5e0 tx=0x7f3e4001c500 comp rx=0 tx=0).stop 2023-09-30T16:49:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 -- 172.21.15.52:0/2513795431 shutdown_connections 2023-09-30T16:49:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2513795431 >> v2:172.21.15.186:3300/0 conn(0x7f3e4c047ce0 0x7f3e4c052ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2513795431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0eb260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 -- 172.21.15.52:0/2513795431 >> 172.21.15.52:0/2513795431 conn(0x7f3e4c054c20 msgr2=0x7f3e4c055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 -- 172.21.15.52:0/2991664522 shutdown_connections 2023-09-30T16:49:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 Processor -- start 2023-09-30T16:49:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 -- start start 2023-09-30T16:49:21.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 Processor -- start 2023-09-30T16:49:21.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f994dffb640 1 -- 172.21.15.52:0/3985033560 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440a6890 con 0x7f99480df5e0 2023-09-30T16:49:21.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994dffb640 1 -- 172.21.15.52:0/3985033560 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99440a69f0 con 0x7f99480df5e0 2023-09-30T16:49:21.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994dffb640 1 -- 172.21.15.52:0/3985033560 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440a6d80 con 0x7f99480df5e0 2023-09-30T16:49:21.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 -- 172.21.15.52:0/2513795431 shutdown_connections 2023-09-30T16:49:21.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f3e598cb640 1 -- 172.21.15.52:0/2513795431 wait complete. 2023-09-30T16:49:21.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 Processor -- start 2023-09-30T16:49:21.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7f0fd89d3640 1 -- 172.21.15.52:0/3722003690 wait complete. 2023-09-30T16:49:21.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 Processor -- start 2023-09-30T16:49:21.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 Processor -- start 2023-09-30T16:49:21.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb806c600 0x7f2bb814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.010+0000 7fc53b59e640 1 -- 172.21.15.52:0/2991664522 wait complete. 2023-09-30T16:49:21.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 Processor -- start 2023-09-30T16:49:21.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 -- start start 2023-09-30T16:49:21.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280c1690 0x7fce2814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99480df5e0 msgr2=0x7f99480542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 --2- 172.21.15.52:0/3985033560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99480df5e0 0x7f99480542a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f994800b950 tx=0x7f994401d880 comp rx=0 tx=0).stop 2023-09-30T16:49:21.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 shutdown_connections 2023-09-30T16:49:21.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 --2- 172.21.15.52:0/3985033560 >> v2:172.21.15.52:3300/0 conn(0x7f994803aee0 0x7f9948050140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 --2- 172.21.15.52:0/3985033560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99480df5e0 0x7f99480542a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 >> 172.21.15.52:0/3985033560 conn(0x7f994800a9a0 msgr2=0x7f994800adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 0x7f2bb814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb8158b70 0x7f2bb814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb814a940 con 0x7f2bb8070520 2023-09-30T16:49:21.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb814ed60 con 0x7f2bb8158b70 2023-09-30T16:49:21.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bbe144640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb814f040 con 0x7f2bb806c600 2023-09-30T16:49:21.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce280c1a70 0x7fce280c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 -- start start 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93fc047bd0 0x7f93fc0e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93fc048200 0x7f93fc0e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 0x7f93fc0e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc038c90 con 0x7f93fc0e9990 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0382f0 con 0x7f93fc048200 2023-09-30T16:49:21.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0385d0 con 0x7f93fc047bd0 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce280cb650 0x7fce280c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2814daa0 con 0x7fce280cb650 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c5780 con 0x7fce280c1a70 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2759e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c59d0 con 0x7fce280c1690 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 -- start start 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 0x7f0fd40bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd4071040 0x7f0fd4167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0fd40c9c30 0x7f0fd40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c33d0 con 0x7f0fd406a3c0 2023-09-30T16:49:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c2800 con 0x7f0fd4071040 2023-09-30T16:49:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd89d3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40c2aa0 con 0x7f0fd40c9c30 2023-09-30T16:49:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 0x7f93fc0e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 0x7f93fc0e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54106/0 (socket says 172.21.15.52:54106) 2023-09-30T16:49:21.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 -- 172.21.15.52:0/1479507130 learned_addr learned my addr 172.21.15.52:0/1479507130 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 0x7f2bb814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 0x7f2bb814e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54098/0 (socket says 172.21.15.52:54098) 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2388392051 learned_addr learned my addr 172.21.15.52:0/2388392051 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 0x7f0fd40bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 0x7f0fd40bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54120/0 (socket says 172.21.15.52:54120) 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 -- 172.21.15.52:0/2848183315 learned_addr learned my addr 172.21.15.52:0/2848183315 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f94037fe640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93fc048200 0x7f93fc0e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9403fff640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93fc047bd0 0x7f93fc0e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb7fff640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb8158b70 0x7f2bb814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 shutdown_connections 2023-09-30T16:49:21.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb77fe640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb806c600 0x7f2bb814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2659c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280c1690 0x7fce2814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2659c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280c1690 0x7fce2814d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46666/0 (socket says 172.21.15.52:46666) 2023-09-30T16:49:21.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce2659c640 1 -- 172.21.15.52:0/651161377 learned_addr learned my addr 172.21.15.52:0/651161377 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce280c1a70 0x7fce280c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 -- start start 2023-09-30T16:49:21.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e4c047ce0 0x7f3e4c0da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e4c048310 0x7f3e4c0e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0e9d10 con 0x7f3e4c033e20 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0e9100 con 0x7f3e4c048310 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e598cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0e93e0 con 0x7f3e4c047ce0 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 -- 172.21.15.52:0/3985033560 wait complete. 2023-09-30T16:49:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0d92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54126/0 (socket says 172.21.15.52:54126) 2023-09-30T16:49:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 -- 172.21.15.52:0/2280513339 learned_addr learned my addr 172.21.15.52:0/2280513339 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce26d9d640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce280cb650 0x7fce280c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 -- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93fc047bd0 msgr2=0x7f93fc0e1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93fc047bd0 0x7f93fc0e1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 -- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93fc048200 msgr2=0x7f93fc0e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93fc048200 0x7f93fc0e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 -- 172.21.15.52:0/1479507130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404072e20 con 0x7f93fc0e9990 2023-09-30T16:49:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e590ca640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e4c048310 0x7f3e4c0e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb806c600 msgr2=0x7f2bb814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb806c600 0x7f2bb814a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb8158b70 msgr2=0x7f2bb814d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb8158b70 0x7f2bb814d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f2bb6ffd640 1 -- 172.21.15.52:0/2388392051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0009a70 con 0x7f2bb8070520 2023-09-30T16:49:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e53fff640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e4c047ce0 0x7f3e4c0da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 -- start start 2023-09-30T16:49:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd2ffd640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd4071040 0x7f0fd4167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c15e870 0x7fc53c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 -- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280c1690 msgr2=0x7fce2814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280c1690 0x7fce2814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 -- 172.21.15.52:0/651161377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce280cb650 msgr2=0x7fce280c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce280cb650 0x7fce280c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 -- 172.21.15.52:0/651161377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20009a70 con 0x7fce280c1a70 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b3c70 con 0x7fc53c06c550 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c15df00 con 0x7fc53c15e870 2023-09-30T16:49:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fc53b59e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b3310 con 0x7fc53c0cb820 2023-09-30T16:49:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9408d0e640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 0x7f93fc0e7c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c390 tx=0x7f93f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 -- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0fd40c9c30 msgr2=0x7f0fd40b1940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T16:49:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0fd40c9c30 0x7f0fd40b1940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 -- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd4071040 msgr2=0x7f0fd4167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd4071040 0x7f0fd4167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f0fd37fe640 1 -- 172.21.15.52:0/2848183315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094d0 con 0x7f0fd406a3c0 2023-09-30T16:49:21.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f00052d0 con 0x7f93fc0e9990 2023-09-30T16:49:21.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7fce1ffff640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce280c1a70 0x7fce280c6790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c730 tx=0x7fce1800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 -- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e4c047ce0 msgr2=0x7f3e4c0da5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e4c047ce0 0x7f3e4c0da5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 -- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e4c048310 msgr2=0x7f3e4c0e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e4c048310 0x7f3e4c0e7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f3e588c9640 1 -- 172.21.15.52:0/2280513339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400094d0 con 0x7f3e4c033e20 2023-09-30T16:49:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 -- 172.21.15.52:0/1479507130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc0388b0 con 0x7f93fc0e9990 2023-09-30T16:49:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f940a771640 1 -- 172.21.15.52:0/1479507130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc0ea140 con 0x7f93fc0e9990 2023-09-30T16:49:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53ad9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c15e870 0x7fc53c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f0005430 con 0x7f93fc0e9990 2023-09-30T16:49:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2bb6ffd640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 0x7f2bb814e310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2bb001afd0 tx=0x7f2bb00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53ad9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c15e870 0x7fc53c15fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57632/0 (socket says 172.21.15.52:57632) 2023-09-30T16:49:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53ad9d640 1 -- 172.21.15.52:0/1146862422 learned_addr learned my addr 172.21.15.52:0/1146862422 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc539d9b640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18005ac0 con 0x7fce280c1a70 2023-09-30T16:49:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280c5cb0 con 0x7fce280c1a70 2023-09-30T16:49:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce280c6270 con 0x7fce280c1a70 2023-09-30T16:49:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f155bfff640 1 -- 172.21.15.52:0/2847892167 shutdown_connections 2023-09-30T16:49:21.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f155bfff640 1 --2- 172.21.15.52:0/2847892167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15440141a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f155bfff640 1 -- 172.21.15.52:0/2847892167 >> 172.21.15.52:0/2847892167 conn(0x7f155403ab90 msgr2=0x7f155403afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 -- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 msgr2=0x7fc53c0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 -- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c15e870 msgr2=0x7fc53c15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c15e870 0x7fc53c15fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 -- 172.21.15.52:0/1146862422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c009420 con 0x7fc53c06c550 2023-09-30T16:49:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f0fd37fe640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 0x7f0fd40bf0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fc401c940 tx=0x7f0fc401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18005c20 con 0x7fce280c1a70 2023-09-30T16:49:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.014+0000 7f994ffff640 1 Processor -- start 2023-09-30T16:49:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f3e588c9640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0d92c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ae040 tx=0x7f3e400192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53a59c640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c15d720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc53000c460 tx=0x7fc53000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18001d40 con 0x7fce280c1a70 2023-09-30T16:49:21.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00be070 con 0x7f2bb8070520 2023-09-30T16:49:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00a57e0 con 0x7f2bb8070520 2023-09-30T16:49:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0004240 con 0x7f2bb8070520 2023-09-30T16:49:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400b6670 con 0x7f3e4c033e20 2023-09-30T16:49:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530005cf0 con 0x7fc53c06c550 2023-09-30T16:49:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2bbe144640 1 -- 172.21.15.52:0/2388392051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb814f320 con 0x7f2bb8070520 2023-09-30T16:49:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530005e50 con 0x7fc53c06c550 2023-09-30T16:49:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530007270 con 0x7fc53c06c550 2023-09-30T16:49:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2bbe144640 1 -- 172.21.15.52:0/2388392051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb814f8e0 con 0x7f2bb8070520 2023-09-30T16:49:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c15dc60 con 0x7fc53c06c550 2023-09-30T16:49:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0b3890 con 0x7fc53c06c550 2023-09-30T16:49:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f2bbe144640 1 -- 172.21.15.52:0/2388392051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98005260 con 0x7f2bb8070520 2023-09-30T16:49:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c005260 con 0x7fce280c1a70 2023-09-30T16:49:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f155bfff640 1 -- 172.21.15.52:0/2847892167 shutdown_connections 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 -- start start 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f994803aee0 0x7f99480390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 0x7f994803a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99480df5e0 0x7f99480ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994803a7d0 con 0x7f99480df5e0 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9948039790 con 0x7f9948050680 2023-09-30T16:49:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994ffff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994804db20 con 0x7f994803aee0 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 0x7f994803a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 0x7f994803a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57648/0 (socket says 172.21.15.52:57648) 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 -- 172.21.15.52:0/1707258754 learned_addr learned my addr 172.21.15.52:0/1707258754 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994f7fe640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99480df5e0 0x7f99480ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 -- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f994803aee0 msgr2=0x7f99480390b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f994803aee0 0x7f99480390b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 -- 172.21.15.52:0/1707258754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99480df5e0 msgr2=0x7f99480ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99480df5e0 0x7f99480ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 -- 172.21.15.52:0/1707258754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994400a670 con 0x7f9948050680 2023-09-30T16:49:21.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520005260 con 0x7fc53c06c550 2023-09-30T16:49:21.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0007240 con 0x7f93fc0e9990 2023-09-30T16:49:21.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f940a771640 1 -- 172.21.15.52:0/1479507130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e4005260 con 0x7f93fc0e9990 2023-09-30T16:49:21.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f93f0007460 con 0x7f93fc0e9990 2023-09-30T16:49:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f155bfff640 1 -- 172.21.15.52:0/2847892167 wait complete. 2023-09-30T16:49:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f9400ff9640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f93e80662b0 0x7f93e8068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f994e7fc640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 0x7f994803a290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f994000b550 tx=0x7f994000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f994f7fe640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99480df5e0 0x7f99480ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f2bb00043a0 con 0x7f2bb8070520 2023-09-30T16:49:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b1ce0 con 0x7f0fd406a3c0 2023-09-30T16:49:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40b1e40 con 0x7f0fd406a3c0 2023-09-30T16:49:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.018+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b9640 con 0x7f0fd406a3c0 2023-09-30T16:49:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93f0082e90 con 0x7f93fc0e9990 2023-09-30T16:49:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f9403fff640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f93e80662b0 0x7f93e8068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fce18007070 con 0x7fce280c1a70 2023-09-30T16:49:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 Processor -- start 2023-09-30T16:49:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f2b9ffff640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2ba4066160 0x7f2ba4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 -- start start 2023-09-30T16:49:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e400b67f0 con 0x7f3e4c033e20 2023-09-30T16:49:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bb011e840 con 0x7f2bb8070520 2023-09-30T16:49:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f2bb77fe640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2ba4066160 0x7f2ba4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0e96c0 con 0x7f3e4c033e20 2023-09-30T16:49:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0d9800 con 0x7f3e4c033e20 2023-09-30T16:49:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7fce1effd640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fce08066230 0x7fce080686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce18083040 con 0x7fce280c1a70 2023-09-30T16:49:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7fce2659c640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fce08066230 0x7fce080686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c0d9ab0 con 0x7f3e4c033e20 2023-09-30T16:49:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400b6ba0 con 0x7f3e4c033e20 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15540d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 0x7f15540deae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15540e24c0 0x7f15540e2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540df020 con 0x7f15540de660 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540e2eb0 con 0x7f15440041a0 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155bfff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540e3180 con 0x7f15540e24c0 2023-09-30T16:49:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 0x7f15540deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 0x7f15540deae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54152/0 (socket says 172.21.15.52:54152) 2023-09-30T16:49:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 -- 172.21.15.52:0/3960543683 learned_addr learned my addr 172.21.15.52:0/3960543683 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f2bb77fe640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2ba4066160 0x7f2ba4068620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0079c0 tx=0x7f2bac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd40c2d80 con 0x7f0fd406a3c0 2023-09-30T16:49:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd4167ff0 con 0x7f0fd406a3c0 2023-09-30T16:49:21.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd404e930 con 0x7f0fd406a3c0 2023-09-30T16:49:21.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155affd640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15540d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7fce2659c640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fce08066230 0x7fce080686f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce10000f70 tx=0x7fce10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155b7fe640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15540e24c0 0x7f15540e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 -- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15540e24c0 msgr2=0x7f15540e2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15540e24c0 0x7f15540e2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 -- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 msgr2=0x7f15540d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15540d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 -- 172.21.15.52:0/3960543683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540e0c30 con 0x7f15540de660 2023-09-30T16:49:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f9403fff640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f93e80662b0 0x7f93e8068770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0ebf50 tx=0x7f9404120000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7f155a7fc640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 0x7f15540deae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f154c011e60 tx=0x7f154c00f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.022+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fc5300073d0 con 0x7fc53c06c550 2023-09-30T16:49:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7fc52affd640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc51c0661b0 0x7fc51c068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7fc539d9b640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc51c0661b0 0x7fc51c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7fc539d9b640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc51c0661b0 0x7fc51c068670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0af000 tx=0x7fc52c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc530054a00 con 0x7fc53c06c550 2023-09-30T16:49:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f93f00505d0 con 0x7f93fc0e9990 2023-09-30T16:49:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c005ac0 con 0x7f15540de660 2023-09-30T16:49:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15540e0f10 con 0x7f15540de660 2023-09-30T16:49:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15540e14d0 con 0x7f15540de660 2023-09-30T16:49:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.026+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15540054a0 con 0x7f15540de660 2023-09-30T16:49:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.030+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f2bb00ec030 con 0x7f2bb8070520 2023-09-30T16:49:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.030+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f0fc40b7070 con 0x7f0fd406a3c0 2023-09-30T16:49:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f3e400b2070 con 0x7f3e4c033e20 2023-09-30T16:49:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f0fbbfff640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0fc00661b0 0x7f0fc0068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f3e517fa640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3e380661e0 0x7f3e380686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f0fd2ffd640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0fc00661b0 0x7f0fc0068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f3e53fff640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3e380661e0 0x7f3e380686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940010870 con 0x7f9948050680 2023-09-30T16:49:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99400109d0 con 0x7f9948050680 2023-09-30T16:49:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940010d80 con 0x7f9948050680 2023-09-30T16:49:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f0fd2ffd640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0fc00661b0 0x7f0fc0068670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40afda0 tx=0x7f0fc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994804de00 con 0x7f9948050680 2023-09-30T16:49:21.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99480ec810 con 0x7f9948050680 2023-09-30T16:49:21.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f3e53fff640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3e380661e0 0x7f3e380686a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0487a0 tx=0x7f3e48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fce180506f0 con 0x7fce280c1a70 2023-09-30T16:49:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.034+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994804e320 con 0x7f9948050680 2023-09-30T16:49:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f9940023480 con 0x7f9948050680 2023-09-30T16:49:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f9937fff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f993c066160 0x7f993c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9940083cf0 con 0x7f9948050680 2023-09-30T16:49:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f994effd640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f993c066160 0x7f993c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fc530050d40 con 0x7fc53c06c550 2023-09-30T16:49:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc40f3640 con 0x7f0fd406a3c0 2023-09-30T16:49:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f994effd640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f993c066160 0x7f993c068620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99440b0000 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e400efc30 con 0x7f3e4c033e20 2023-09-30T16:49:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00fe50 con 0x7f15540de660 2023-09-30T16:49:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.038+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c005e20 con 0x7f15540de660 2023-09-30T16:49:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.042+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f154c0070d0 con 0x7f15540de660 2023-09-30T16:49:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.042+0000 7f15437fe640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1548066190 0x7f1548068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.042+0000 7f155affd640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1548066190 0x7f1548068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.042+0000 7f155affd640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1548066190 0x7f1548068650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1550000c10 tx=0x7f1550009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.050+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f0fc40ef280 con 0x7f0fd406a3c0 2023-09-30T16:49:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.050+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f9940054e80 con 0x7f9948050680 2023-09-30T16:49:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.058+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f3e400ebf70 con 0x7f3e4c033e20 2023-09-30T16:49:21.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.058+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f154c058770 con 0x7f15540de660 2023-09-30T16:49:21.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.066+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f154c0543b0 con 0x7f15540de660 2023-09-30T16:49:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.322+0000 7f940a771640 1 -- 172.21.15.52:0/1479507130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93e4005510 con 0x7f93fc0e9990 2023-09-30T16:49:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.322+0000 7f9400ff9640 1 -- 172.21.15.52:0/1479507130 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93f0053bf0 con 0x7f93fc0e9990 2023-09-30T16:49:21.327 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-09-30T16:49:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 -- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f93e80662b0 msgr2=0x7f93e8068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f93e80662b0 0x7f93e8068770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0ebf50 tx=0x7f9404120000 comp rx=0 tx=0).stop 2023-09-30T16:49:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 -- 172.21.15.52:0/1479507130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 msgr2=0x7f93fc0e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 0x7f93fc0e7c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c390 tx=0x7f93f000c850 comp rx=0 tx=0).stop 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 -- 172.21.15.52:0/1479507130 shutdown_connections 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f93e80662b0 0x7f93e8068770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93fc0e9990 0x7f93fc0e7c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93fc048200 0x7f93fc0e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 --2- 172.21.15.52:0/1479507130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93fc047bd0 0x7f93fc0e1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 -- 172.21.15.52:0/1479507130 >> 172.21.15.52:0/1479507130 conn(0x7f93fc054b10 msgr2=0x7f93fc034540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 -- 172.21.15.52:0/1479507130 shutdown_connections 2023-09-30T16:49:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.330+0000 7f93ee7fc640 1 -- 172.21.15.52:0/1479507130 wait complete. 2023-09-30T16:49:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.346+0000 7f2bbe144640 1 -- 172.21.15.52:0/2388392051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2b980057e0 con 0x7f2bb8070520 2023-09-30T16:49:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.346+0000 7f2b9ffff640 1 -- 172.21.15.52:0/2388392051 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bb00b2020 con 0x7f2bb8070520 2023-09-30T16:49:21.355 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-09-30T16:49:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 -- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2ba4066160 msgr2=0x7f2ba4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2ba4066160 0x7f2ba4068620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0079c0 tx=0x7f2bac008040 comp rx=0 tx=0).stop 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 -- 172.21.15.52:0/2388392051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 msgr2=0x7f2bb814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 0x7f2bb814e310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2bb001afd0 tx=0x7f2bb00196c0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 -- 172.21.15.52:0/2388392051 shutdown_connections 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2ba4066160 0x7f2ba4068620 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb8158b70 0x7f2bb814d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070520 0x7f2bb814e310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 --2- 172.21.15.52:0/2388392051 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb806c600 0x7f2bb814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 -- 172.21.15.52:0/2388392051 >> 172.21.15.52:0/2388392051 conn(0x7f2bb80ce4b0 msgr2=0x7f2bb80cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 -- 172.21.15.52:0/2388392051 shutdown_connections 2023-09-30T16:49:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7f2b9dffb640 1 -- 172.21.15.52:0/2388392051 wait complete. 2023-09-30T16:49:21.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2023-09-30T16:49:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5200057e0 con 0x7fc53c06c550 2023-09-30T16:49:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.350+0000 7fc52affd640 1 -- 172.21.15.52:0/1146862422 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc530021020 con 0x7fc53c06c550 2023-09-30T16:49:21.358 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc51c0661b0 msgr2=0x7fc51c068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc51c0661b0 0x7fc51c068670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0af000 tx=0x7fc52c0a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 msgr2=0x7fc53c15d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c15d720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc53000c460 tx=0x7fc53000c920 comp rx=0 tx=0).stop 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 shutdown_connections 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc51c0661b0 0x7fc51c068670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c15e870 0x7fc53c15fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c0cb820 0x7fc53c0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 --2- 172.21.15.52:0/1146862422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc53c06c550 0x7fc53c15d720 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 >> 172.21.15.52:0/1146862422 conn(0x7fc53c069e00 msgr2=0x7fc53c0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 shutdown_connections 2023-09-30T16:49:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fc53b59e640 1 -- 172.21.15.52:0/1146862422 wait complete. 2023-09-30T16:49:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.354+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fce0c0057e0 con 0x7fce280c1a70 2023-09-30T16:49:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.358+0000 7fce1effd640 1 -- 172.21.15.52:0/651161377 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce18017020 con 0x7fce280c1a70 2023-09-30T16:49:21.363 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2023-09-30T16:49:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fce08066230 msgr2=0x7fce080686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fce08066230 0x7fce080686f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce10000f70 tx=0x7fce10009040 comp rx=0 tx=0).stop 2023-09-30T16:49:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce280c1a70 msgr2=0x7fce280c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce280c1a70 0x7fce280c6790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c730 tx=0x7fce1800cbf0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 shutdown_connections 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fce08066230 0x7fce080686f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce280cb650 0x7fce280c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce280c1a70 0x7fce280c6790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 --2- 172.21.15.52:0/651161377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce280c1690 0x7fce2814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 >> 172.21.15.52:0/651161377 conn(0x7fce2806a400 msgr2=0x7fce280cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 shutdown_connections 2023-09-30T16:49:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.362+0000 7fce2759e640 1 -- 172.21.15.52:0/651161377 wait complete. 2023-09-30T16:49:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fd40cd440 con 0x7f0fd406a3c0 2023-09-30T16:49:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f994804e320 con 0x7f9948050680 2023-09-30T16:49:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f0fbbfff640 1 -- 172.21.15.52:0/2848183315 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fc40b5020 con 0x7f0fd406a3c0 2023-09-30T16:49:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f9937fff640 1 -- 172.21.15.52:0/1707258754 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f994804e320 con 0x7f9948050680 2023-09-30T16:49:21.372 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f993c066160 msgr2=0x7f993c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f993c066160 0x7f993c068620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99440b0000 tx=0x7f9944008040 comp rx=0 tx=0).stop 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 msgr2=0x7f994803a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 0x7f994803a290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f994000b550 tx=0x7f994000ba10 comp rx=0 tx=0).stop 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 shutdown_connections 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f993c066160 0x7f993c068620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99480df5e0 0x7f99480ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9948050680 0x7f994803a290 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 --2- 172.21.15.52:0/1707258754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f994803aee0 0x7f99480390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.366+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 >> 172.21.15.52:0/1707258754 conn(0x7f994800a9a0 msgr2=0x7f99480e3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.375 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-09-30T16:49:21.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1554056c70 con 0x7f15540de660 2023-09-30T16:49:21.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f15437fe640 1 -- 172.21.15.52:0/3960543683 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f154c0579d0 con 0x7f15540de660 2023-09-30T16:49:21.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 shutdown_connections 2023-09-30T16:49:21.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f994ffff640 1 -- 172.21.15.52:0/1707258754 wait complete. 2023-09-30T16:49:21.376 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0fc00661b0 msgr2=0x7f0fc0068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0fc00661b0 0x7f0fc0068670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40afda0 tx=0x7f0fc8009040 comp rx=0 tx=0).stop 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 msgr2=0x7f0fd40bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 0x7f0fd40bf0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fc401c940 tx=0x7f0fc401bad0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 shutdown_connections 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0fc00661b0 0x7f0fc0068670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0fd40c9c30 0x7f0fd40b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fd4071040 0x7f0fd4167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 --2- 172.21.15.52:0/2848183315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd406a3c0 0x7f0fd40bf0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 >> 172.21.15.52:0/2848183315 conn(0x7f0fd40ced80 msgr2=0x7f0fd40caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 shutdown_connections 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f0fd89d3640 1 -- 172.21.15.52:0/2848183315 wait complete. 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e4c0d9ab0 con 0x7f3e4c033e20 2023-09-30T16:49:21.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.370+0000 7f3e517fa640 1 -- 172.21.15.52:0/2280513339 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e4c0d9ab0 con 0x7f3e4c033e20 2023-09-30T16:49:21.380 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1548066190 msgr2=0x7f1548068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1548066190 0x7f1548068650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1550000c10 tx=0x7f1550009040 comp rx=0 tx=0).stop 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 msgr2=0x7f15540deae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 0x7f15540deae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f154c011e60 tx=0x7f154c00f530 comp rx=0 tx=0).stop 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 shutdown_connections 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1548066190 0x7f1548068650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15540e24c0 0x7f15540e2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540de660 0x7f15540deae0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 --2- 172.21.15.52:0/3960543683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15440041a0 0x7f15540d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 >> 172.21.15.52:0/3960543683 conn(0x7f155403ab90 msgr2=0x7f15540d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3e380661e0 msgr2=0x7f3e380686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3e380661e0 0x7f3e380686a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0487a0 tx=0x7f3e48009040 comp rx=0 tx=0).stop 2023-09-30T16:49:21.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 msgr2=0x7f3e4c0d92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:21.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0d92c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ae040 tx=0x7f3e400192a0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.374+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 shutdown_connections 2023-09-30T16:49:21.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f155bfff640 1 -- 172.21.15.52:0/3960543683 wait complete. 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 shutdown_connections 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3e380661e0 0x7f3e380686a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e4c048310 0x7f3e4c0e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e4c047ce0 0x7f3e4c0da5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 --2- 172.21.15.52:0/2280513339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e4c033e20 0x7f3e4c0d92c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 >> 172.21.15.52:0/2280513339 conn(0x7f3e4c054c20 msgr2=0x7f3e4c004cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 shutdown_connections 2023-09-30T16:49:21.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:21.378+0000 7f3e598cb640 1 -- 172.21.15.52:0/2280513339 wait complete. 2023-09-30T16:49:21.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2023-09-30T16:49:21.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2023-09-30T16:49:21.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2023-09-30T16:49:21.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2023-09-30T16:49:21.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2023-09-30T16:49:21.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-09-30T16:49:21.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2023-09-30T16:49:22.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-30T16:49:22.389 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-30T16:49:22.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T16:49:22.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-30T16:49:22.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-30T16:49:22.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T16:49:22.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T16:49:22.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T16:49:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.510+0000 7fb633ec5640 1 Processor -- start 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.510+0000 7fb633ec5640 1 -- start start 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb633ec5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb633ec5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c159810 con 0x7fb62c0cd0f0 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb633ec5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c159af0 con 0x7fb62c071fc0 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb633ec5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c15a0b0 con 0x7fb62c0c8cd0 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb632462640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb62c0cd0f0 0x7fb62c0c94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40050/0 (socket says 172.21.15.52:40050) 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb632462640 1 -- 172.21.15.52:0/315119891 learned_addr learned my addr 172.21.15.52:0/315119891 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb631460640 1 --2- 172.21.15.52:0/315119891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb630c5f640 1 -- 172.21.15.52:0/315119891 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022651274 0 0) 0x7fb62c159af0 con 0x7fb62c071fc0 2023-09-30T16:49:22.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb630c5f640 1 -- 172.21.15.52:0/315119891 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb618003530 con 0x7fb62c071fc0 2023-09-30T16:49:22.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb631460640 1 -- 172.21.15.52:0/315119891 >> v1:172.21.15.186:6789/0 conn(0x7fb62c071fc0 legacy=0x7fb62c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb631460640 1 -- 172.21.15.52:0/315119891 >> v1:172.21.15.52:6789/0 conn(0x7fb62c0cd0f0 legacy=0x7fb62c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.514+0000 7fb631460640 1 -- 172.21.15.52:0/315119891 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c159dd0 con 0x7fb62c0c8cd0 2023-09-30T16:49:22.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb631460640 1 --2- 172.21.15.52:0/315119891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0ccbb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb624009b40 tx=0x7fb62401dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe5992615be0f89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb630c5f640 1 -- 172.21.15.52:0/315119891 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240a6ca0 con 0x7fb62c0c8cd0 2023-09-30T16:49:22.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb630c5f640 1 -- 172.21.15.52:0/315119891 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6240a6e00 con 0x7fb62c0c8cd0 2023-09-30T16:49:22.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb630c5f640 1 -- 172.21.15.52:0/315119891 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240ae660 con 0x7fb62c0c8cd0 2023-09-30T16:49:22.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 -- 172.21.15.52:0/315119891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 msgr2=0x7fb62c0ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 --2- 172.21.15.52:0/315119891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0ccbb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb624009b40 tx=0x7fb62401dc60 comp rx=0 tx=0).stop 2023-09-30T16:49:22.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 -- 172.21.15.52:0/315119891 shutdown_connections 2023-09-30T16:49:22.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 --2- 172.21.15.52:0/315119891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0ccbb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 -- 172.21.15.52:0/315119891 >> 172.21.15.52:0/315119891 conn(0x7fb62c06bf70 msgr2=0x7fb62c06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 -- 172.21.15.52:0/315119891 shutdown_connections 2023-09-30T16:49:22.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.518+0000 7fb633ec5640 1 -- 172.21.15.52:0/315119891 wait complete. 2023-09-30T16:49:22.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 Processor -- start 2023-09-30T16:49:22.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 -- start start 2023-09-30T16:49:22.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb62c071fc0 0x7fb62c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 0x7fb62c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c155830 con 0x7fb62c0cd0f0 2023-09-30T16:49:22.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0b3120 con 0x7fb62c071fc0 2023-09-30T16:49:22.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb633ec5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c06c8a0 con 0x7fb62c0c8cd0 2023-09-30T16:49:22.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb632462640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 0x7fb62c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb631c61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb62c071fc0 0x7fb62c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb632462640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 0x7fb62c0c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54158/0 (socket says 172.21.15.52:54158) 2023-09-30T16:49:22.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb632462640 1 -- 172.21.15.52:0/457554754 learned_addr learned my addr 172.21.15.52:0/457554754 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.522+0000 7fb631460640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb631c61640 1 -- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 msgr2=0x7fb62c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb631c61640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb631c61640 1 -- 172.21.15.52:0/457554754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 msgr2=0x7fb62c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb631c61640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 0x7fb62c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb631c61640 1 -- 172.21.15.52:0/457554754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009770 con 0x7fb62c071fc0 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb632462640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 0x7fb62c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:49:22.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.526+0000 7fb631c61640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb62c071fc0 0x7fb62c1552f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c390 tx=0x7fb62800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280052d0 con 0x7fb62c071fc0 2023-09-30T16:49:22.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628005430 con 0x7fb62c071fc0 2023-09-30T16:49:22.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb633ec5640 1 -- 172.21.15.52:0/457554754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c155b30 con 0x7fb62c071fc0 2023-09-30T16:49:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628003840 con 0x7fb62c071fc0 2023-09-30T16:49:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb633ec5640 1 -- 172.21.15.52:0/457554754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c1560f0 con 0x7fb62c071fc0 2023-09-30T16:49:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb633ec5640 1 -- 172.21.15.52:0/457554754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0740a0 con 0x7fb62c071fc0 2023-09-30T16:49:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.530+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb6280039a0 con 0x7fb62c071fc0 2023-09-30T16:49:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.534+0000 7fb6227fc640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6100661b0 0x7fb610068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.534+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb628082e20 con 0x7fb62c071fc0 2023-09-30T16:49:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.534+0000 7fb631460640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6100661b0 0x7fb610068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.534+0000 7fb631460640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6100661b0 0x7fb610068670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6240b0000 tx=0x7fb6240a8070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.546+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb6280505d0 con 0x7fb62c071fc0 2023-09-30T16:49:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7b59e640 1 Processor -- start 2023-09-30T16:49:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7b59e640 1 -- start start 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7b59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb7c0c9240 0x7ffb7c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7b59e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c06dff0 con 0x7ffb7c16b420 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7b59e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c06e2d0 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7b59e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0ce240 con 0x7ffb7c0c9240 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffb7c16b420 0x7ffb7c0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40054/0 (socket says 172.21.15.52:40054) 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb7a59c640 1 -- 172.21.15.52:0/2350414919 learned_addr learned my addr 172.21.15.52:0/2350414919 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb79d9b640 1 --2- 172.21.15.52:0/2350414919 >> v2:172.21.15.52:3300/0 conn(0x7ffb7c0c9240 0x7ffb7c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb79d9b640 1 -- 172.21.15.52:0/2350414919 >> v1:172.21.15.186:6789/0 conn(0x7ffb7c0c96d0 legacy=0x7ffb7c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb79d9b640 1 -- 172.21.15.52:0/2350414919 >> v1:172.21.15.52:6789/0 conn(0x7ffb7c16b420 legacy=0x7ffb7c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.566+0000 7ffb79d9b640 1 -- 172.21.15.52:0/2350414919 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c06e5b0 con 0x7ffb7c0c9240 2023-09-30T16:49:22.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 Processor -- start 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 -- start start 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c9770 0x7ff23c070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff23c0c1720 0x7ff23c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c06c0c0 0x7ff23c06c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c06ca90 con 0x7ff23c0c9770 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c0cc3b0 con 0x7ff23c0c1720 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff240f64640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0cc690 con 0x7ff23c06c0c0 2023-09-30T16:49:22.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb79d9b640 1 --2- 172.21.15.52:0/2350414919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c9240 0x7ffb7c06c050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009d90 tx=0x7ffb7401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711e58efba4a0001 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c9770 0x7ff23c070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c9770 0x7ff23c070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54180/0 (socket says 172.21.15.52:54180) 2023-09-30T16:49:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23a59c640 1 -- 172.21.15.52:0/161604418 learned_addr learned my addr 172.21.15.52:0/161604418 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/161604418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c06c0c0 0x7ff23c06c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7959a640 1 -- 172.21.15.52:0/2350414919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740a5920 con 0x7ffb7c0c9240 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7959a640 1 -- 172.21.15.52:0/2350414919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740a5a80 con 0x7ffb7c0c9240 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7959a640 1 -- 172.21.15.52:0/2350414919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740a5e10 con 0x7ffb7c0c9240 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 -- 172.21.15.52:0/2350414919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c9240 msgr2=0x7ffb7c06c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/2350414919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c9240 0x7ffb7c06c050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009d90 tx=0x7ffb7401c970 comp rx=0 tx=0).stop 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 -- 172.21.15.52:0/2350414919 shutdown_connections 2023-09-30T16:49:22.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/2350414919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c9240 0x7ffb7c06c050 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 -- 172.21.15.52:0/2350414919 >> 172.21.15.52:0/2350414919 conn(0x7ffb7c0ce490 msgr2=0x7ffb7c0ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 -- 172.21.15.52:0/2350414919 shutdown_connections 2023-09-30T16:49:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ffb7b59e640 1 -- 172.21.15.52:0/2350414919 wait complete. 2023-09-30T16:49:22.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 Processor -- start 2023-09-30T16:49:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23ad9d640 1 -- 172.21.15.52:0/161604418 >> v2:172.21.15.186:3300/0 conn(0x7ff23c0c1720 msgr2=0x7ff23c06d880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T16:49:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/161604418 >> v2:172.21.15.186:3300/0 conn(0x7ff23c0c1720 0x7ff23c06d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23ad9d640 1 -- 172.21.15.52:0/161604418 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c9770 msgr2=0x7ff23c070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/161604418 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c9770 0x7ff23c070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.570+0000 7ff23ad9d640 1 -- 172.21.15.52:0/161604418 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c0c9b50 con 0x7ff23c06c0c0 2023-09-30T16:49:22.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/161604418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c06c0c0 0x7ff23c06c550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff23c164ba0 tx=0x7ff23401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e657f18096044f0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 -- start start 2023-09-30T16:49:22.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ff23959a640 1 -- 172.21.15.52:0/161604418 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340a58a0 con 0x7ff23c06c0c0 2023-09-30T16:49:22.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ff23959a640 1 -- 172.21.15.52:0/161604418 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2340a5a00 con 0x7ff23c06c0c0 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb7c0c9240 0x7ffb7c162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 0x7ffb7c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb7c16b420 0x7ffb7c088dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b16e0 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b3c00 con 0x7ffb7c16b420 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7b59e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c089310 con 0x7ffb7c0c9240 2023-09-30T16:49:22.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb79d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 0x7ffb7c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb79d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 0x7ffb7c0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54182/0 (socket says 172.21.15.52:54182) 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb79d9b640 1 -- 172.21.15.52:0/1303425306 learned_addr learned my addr 172.21.15.52:0/1303425306 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7a59c640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb7c0c9240 0x7ffb7c162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.574+0000 7ffb7ad9d640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb7c16b420 0x7ffb7c088dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff23959a640 1 -- 172.21.15.52:0/161604418 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340a5d90 con 0x7ff23c06c0c0 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 -- 172.21.15.52:0/161604418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c06c0c0 msgr2=0x7ff23c06c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 --2- 172.21.15.52:0/161604418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c06c0c0 0x7ff23c06c550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff23c164ba0 tx=0x7ff23401c950 comp rx=0 tx=0).stop 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb79d9b640 1 -- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb7c0c9240 msgr2=0x7ffb7c162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb79d9b640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb7c0c9240 0x7ffb7c162020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb79d9b640 1 -- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb7c16b420 msgr2=0x7ffb7c088dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb79d9b640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb7c16b420 0x7ffb7c088dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb79d9b640 1 -- 172.21.15.52:0/1303425306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74009a70 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 -- 172.21.15.52:0/161604418 shutdown_connections 2023-09-30T16:49:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 --2- 172.21.15.52:0/161604418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c06c0c0 0x7ff23c06c550 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 --2- 172.21.15.52:0/161604418 >> v2:172.21.15.186:3300/0 conn(0x7ff23c0c1720 0x7ff23c06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 --2- 172.21.15.52:0/161604418 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c9770 0x7ff23c070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 -- 172.21.15.52:0/161604418 >> 172.21.15.52:0/161604418 conn(0x7ff23c0ce4b0 msgr2=0x7ff23c0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb79d9b640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 0x7ffb7c0c72a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009d90 tx=0x7ffb74019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 -- 172.21.15.52:0/161604418 shutdown_connections 2023-09-30T16:49:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 -- 172.21.15.52:0/161604418 wait complete. 2023-09-30T16:49:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740b7610 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740b7770 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0b1120 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740b7b60 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c0b3820 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 Processor -- start 2023-09-30T16:49:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c0b3680 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7ff240f64640 1 -- start start 2023-09-30T16:49:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff240f64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c0c1720 0x7ff23c0c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ffb740b4050 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ffb6affd640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb5c0661b0 0x7ffb5c068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb7411edb0 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ffb7a59c640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb5c0661b0 0x7ffb5c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ffb7a59c640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb5c0661b0 0x7ffb5c068670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005890 tx=0x7ffb6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff240f64640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff23c0c9770 0x7ff23c1603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff240f64640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 0x7ff23c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff240f64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0c8090 con 0x7ff23c0c1720 2023-09-30T16:49:22.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff240f64640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c160e30 con 0x7ff23c0c9770 2023-09-30T16:49:22.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff240f64640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0c7480 con 0x7ff23c0c35c0 2023-09-30T16:49:22.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7653488640 1 Processor -- start 2023-09-30T16:49:22.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff23ad9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 0x7ff23c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff239d9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff23c0c9770 0x7ff23c1603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff23ad9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 0x7ff23c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46766/0 (socket says 172.21.15.52:46766) 2023-09-30T16:49:22.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7ff23ad9d640 1 -- 172.21.15.52:0/1664251749 learned_addr learned my addr 172.21.15.52:0/1664251749 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7653488640 1 -- start start 2023-09-30T16:49:22.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7653488640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c089570 0x7f764c0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7653488640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0cc8d0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7653488640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0ce280 con 0x7f764c071d30 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7653488640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0c9150 con 0x7f764c089570 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7652c87640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f764c0cd2a0 0x7f764c0ce760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40064/0 (socket says 172.21.15.52:40064) 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7652c87640 1 -- 172.21.15.52:0/366527465 learned_addr learned my addr 172.21.15.52:0/366527465 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7652486640 1 --2- 172.21.15.52:0/366527465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c089570 0x7f764c0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.578+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253872110 0 0) 0x7f764c0cc8d0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7638003510 con 0x7f764c0cd2a0 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555827759 0 0) 0x7f764c0ce280 con 0x7f764c071d30 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f764c0cc8d0 con 0x7f764c071d30 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7f7652486640 1 -- 172.21.15.52:0/366527465 >> v1:172.21.15.186:6789/0 conn(0x7f764c071d30 legacy=0x7f764c16d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7f7652486640 1 -- 172.21.15.52:0/366527465 >> v1:172.21.15.52:6789/0 conn(0x7f764c0cd2a0 legacy=0x7f764c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.582+0000 7f7652486640 1 -- 172.21.15.52:0/366527465 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0c9430 con 0x7f764c089570 2023-09-30T16:49:22.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff23ad9d640 1 -- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff23c0c9770 msgr2=0x7ff23c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff23c0c9770 0x7ff23c1603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff23ad9d640 1 -- 172.21.15.52:0/1664251749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c0c1720 msgr2=0x7ff23c0c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c0c1720 0x7ff23c0c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff23ad9d640 1 -- 172.21.15.52:0/1664251749 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009a70 con 0x7ff23c0c35c0 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff239d9b640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff23c0c9770 0x7ff23c1603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff23ad9d640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 0x7ff23c1608f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff23401d1f0 tx=0x7ff2340196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340ad850 con 0x7ff23c0c35c0 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c0c7760 con 0x7ff23c0c35c0 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c0c7d20 con 0x7ff23c0c35c0 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2340ad9b0 con 0x7ff23c0c35c0 2023-09-30T16:49:22.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340add40 con 0x7ff23c0c35c0 2023-09-30T16:49:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7f7652486640 1 --2- 172.21.15.52:0/366527465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c089570 0x7f764c0ccd60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76480071f0 tx=0x7f7648020740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf862ddfa659422 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648007ad0 con 0x7f764c089570 2023-09-30T16:49:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648007c30 con 0x7f764c089570 2023-09-30T16:49:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7f7651484640 1 -- 172.21.15.52:0/366527465 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480090d0 con 0x7f764c089570 2023-09-30T16:49:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.586+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff2340b4070 con 0x7ff23c0c35c0 2023-09-30T16:49:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7ff22affd640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff21c066190 0x7ff21c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff23411e620 con 0x7ff23c0c35c0 2023-09-30T16:49:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 -- 172.21.15.52:0/366527465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c089570 msgr2=0x7f764c0ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 --2- 172.21.15.52:0/366527465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c089570 0x7f764c0ccd60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76480071f0 tx=0x7f7648020740 comp rx=0 tx=0).stop 2023-09-30T16:49:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7ff23a59c640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff21c066190 0x7ff21c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7ff23a59c640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff21c066190 0x7ff21c068650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006f50 tx=0x7ff22c006ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ffb7c0b3680 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 -- 172.21.15.52:0/366527465 shutdown_connections 2023-09-30T16:49:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220005260 con 0x7ff23c0c35c0 2023-09-30T16:49:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 --2- 172.21.15.52:0/366527465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c089570 0x7f764c0ccd60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 -- 172.21.15.52:0/366527465 >> 172.21.15.52:0/366527465 conn(0x7f764c069fd0 msgr2=0x7f764c06a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 -- 172.21.15.52:0/366527465 shutdown_connections 2023-09-30T16:49:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 -- 172.21.15.52:0/366527465 wait complete. 2023-09-30T16:49:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 Processor -- start 2023-09-30T16:49:22.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 -- start start 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c071d30 0x7f764c0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764c089570 0x7f764c200290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.590+0000 7f7653488640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 0x7f764c212260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7653488640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c1fde50 con 0x7f764c089570 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7653488640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0c6d50 con 0x7f764c0cd2a0 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7653488640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0c64b0 con 0x7f764c071d30 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 0x7f764c212260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 0x7f764c212260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57718/0 (socket says 172.21.15.52:57718) 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 -- 172.21.15.52:0/3139158483 learned_addr learned my addr 172.21.15.52:0/3139158483 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7651c85640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764c089570 0x7f764c200290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652486640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c071d30 0x7f764c0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 -- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c071d30 msgr2=0x7f764c0c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c071d30 0x7f764c0c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 -- 172.21.15.52:0/3139158483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764c089570 msgr2=0x7f764c200290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764c089570 0x7f764c200290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 -- 172.21.15.52:0/3139158483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648009d40 con 0x7f764c0cd2a0 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7651c85640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764c089570 0x7f764c200290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652486640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c071d30 0x7f764c0c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7652c87640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 0x7f764c212260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f764400c8c0 tx=0x7f764400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 Processor -- start 2023-09-30T16:49:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 -- start start 2023-09-30T16:49:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400a640 con 0x7f764c0cd2a0 2023-09-30T16:49:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764400a7e0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400abd0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7653488640 1 -- 172.21.15.52:0/3139158483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c0c6790 con 0x7f764c0cd2a0 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7653488640 1 -- 172.21.15.52:0/3139158483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c0c7a30 con 0x7f764c0cd2a0 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f84033c60 0x7f6f8404ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f8403a5b0 0x7f6f84006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f84037d10 con 0x7f6f840e1280 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f84038950 con 0x7f6f8403a5b0 2023-09-30T16:49:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f90f4b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84037fb0 con 0x7f6f84033c60 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7628005260 con 0x7f764c0cd2a0 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f8403a5b0 0x7f6f84006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f8403a5b0 0x7f6f84006120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54200/0 (socket says 172.21.15.52:54200) 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f8b7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f6f840e1280 0x7f6f84039ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:51174/0 (socket says 172.21.15.52:51174) 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f8bfff640 1 -- 172.21.15.52:0/3576527766 learned_addr learned my addr 172.21.15.52:0/3576527766 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.594+0000 7f6f8affd640 1 --2- 172.21.15.52:0/3576527766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f84033c60 0x7f6f8404ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8bfff640 1 -- 172.21.15.52:0/3576527766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f84033c60 msgr2=0x7f6f8404ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8bfff640 1 --2- 172.21.15.52:0/3576527766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f84033c60 0x7f6f8404ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8bfff640 1 -- 172.21.15.52:0/3576527766 >> v1:172.21.15.186:6789/0 conn(0x7f6f840e1280 legacy=0x7f6f84039ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8bfff640 1 -- 172.21.15.52:0/3576527766 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84038290 con 0x7f6f8403a5b0 2023-09-30T16:49:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f764400ad30 con 0x7f764c0cd2a0 2023-09-30T16:49:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f7642ffd640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7630066230 0x7f76300686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76440837c0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8bfff640 1 --2- 172.21.15.52:0/3576527766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8403a5b0 0x7f6f84006120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c073fa0 tx=0x7f6f8c096c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d203d05128b71253 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f7652486640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7630066230 0x7f76300686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8a7fc640 1 -- 172.21.15.52:0/3576527766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c126440 con 0x7f6f8403a5b0 2023-09-30T16:49:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8a7fc640 1 -- 172.21.15.52:0/3576527766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c1265a0 con 0x7f6f8403a5b0 2023-09-30T16:49:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.598+0000 7f6f8a7fc640 1 -- 172.21.15.52:0/3576527766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c126990 con 0x7f6f8403a5b0 2023-09-30T16:49:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 -- 172.21.15.52:0/3576527766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8403a5b0 msgr2=0x7f6f84006120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 --2- 172.21.15.52:0/3576527766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8403a5b0 0x7f6f84006120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c073fa0 tx=0x7f6f8c096c10 comp rx=0 tx=0).stop 2023-09-30T16:49:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 -- 172.21.15.52:0/3576527766 shutdown_connections 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 --2- 172.21.15.52:0/3576527766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8403a5b0 0x7f6f84006120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 --2- 172.21.15.52:0/3576527766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f84033c60 0x7f6f8404ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 -- 172.21.15.52:0/3576527766 >> 172.21.15.52:0/3576527766 conn(0x7f6f84054b10 msgr2=0x7f6f84054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 -- 172.21.15.52:0/3576527766 shutdown_connections 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 -- 172.21.15.52:0/3576527766 wait complete. 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f7652486640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7630066230 0x7f76300686f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76480b2000 tx=0x7f764800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 Processor -- start 2023-09-30T16:49:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.602+0000 7f6f90f4b640 1 -- start start 2023-09-30T16:49:22.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 0x7f6f84037140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8403a5b0 0x7f6f840d8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f840e1280 0x7f6f8404c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84052ec0 con 0x7f6f84033c60 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840de630 con 0x7f6f840e1280 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840debb0 con 0x7f6f8403a5b0 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 0x7f6f84037140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 0x7f6f84037140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54216/0 (socket says 172.21.15.52:54216) 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 -- 172.21.15.52:0/4129761016 learned_addr learned my addr 172.21.15.52:0/4129761016 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8affd640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8403a5b0 0x7f6f840d8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 -- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8403a5b0 msgr2=0x7f6f840d8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8403a5b0 0x7f6f840d8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 -- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f840e1280 msgr2=0x7f6f8404c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f840e1280 0x7f6f8404c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 -- 172.21.15.52:0/4129761016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c04e650 con 0x7f6f84033c60 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8b7fe640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 0x7f6f84037140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800c780 tx=0x7f6f7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780072d0 con 0x7f6f84033c60 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f78007430 con 0x7f6f84033c60 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 -- 172.21.15.52:0/4129761016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f84052900 con 0x7f6f84033c60 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f90f4b640 1 -- 172.21.15.52:0/4129761016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840de8d0 con 0x7f6f84033c60 2023-09-30T16:49:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780047f0 con 0x7f6f84033c60 2023-09-30T16:49:22.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff2340ebba0 con 0x7ff23c0c35c0 2023-09-30T16:49:22.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f6f78004950 con 0x7f6f84033c60 2023-09-30T16:49:22.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f77fff640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6f700661b0 0x7f6f70068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f78082fe0 con 0x7f6f84033c60 2023-09-30T16:49:22.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.606+0000 7f6f8affd640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6f700661b0 0x7f6f70068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.610+0000 7f6f8affd640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6f700661b0 0x7f6f70068670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f8403a500 tx=0x7f6f80009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.610+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7644050f00 con 0x7f764c0cd2a0 2023-09-30T16:49:22.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.618+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f840de490 con 0x7f6f84033c60 2023-09-30T16:49:22.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.626+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6f840de490 con 0x7f6f84033c60 2023-09-30T16:49:22.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85068c4640 1 Processor -- start 2023-09-30T16:49:22.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85068c4640 1 -- start start 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85068c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84f8039920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85068c4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f803aac0 con 0x7f84f8102fb0 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85068c4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f803a220 con 0x7f84f8102990 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85068c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80528a0 con 0x7f84f8101ea0 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85050c1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84f8102fb0 0x7f84f8102280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40080/0 (socket says 172.21.15.52:40080) 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85050c1640 1 -- 172.21.15.52:0/3010836216 learned_addr learned my addr 172.21.15.52:0/3010836216 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:22.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85058c2640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84f8039920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973123958 0 0) 0x7f84f803aac0 con 0x7f84f8102fb0 2023-09-30T16:49:22.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ec003530 con 0x7f84f8102fb0 2023-09-30T16:49:22.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f37592d3640 1 Processor -- start 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 822177701 0 0) 0x7f84ec003530 con 0x7f84f8102fb0 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 msgr2=0x7f84f8039920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84f8039920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 >> v1:172.21.15.186:6789/0 conn(0x7f84f8102990 legacy=0x7f84f8052cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f803a500 con 0x7f84f8102fb0 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f84f0001680 con 0x7f84f8102fb0 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 >> v1:172.21.15.52:6789/0 conn(0x7f84f8102fb0 legacy=0x7f84f8102280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0039b0 0x7f84ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec004d10 0x7f84ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80528a0 con 0x7f84ec004d10 2023-09-30T16:49:22.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec00ba30 con 0x7f84ec0039b0 2023-09-30T16:49:22.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec00bbf0 con 0x7f84f8101ea0 2023-09-30T16:49:22.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85060c3640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec004d10 0x7f84ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f37592d3640 1 -- start start 2023-09-30T16:49:22.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85058c2640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0039b0 0x7f84ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85050c1640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85060c3640 1 -- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 msgr2=0x7f84ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85060c3640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85060c3640 1 -- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0039b0 msgr2=0x7f84ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85060c3640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0039b0 0x7f84ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85060c3640 1 -- 172.21.15.52:0/3010836216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec003530 con 0x7f84ec004d10 2023-09-30T16:49:22.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.634+0000 7f85050c1640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84f8101ea0 0x7f84ec0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f37592d3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c00c200 0x7f374c007330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f37592d3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f374c0df400 0x7f374c053df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f37592d3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c005ff0 con 0x7f374c0e2dc0 2023-09-30T16:49:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f37592d3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0e3b80 con 0x7f374c0df400 2023-09-30T16:49:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f37592d3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c006290 con 0x7f374c00c200 2023-09-30T16:49:22.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3758ad2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f374c0e2dc0 0x7f374c038310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40090/0 (socket says 172.21.15.52:40090) 2023-09-30T16:49:22.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3758ad2640 1 -- 172.21.15.52:0/370519567 learned_addr learned my addr 172.21.15.52:0/370519567 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:22.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3753fff640 1 --2- 172.21.15.52:0/370519567 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c00c200 0x7f374c007330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f37537fe640 1 --2- 172.21.15.52:0/370519567 >> v2:172.21.15.186:3300/0 conn(0x7f374c0df400 0x7f374c053df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85060c3640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec004d10 0x7f84ec005190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f850004fa80 tx=0x7f8500085180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ab6c0be5d80a6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3753fff640 1 -- 172.21.15.52:0/370519567 >> v2:172.21.15.186:3300/0 conn(0x7f374c0df400 msgr2=0x7f374c053df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3753fff640 1 --2- 172.21.15.52:0/370519567 >> v2:172.21.15.186:3300/0 conn(0x7f374c0df400 0x7f374c053df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3753fff640 1 -- 172.21.15.52:0/370519567 >> v1:172.21.15.52:6789/0 conn(0x7f374c0e2dc0 legacy=0x7f374c038310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f3753fff640 1 -- 172.21.15.52:0/370519567 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c006570 con 0x7f374c00c200 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500114640 con 0x7f84ec004d10 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8500110050 con 0x7f84ec004d10 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85048c0640 1 -- 172.21.15.52:0/3010836216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500114ac0 con 0x7f84ec004d10 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85068c4640 1 -- 172.21.15.52:0/3010836216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec004d10 msgr2=0x7f84ec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85068c4640 1 --2- 172.21.15.52:0/3010836216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ec004d10 0x7f84ec005190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f850004fa80 tx=0x7f8500085180 comp rx=0 tx=0).stop 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85060c3640 1 -- 172.21.15.52:0/3010836216 reap_dead start 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85068c4640 1 -- 172.21.15.52:0/3010836216 shutdown_connections 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85068c4640 1 -- 172.21.15.52:0/3010836216 >> 172.21.15.52:0/3010836216 conn(0x7f84f8054b10 msgr2=0x7f84f8054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85068c4640 1 -- 172.21.15.52:0/3010836216 shutdown_connections 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f3753fff640 1 --2- 172.21.15.52:0/370519567 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c00c200 0x7f374c007330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37480097c0 tx=0x7f374801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6152a615708c3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f3752ffd640 1 -- 172.21.15.52:0/370519567 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480ab600 con 0x7f374c00c200 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f3752ffd640 1 -- 172.21.15.52:0/370519567 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480a7050 con 0x7f374c00c200 2023-09-30T16:49:22.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f3752ffd640 1 -- 172.21.15.52:0/370519567 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480ab980 con 0x7f374c00c200 2023-09-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 -- 172.21.15.52:0/370519567 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c00c200 msgr2=0x7f374c007330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 --2- 172.21.15.52:0/370519567 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c00c200 0x7f374c007330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37480097c0 tx=0x7f374801c470 comp rx=0 tx=0).stop 2023-09-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 -- 172.21.15.52:0/370519567 shutdown_connections 2023-09-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 --2- 172.21.15.52:0/370519567 >> v2:172.21.15.186:3300/0 conn(0x7f374c0df400 0x7f374c053df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 --2- 172.21.15.52:0/370519567 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c00c200 0x7f374c007330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 -- 172.21.15.52:0/370519567 >> 172.21.15.52:0/370519567 conn(0x7f374c054c20 msgr2=0x7f374c055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.638+0000 7f85068c4640 1 -- 172.21.15.52:0/3010836216 wait complete. 2023-09-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85068c4640 1 Processor -- start 2023-09-30T16:49:22.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 -- 172.21.15.52:0/370519567 shutdown_connections 2023-09-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 -- 172.21.15.52:0/370519567 wait complete. 2023-09-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85068c4640 1 -- start start 2023-09-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85068c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec004d10 0x7f84f80f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 Processor -- start 2023-09-30T16:49:22.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f37592d3640 1 -- start start 2023-09-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85068c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f8048620 0x7f84f8053c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85068c4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84f8048a80 0x7f84f8054180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85058c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec004d10 0x7f84f80f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85060c3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84f8048a80 0x7f84f8054180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85058c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec004d10 0x7f84f80f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46812/0 (socket says 172.21.15.52:46812) 2023-09-30T16:49:22.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.642+0000 7f85058c2640 1 -- 172.21.15.52:0/2940889845 learned_addr learned my addr 172.21.15.52:0/2940889845 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85050c1640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f8048620 0x7f84f8053c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f804f140 con 0x7f84f8048620 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f804f420 con 0x7f84f8048a80 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f804f700 con 0x7f84ec004d10 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 0x7f374c0ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f374c0df400 0x7f374c0f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c0e2dc0 0x7f374c0eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0ed860 con 0x7f374c0df400 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0de4e0 con 0x7f374c00c200 2023-09-30T16:49:22.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c17db30 con 0x7f374c0e2dc0 2023-09-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 0x7f374c0ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 0x7f374c0ed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:57768/0 (socket says 172.21.15.52:57768) 2023-09-30T16:49:22.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 -- 172.21.15.52:0/52769248 learned_addr learned my addr 172.21.15.52:0/52769248 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3758ad2640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c0e2dc0 0x7f374c0eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37537fe640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f374c0df400 0x7f374c0f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 -- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c0e2dc0 msgr2=0x7f374c0eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c0e2dc0 0x7f374c0eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 -- 172.21.15.52:0/52769248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f374c0df400 msgr2=0x7f374c0f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f374c0df400 0x7f374c0f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 -- 172.21.15.52:0/52769248 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748009420 con 0x7f374c00c200 2023-09-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85060c3640 1 -- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec004d10 msgr2=0x7f84f80f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85060c3640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec004d10 0x7f84f80f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85060c3640 1 -- 172.21.15.52:0/2940889845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f8048620 msgr2=0x7f84f8053c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85060c3640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f8048620 0x7f84f8053c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85060c3640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f804f9e0 con 0x7f84f8048a80 2023-09-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85060c3640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84f8048a80 0x7f84f8054180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85000639d0 tx=0x7f8500082020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500114650 con 0x7f84f8048a80 2023-09-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0001d80 con 0x7f84f8048a80 2023-09-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85001149b0 con 0x7f84f8048a80 2023-09-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3753fff640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 0x7f374c0ed320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f374801a0a0 tx=0x7f3748019210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f804fcc0 con 0x7f84f8048a80 2023-09-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748006e20 con 0x7f374c00c200 2023-09-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f80f54d0 con 0x7f84f8048a80 2023-09-30T16:49:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c17de10 con 0x7f374c00c200 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c17e3d0 con 0x7f374c00c200 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480b4410 con 0x7f374c00c200 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.646+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480b47c0 con 0x7f374c00c200 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734005260 con 0x7f374c00c200 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f37480b2040 con 0x7f374c00c200 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 Processor -- start 2023-09-30T16:49:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 -- start start 2023-09-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ca80cc400 0x7f6ca815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca8070310 0x7f6ca80707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80c9620 con 0x7f6ca8158df0 2023-09-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca815d720 con 0x7f6ca80cc400 2023-09-30T16:49:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6cac86e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80c9900 con 0x7f6ca8070310 2023-09-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8500114b10 con 0x7f84f8048a80 2023-09-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f84f67fc640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84e4066150 0x7f84e4068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f850018dfd0 con 0x7f84f8048a80 2023-09-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca6d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6ca8158df0 0x7f6ca80cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40096/0 (socket says 172.21.15.52:40096) 2023-09-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca6d9d640 1 -- 172.21.15.52:0/575130804 learned_addr learned my addr 172.21.15.52:0/575130804 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca759e640 1 --2- 172.21.15.52:0/575130804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca8070310 0x7f6ca80707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f3750ff9640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3738066160 0x7f3738068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f374811e500 con 0x7f374c00c200 2023-09-30T16:49:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f85058c2640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84e4066150 0x7f84e4068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca659c640 1 --2- 172.21.15.52:0/575130804 >> v2:172.21.15.52:3300/0 conn(0x7f6ca80cc400 0x7f6ca815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f37537fe640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3738066160 0x7f3738068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca759e640 1 -- 172.21.15.52:0/575130804 >> v2:172.21.15.52:3300/0 conn(0x7f6ca80cc400 msgr2=0x7f6ca815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:22.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f85058c2640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84e4066150 0x7f84e4068610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009b60 tx=0x7f84fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f37537fe640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3738066160 0x7f3738068620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f374c0e7ab0 tx=0x7f3740009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca759e640 1 --2- 172.21.15.52:0/575130804 >> v2:172.21.15.52:3300/0 conn(0x7f6ca80cc400 0x7f6ca815d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca759e640 1 -- 172.21.15.52:0/575130804 >> v1:172.21.15.52:6789/0 conn(0x7f6ca8158df0 legacy=0x7f6ca80cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.650+0000 7f6ca759e640 1 -- 172.21.15.52:0/575130804 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80ccad0 con 0x7f6ca8070310 2023-09-30T16:49:22.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6ca659c640 1 --2- 172.21.15.52:0/575130804 >> v2:172.21.15.52:3300/0 conn(0x7f6ca80cc400 0x7f6ca815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:22.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6ca759e640 1 --2- 172.21.15.52:0/575130804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca8070310 0x7f6ca80707a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000adc0 tx=0x7f6ca001d8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df06075b0d856835 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f804a1f0 con 0x7f84f8048a80 2023-09-30T16:49:22.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6ca5d9b640 1 -- 172.21.15.52:0/575130804 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00a6990 con 0x7f6ca8070310 2023-09-30T16:49:22.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6ca5d9b640 1 -- 172.21.15.52:0/575130804 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca00a6af0 con 0x7f6ca8070310 2023-09-30T16:49:22.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6ca5d9b640 1 -- 172.21.15.52:0/575130804 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00a6e80 con 0x7f6ca8070310 2023-09-30T16:49:22.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 -- 172.21.15.52:0/575130804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca8070310 msgr2=0x7f6ca80707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 --2- 172.21.15.52:0/575130804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca8070310 0x7f6ca80707a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000adc0 tx=0x7f6ca001d8c0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 -- 172.21.15.52:0/575130804 shutdown_connections 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 --2- 172.21.15.52:0/575130804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca8070310 0x7f6ca80707a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 --2- 172.21.15.52:0/575130804 >> v2:172.21.15.52:3300/0 conn(0x7f6ca80cc400 0x7f6ca815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 -- 172.21.15.52:0/575130804 >> 172.21.15.52:0/575130804 conn(0x7f6ca80ce490 msgr2=0x7f6ca80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 -- 172.21.15.52:0/575130804 shutdown_connections 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.654+0000 7f6cac86e640 1 -- 172.21.15.52:0/575130804 wait complete. 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 Processor -- start 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 -- start start 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 0x7f6ca80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca80cc400 0x7f6ca8163100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8158df0 0x7f6ca814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca814e120 con 0x7f6ca8070310 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8163640 con 0x7f6ca8158df0 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca81626b0 con 0x7f6ca80cc400 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 0x7f6ca80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 0x7f6ca80b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54260/0 (socket says 172.21.15.52:54260) 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 -- 172.21.15.52:0/2563864713 learned_addr learned my addr 172.21.15.52:0/2563864713 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca759e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8158df0 0x7f6ca814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca659c640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca80cc400 0x7f6ca8163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 -- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca80cc400 msgr2=0x7f6ca8163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca80cc400 0x7f6ca8163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 -- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8158df0 msgr2=0x7f6ca814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8158df0 0x7f6ca814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 -- 172.21.15.52:0/2563864713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca000aa70 con 0x7f6ca8070310 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca759e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8158df0 0x7f6ca814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6ca6d9d640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 0x7f6ca80b3bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c700 tx=0x7f6c9800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004c10 con 0x7f6ca8070310 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca8162c70 con 0x7f6ca8070310 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca80aec00 con 0x7f6ca8070310 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98004d70 con 0x7f6ca8070310 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.658+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98007b50 con 0x7f6ca8070310 2023-09-30T16:49:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88005260 con 0x7f6ca8070310 2023-09-30T16:49:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f37480ebd20 con 0x7f374c00c200 2023-09-30T16:49:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f6c98007cb0 con 0x7f6ca8070310 2023-09-30T16:49:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f6c8f7fe640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6c94066230 0x7f6c940686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c98083580 con 0x7f6ca8070310 2023-09-30T16:49:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f6ca659c640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6c94066230 0x7f6c940686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.662+0000 7f6ca659c640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6c94066230 0x7f6c940686f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80b1e10 tx=0x7f6c9c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:22.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.670+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6c98054750 con 0x7f6ca8070310 2023-09-30T16:49:22.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.674+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f850015b620 con 0x7f84f8048a80 2023-09-30T16:49:22.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.866+0000 7fb633ec5640 1 -- 172.21.15.52:0/457554754 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb62c0cb2b0 con 0x7fb62c071fc0 2023-09-30T16:49:22.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.866+0000 7fb6227fc640 1 -- 172.21.15.52:0/457554754 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb628017090 con 0x7fb62c071fc0 2023-09-30T16:49:22.874 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:22.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 -- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6100661b0 msgr2=0x7fb610068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6100661b0 0x7fb610068670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6240b0000 tx=0x7fb6240a8070 comp rx=0 tx=0).stop 2023-09-30T16:49:22.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 -- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb62c071fc0 msgr2=0x7fb62c1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb62c071fc0 0x7fb62c1552f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c390 tx=0x7fb62800c850 comp rx=0 tx=0).stop 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 -- 172.21.15.52:0/457554754 shutdown_connections 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb6100661b0 0x7fb610068670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb62c0cd0f0 0x7fb62c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb62c0c8cd0 0x7fb62c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 --2- 172.21.15.52:0/457554754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb62c071fc0 0x7fb62c1552f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 -- 172.21.15.52:0/457554754 >> 172.21.15.52:0/457554754 conn(0x7fb62c06bf70 msgr2=0x7fb62c15b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 -- 172.21.15.52:0/457554754 shutdown_connections 2023-09-30T16:49:22.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.870+0000 7fb60ffff640 1 -- 172.21.15.52:0/457554754 wait complete. 2023-09-30T16:49:22.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2023-09-30T16:49:22.899 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.918+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb7c070aa0 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.918+0000 7ffb6affd640 1 -- 172.21.15.52:0/1303425306 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb740b2020 con 0x7ffb7c0c96d0 2023-09-30T16:49:22.923 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.918+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6f840de490 con 0x7f6f84033c60 2023-09-30T16:49:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.918+0000 7f6f77fff640 1 -- 172.21.15.52:0/4129761016 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f840de490 con 0x7f6f84033c60 2023-09-30T16:49:22.925 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2023-09-30T16:49:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb5c0661b0 msgr2=0x7ffb5c068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb5c0661b0 0x7ffb5c068670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005890 tx=0x7ffb6c009040 comp rx=0 tx=0).stop 2023-09-30T16:49:22.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 msgr2=0x7ffb7c0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 0x7ffb7c0c72a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009d90 tx=0x7ffb74019710 comp rx=0 tx=0).stop 2023-09-30T16:49:22.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6f700661b0 msgr2=0x7f6f70068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6f700661b0 0x7f6f70068670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f8403a500 tx=0x7f6f80009190 comp rx=0 tx=0).stop 2023-09-30T16:49:22.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 msgr2=0x7f6f84037140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 0x7f6f84037140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800c780 tx=0x7f6f7800cc40 comp rx=0 tx=0).stop 2023-09-30T16:49:22.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 shutdown_connections 2023-09-30T16:49:22.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6f700661b0 0x7f6f70068670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 shutdown_connections 2023-09-30T16:49:22.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f840e1280 0x7f6f8404c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8403a5b0 0x7f6f840d8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 --2- 172.21.15.52:0/4129761016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f84033c60 0x7f6f84037140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 >> 172.21.15.52:0/4129761016 conn(0x7f6f84054b10 msgr2=0x7f6f8404d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb5c0661b0 0x7ffb5c068670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb7c16b420 0x7ffb7c088dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c0c96d0 0x7ffb7c0c72a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 --2- 172.21.15.52:0/1303425306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb7c0c9240 0x7ffb7c162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 >> 172.21.15.52:0/1303425306 conn(0x7ffb7c0ce490 msgr2=0x7ffb7c070390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 shutdown_connections 2023-09-30T16:49:22.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7f6f75ffb640 1 -- 172.21.15.52:0/4129761016 wait complete. 2023-09-30T16:49:22.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 shutdown_connections 2023-09-30T16:49:22.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.922+0000 7ffb7b59e640 1 -- 172.21.15.52:0/1303425306 wait complete. 2023-09-30T16:49:22.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.926+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff220005510 con 0x7ff23c0c35c0 2023-09-30T16:49:22.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.926+0000 7ff22affd640 1 -- 172.21.15.52:0/1664251749 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2340b2030 con 0x7ff23c0c35c0 2023-09-30T16:49:22.934 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-09-30T16:49:22.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff21c066190 msgr2=0x7ff21c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff21c066190 0x7ff21c068650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006f50 tx=0x7ff22c006ea0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 msgr2=0x7ff23c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 0x7ff23c1608f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff23401d1f0 tx=0x7ff2340196f0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 shutdown_connections 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff21c066190 0x7ff21c068650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff23c0c35c0 0x7ff23c1608f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff23c0c9770 0x7ff23c1603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 --2- 172.21.15.52:0/1664251749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c0c1720 0x7ff23c0c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 >> 172.21.15.52:0/1664251749 conn(0x7ff23c0ce4b0 msgr2=0x7ff23c161660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 shutdown_connections 2023-09-30T16:49:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7ff240f64640 1 -- 172.21.15.52:0/1664251749 wait complete. 2023-09-30T16:49:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f76280057e0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.930+0000 7f7642ffd640 1 -- 172.21.15.52:0/3139158483 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76440018b0 con 0x7f764c0cd2a0 2023-09-30T16:49:22.939 INFO:teuthology.orchestra.run.smithi052.stdout:60129542152 2023-09-30T16:49:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7630066230 msgr2=0x7f76300686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7630066230 0x7f76300686f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76480b2000 tx=0x7f764800b040 comp rx=0 tx=0).stop 2023-09-30T16:49:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 msgr2=0x7f764c212260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 0x7f764c212260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f764400c8c0 tx=0x7f764400cd80 comp rx=0 tx=0).stop 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 shutdown_connections 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7630066230 0x7f76300686f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0cd2a0 0x7f764c212260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764c089570 0x7f764c200290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 --2- 172.21.15.52:0/3139158483 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c071d30 0x7f764c0c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 >> 172.21.15.52:0/3139158483 conn(0x7f764c069fd0 msgr2=0x7f764c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 shutdown_connections 2023-09-30T16:49:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.934+0000 7f7640ff9640 1 -- 172.21.15.52:0/3139158483 wait complete. 2023-09-30T16:49:22.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2023-09-30T16:49:22.950 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:22.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2023-09-30T16:49:22.958 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:22.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2023-09-30T16:49:22.966 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:22.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2023-09-30T16:49:22.966 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:22.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84f8008a20 con 0x7f84f8048a80 2023-09-30T16:49:22.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f84f67fc640 1 -- 172.21.15.52:0/2940889845 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f850017d020 con 0x7f84f8048a80 2023-09-30T16:49:22.979 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2023-09-30T16:49:22.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84e4066150 msgr2=0x7f84e4068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84e4066150 0x7f84e4068610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009b60 tx=0x7f84fc008040 comp rx=0 tx=0).stop 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84f8048a80 msgr2=0x7f84f8054180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84f8048a80 0x7f84f8054180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85000639d0 tx=0x7f8500082020 comp rx=0 tx=0).stop 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 shutdown_connections 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84e4066150 0x7f84e4068610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84f8048a80 0x7f84f8054180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f8048620 0x7f84f8053c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 --2- 172.21.15.52:0/2940889845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec004d10 0x7f84f80f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 >> 172.21.15.52:0/2940889845 conn(0x7f84f8054b10 msgr2=0x7f84f8038e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 shutdown_connections 2023-09-30T16:49:22.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.974+0000 7f85068c4640 1 -- 172.21.15.52:0/2940889845 wait complete. 2023-09-30T16:49:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.978+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37340057e0 con 0x7f374c00c200 2023-09-30T16:49:22.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.978+0000 7f3750ff9640 1 -- 172.21.15.52:0/52769248 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37480b0020 con 0x7f374c00c200 2023-09-30T16:49:22.985 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3738066160 msgr2=0x7f3738068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3738066160 0x7f3738068620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f374c0e7ab0 tx=0x7f3740009190 comp rx=0 tx=0).stop 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 msgr2=0x7f374c0ed320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 0x7f374c0ed320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f374801a0a0 tx=0x7f3748019210 comp rx=0 tx=0).stop 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 shutdown_connections 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3738066160 0x7f3738068620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f374c0e2dc0 0x7f374c0eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f374c0df400 0x7f374c0f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 --2- 172.21.15.52:0/52769248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f374c00c200 0x7f374c0ed320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 >> 172.21.15.52:0/52769248 conn(0x7f374c054c20 msgr2=0x7f374c0e7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 shutdown_connections 2023-09-30T16:49:22.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f37592d3640 1 -- 172.21.15.52:0/52769248 wait complete. 2023-09-30T16:49:22.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c88005510 con 0x7f6ca8070310 2023-09-30T16:49:22.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.982+0000 7f6c8f7fe640 1 -- 172.21.15.52:0/2563864713 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c9801d090 con 0x7f6ca8070310 2023-09-30T16:49:22.989 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6c94066230 msgr2=0x7f6c940686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6c94066230 0x7f6c940686f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80b1e10 tx=0x7f6c9c008040 comp rx=0 tx=0).stop 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 msgr2=0x7f6ca80b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 0x7f6ca80b3bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c700 tx=0x7f6c9800cbc0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 shutdown_connections 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6c94066230 0x7f6c940686f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8158df0 0x7f6ca814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca80cc400 0x7f6ca8163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 --2- 172.21.15.52:0/2563864713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ca8070310 0x7f6ca80b3bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:22.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 >> 172.21.15.52:0/2563864713 conn(0x7f6ca80ce490 msgr2=0x7f6ca8154750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:22.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 shutdown_connections 2023-09-30T16:49:22.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:22.986+0000 7f6cac86e640 1 -- 172.21.15.52:0/2563864713 wait complete. 2023-09-30T16:49:23.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-09-30T16:49:23.004 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:23.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2023-09-30T16:49:23.006 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:23.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-09-30T16:49:23.013 DEBUG:teuthology.parallel:result is None 2023-09-30T16:49:23.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T16:49:23.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:23.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.158+0000 7f6d1f7fa640 1 Processor -- start 2023-09-30T16:49:23.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.158+0000 7f6d1f7fa640 1 -- start start 2023-09-30T16:49:23.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1f7fa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d18158ff0 0x7f6d180b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1f7fa640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6d1806cd10 0x7f6d180cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1f7fa640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180b0a40 con 0x7f6d180b05e0 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1f7fa640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d180cc320 con 0x7f6d18158ff0 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1f7fa640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1806d2a0 con 0x7f6d1806cd10 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d18158ff0 0x7f6d180b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d18158ff0 0x7f6d180b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54274/0 (socket says 172.21.15.52:54274) 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 -- 172.21.15.52:0/3664762718 learned_addr learned my addr 172.21.15.52:0/3664762718 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1dd97640 1 --2- 172.21.15.52:0/3664762718 >> v2:172.21.15.186:3300/0 conn(0x7f6d1806cd10 0x7f6d180cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 -- 172.21.15.52:0/3664762718 >> v2:172.21.15.186:3300/0 conn(0x7f6d1806cd10 msgr2=0x7f6d180cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 --2- 172.21.15.52:0/3664762718 >> v2:172.21.15.186:3300/0 conn(0x7f6d1806cd10 0x7f6d180cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 -- 172.21.15.52:0/3664762718 >> v1:172.21.15.186:6789/0 conn(0x7f6d180b05e0 legacy=0x7f6d1806c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 -- 172.21.15.52:0/3664762718 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1806d580 con 0x7f6d18158ff0 2023-09-30T16:49:23.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1dd97640 1 --2- 172.21.15.52:0/3664762718 >> v2:172.21.15.186:3300/0 conn(0x7f6d1806cd10 0x7f6d180cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:23.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d1d596640 1 --2- 172.21.15.52:0/3664762718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d18158ff0 0x7f6d180b00a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6d1806d1a0 tx=0x7f6d1401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7817f78bfa9bf5e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.162+0000 7f6d0ffff640 1 -- 172.21.15.52:0/3664762718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d140ab620 con 0x7f6d18158ff0 2023-09-30T16:49:23.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d0ffff640 1 -- 172.21.15.52:0/3664762718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d140ab780 con 0x7f6d18158ff0 2023-09-30T16:49:23.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d0ffff640 1 -- 172.21.15.52:0/3664762718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d140abb10 con 0x7f6d18158ff0 2023-09-30T16:49:23.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/3664762718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d18158ff0 msgr2=0x7f6d180b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/3664762718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d18158ff0 0x7f6d180b00a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6d1806d1a0 tx=0x7f6d1401c400 comp rx=0 tx=0).stop 2023-09-30T16:49:23.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/3664762718 shutdown_connections 2023-09-30T16:49:23.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/3664762718 >> v2:172.21.15.186:3300/0 conn(0x7f6d1806cd10 0x7f6d180cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/3664762718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d18158ff0 0x7f6d180b00a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/3664762718 >> 172.21.15.52:0/3664762718 conn(0x7f6d1806a5f0 msgr2=0x7f6d180ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:23.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/3664762718 shutdown_connections 2023-09-30T16:49:23.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/3664762718 wait complete. 2023-09-30T16:49:23.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 Processor -- start 2023-09-30T16:49:23.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- start start 2023-09-30T16:49:23.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 0x7f6d180c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d180b05e0 0x7f6d1814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d18158ff0 0x7f6d1814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180c8610 con 0x7f6d1806cd10 2023-09-30T16:49:23.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1815a670 con 0x7f6d180b05e0 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180c6740 con 0x7f6d18158ff0 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 0x7f6d180c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 0x7f6d180c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54288/0 (socket says 172.21.15.52:54288) 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 -- 172.21.15.52:0/2749454255 learned_addr learned my addr 172.21.15.52:0/2749454255 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1dd97640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d18158ff0 0x7f6d1814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 -- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d18158ff0 msgr2=0x7f6d1814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1cd95640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d180b05e0 0x7f6d1814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d18158ff0 0x7f6d1814e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 -- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d180b05e0 msgr2=0x7f6d1814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d180b05e0 0x7f6d1814dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 -- 172.21.15.52:0/2749454255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d140094d0 con 0x7f6d1806cd10 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1dd97640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d18158ff0 0x7f6d1814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1d596640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 0x7f6d180c1ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d140ad040 tx=0x7f6d1401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d140be3f0 con 0x7f6d1806cd10 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d140be550 con 0x7f6d1806cd10 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d180c2430 con 0x7f6d1806cd10 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d140be900 con 0x7f6d1806cd10 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.166+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d180c8330 con 0x7f6d1806cd10 2023-09-30T16:49:23.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.170+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1815a4d0 con 0x7f6d1806cd10 2023-09-30T16:49:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.170+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f6d140c7440 con 0x7f6d1806cd10 2023-09-30T16:49:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.170+0000 7f6d0dffb640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6cfc066160 0x7f6cfc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.170+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d1411e340 con 0x7f6d1806cd10 2023-09-30T16:49:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.170+0000 7f6d1cd95640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6cfc066160 0x7f6cfc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.170+0000 7f6d1cd95640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6cfc066160 0x7f6cfc068620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d181f88e0 tx=0x7f6d08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.174+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6d1815a4d0 con 0x7f6d1806cd10 2023-09-30T16:49:23.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.318+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d181593d0 con 0x7f6cfc066160 2023-09-30T16:49:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d0dffb640 1 -- 172.21.15.52:0/2749454255 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264438 (secure 0 0 0) 0x7f6d0800d4a0 con 0x7f6cfc066160 2023-09-30T16:49:23.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6cfc066160 msgr2=0x7f6cfc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6cfc066160 0x7f6cfc068620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d181f88e0 tx=0x7f6d08009040 comp rx=0 tx=0).stop 2023-09-30T16:49:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 msgr2=0x7f6d180c1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 0x7f6d180c1ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d140ad040 tx=0x7f6d1401ac40 comp rx=0 tx=0).stop 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 shutdown_connections 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6cfc066160 0x7f6cfc068620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d18158ff0 0x7f6d1814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d180b05e0 0x7f6d1814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 --2- 172.21.15.52:0/2749454255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1806cd10 0x7f6d180c1ef0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 >> 172.21.15.52:0/2749454255 conn(0x7f6d1806a5f0 msgr2=0x7f6d180af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 shutdown_connections 2023-09-30T16:49:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.342+0000 7f6d1f7fa640 1 -- 172.21.15.52:0/2749454255 wait complete. 2023-09-30T16:49:23.363 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-09-30T16:49:21.460197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235708,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739012,"statfs":{"total":773094113280,"available":772852748288,"internally_reserved":0,"allocated":2957312,"data_stored":1779564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003548"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978658+0000","last_change":"2023-09-30T16:49:10.633322+0000","last_active":"2023-09-30T16:49:11.978658+0000","last_peered":"2023-09-30T16:49:11.978658+0000","last_clean":"2023-09-30T16:49:11.978658+0000","last_became_active":"2023-09-30T16:49:10.631135+0000","last_became_peered":"2023-09-30T16:49:10.631135+0000","last_unstale":"2023-09-30T16:49:11.978658+0000","last_undegraded":"2023-09-30T16:49:11.978658+0000","last_fullsized":"2023-09-30T16:49:11.978658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976757+0000","last_change":"2023-09-30T16:49:10.632204+0000","last_active":"2023-09-30T16:49:11.976757+0000","last_peered":"2023-09-30T16:49:11.976757+0000","last_clean":"2023-09-30T16:49:11.976757+0000","last_became_active":"2023-09-30T16:49:10.631691+0000","last_became_peered":"2023-09-30T16:49:10.631691+0000","last_unstale":"2023-09-30T16:49:11.976757+0000","last_undegraded":"2023-09-30T16:49:11.976757+0000","last_fullsized":"2023-09-30T16:49:11.976757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:56:24.913821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976467+0000","last_change":"2023-09-30T16:49:10.629832+0000","last_active":"2023-09-30T16:49:11.976467+0000","last_peered":"2023-09-30T16:49:11.976467+0000","last_clean":"2023-09-30T16:49:11.976467+0000","last_became_active":"2023-09-30T16:49:10.629449+0000","last_became_peered":"2023-09-30T16:49:10.629449+0000","last_unstale":"2023-09-30T16:49:11.976467+0000","last_undegraded":"2023-09-30T16:49:11.976467+0000","last_fullsized":"2023-09-30T16:49:11.976467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.604692+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.603126+0000","last_became_peered":"2023-09-30T16:49:10.603126+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:34.821952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:10.633644+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:10.630535+0000","last_became_peered":"2023-09-30T16:49:10.630535+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:25.913808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597358+0000","last_change":"2023-09-30T16:49:10.604995+0000","last_active":"2023-09-30T16:49:11.597358+0000","last_peered":"2023-09-30T16:49:11.597358+0000","last_clean":"2023-09-30T16:49:11.597358+0000","last_became_active":"2023-09-30T16:49:10.603075+0000","last_became_peered":"2023-09-30T16:49:10.603075+0000","last_unstale":"2023-09-30T16:49:11.597358+0000","last_undegraded":"2023-09-30T16:49:11.597358+0000","last_fullsized":"2023-09-30T16:49:11.597358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976179+0000","last_change":"2023-09-30T16:49:10.630597+0000","last_active":"2023-09-30T16:49:11.976179+0000","last_peered":"2023-09-30T16:49:11.976179+0000","last_clean":"2023-09-30T16:49:11.976179+0000","last_became_active":"2023-09-30T16:49:10.626842+0000","last_became_peered":"2023-09-30T16:49:10.626842+0000","last_unstale":"2023-09-30T16:49:11.976179+0000","last_undegraded":"2023-09-30T16:49:11.976179+0000","last_fullsized":"2023-09-30T16:49:11.976179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:25:42.884890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977750+0000","last_change":"2023-09-30T16:49:10.633003+0000","last_active":"2023-09-30T16:49:11.977750+0000","last_peered":"2023-09-30T16:49:11.977750+0000","last_clean":"2023-09-30T16:49:11.977750+0000","last_became_active":"2023-09-30T16:49:10.632147+0000","last_became_peered":"2023-09-30T16:49:10.632147+0000","last_unstale":"2023-09-30T16:49:11.977750+0000","last_undegraded":"2023-09-30T16:49:11.977750+0000","last_fullsized":"2023-09-30T16:49:11.977750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:51:01.956500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978014+0000","last_change":"2023-09-30T16:49:10.633201+0000","last_active":"2023-09-30T16:49:11.978014+0000","last_peered":"2023-09-30T16:49:11.978014+0000","last_clean":"2023-09-30T16:49:11.978014+0000","last_became_active":"2023-09-30T16:49:10.631149+0000","last_became_peered":"2023-09-30T16:49:10.631149+0000","last_unstale":"2023-09-30T16:49:11.978014+0000","last_undegraded":"2023-09-30T16:49:11.978014+0000","last_fullsized":"2023-09-30T16:49:11.978014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977411+0000","last_change":"2023-09-30T16:49:10.633919+0000","last_active":"2023-09-30T16:49:11.977411+0000","last_peered":"2023-09-30T16:49:11.977411+0000","last_clean":"2023-09-30T16:49:11.977411+0000","last_became_active":"2023-09-30T16:49:10.633415+0000","last_became_peered":"2023-09-30T16:49:10.633415+0000","last_unstale":"2023-09-30T16:49:11.977411+0000","last_undegraded":"2023-09-30T16:49:11.977411+0000","last_fullsized":"2023-09-30T16:49:11.977411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:06.308183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976984+0000","last_change":"2023-09-30T16:49:10.638963+0000","last_active":"2023-09-30T16:49:11.976984+0000","last_peered":"2023-09-30T16:49:11.976984+0000","last_clean":"2023-09-30T16:49:11.976984+0000","last_became_active":"2023-09-30T16:49:10.638232+0000","last_became_peered":"2023-09-30T16:49:10.638232+0000","last_unstale":"2023-09-30T16:49:11.976984+0000","last_undegraded":"2023-09-30T16:49:11.976984+0000","last_fullsized":"2023-09-30T16:49:11.976984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:14.058908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601136+0000","last_change":"2023-09-30T16:49:10.635159+0000","last_active":"2023-09-30T16:49:11.601136+0000","last_peered":"2023-09-30T16:49:11.601136+0000","last_clean":"2023-09-30T16:49:11.601136+0000","last_became_active":"2023-09-30T16:49:10.634816+0000","last_became_peered":"2023-09-30T16:49:10.634816+0000","last_unstale":"2023-09-30T16:49:11.601136+0000","last_undegraded":"2023-09-30T16:49:11.601136+0000","last_fullsized":"2023-09-30T16:49:11.601136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:56.576610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601222+0000","last_change":"2023-09-30T16:49:10.623197+0000","last_active":"2023-09-30T16:49:11.601222+0000","last_peered":"2023-09-30T16:49:11.601222+0000","last_clean":"2023-09-30T16:49:11.601222+0000","last_became_active":"2023-09-30T16:49:10.622869+0000","last_became_peered":"2023-09-30T16:49:10.622869+0000","last_unstale":"2023-09-30T16:49:11.601222+0000","last_undegraded":"2023-09-30T16:49:11.601222+0000","last_fullsized":"2023-09-30T16:49:11.601222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:50.982816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976170+0000","last_change":"2023-09-30T16:49:10.636242+0000","last_active":"2023-09-30T16:49:11.976170+0000","last_peered":"2023-09-30T16:49:11.976170+0000","last_clean":"2023-09-30T16:49:11.976170+0000","last_became_active":"2023-09-30T16:49:10.635932+0000","last_became_peered":"2023-09-30T16:49:10.635932+0000","last_unstale":"2023-09-30T16:49:11.976170+0000","last_undegraded":"2023-09-30T16:49:11.976170+0000","last_fullsized":"2023-09-30T16:49:11.976170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977806+0000","last_change":"2023-09-30T16:49:10.617833+0000","last_active":"2023-09-30T16:49:11.977806+0000","last_peered":"2023-09-30T16:49:11.977806+0000","last_clean":"2023-09-30T16:49:11.977806+0000","last_became_active":"2023-09-30T16:49:10.617311+0000","last_became_peered":"2023-09-30T16:49:10.617311+0000","last_unstale":"2023-09-30T16:49:11.977806+0000","last_undegraded":"2023-09-30T16:49:11.977806+0000","last_fullsized":"2023-09-30T16:49:11.977806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978520+0000","last_change":"2023-09-30T16:49:10.635091+0000","last_active":"2023-09-30T16:49:11.978520+0000","last_peered":"2023-09-30T16:49:11.978520+0000","last_clean":"2023-09-30T16:49:11.978520+0000","last_became_active":"2023-09-30T16:49:10.633981+0000","last_became_peered":"2023-09-30T16:49:10.633981+0000","last_unstale":"2023-09-30T16:49:11.978520+0000","last_undegraded":"2023-09-30T16:49:11.978520+0000","last_fullsized":"2023-09-30T16:49:11.978520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:09:36.748081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977435+0000","last_change":"2023-09-30T16:49:10.628753+0000","last_active":"2023-09-30T16:49:11.977435+0000","last_peered":"2023-09-30T16:49:11.977435+0000","last_clean":"2023-09-30T16:49:11.977435+0000","last_became_active":"2023-09-30T16:49:10.628478+0000","last_became_peered":"2023-09-30T16:49:10.628478+0000","last_unstale":"2023-09-30T16:49:11.977435+0000","last_undegraded":"2023-09-30T16:49:11.977435+0000","last_fullsized":"2023-09-30T16:49:11.977435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979513+0000","last_change":"2023-09-30T16:49:10.629633+0000","last_active":"2023-09-30T16:49:11.979513+0000","last_peered":"2023-09-30T16:49:11.979513+0000","last_clean":"2023-09-30T16:49:11.979513+0000","last_became_active":"2023-09-30T16:49:10.629202+0000","last_became_peered":"2023-09-30T16:49:10.629202+0000","last_unstale":"2023-09-30T16:49:11.979513+0000","last_undegraded":"2023-09-30T16:49:11.979513+0000","last_fullsized":"2023-09-30T16:49:11.979513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:21:16.999794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977323+0000","last_change":"2023-09-30T16:49:10.638755+0000","last_active":"2023-09-30T16:49:11.977323+0000","last_peered":"2023-09-30T16:49:11.977323+0000","last_clean":"2023-09-30T16:49:11.977323+0000","last_became_active":"2023-09-30T16:49:10.637877+0000","last_became_peered":"2023-09-30T16:49:10.637877+0000","last_unstale":"2023-09-30T16:49:11.977323+0000","last_undegraded":"2023-09-30T16:49:11.977323+0000","last_fullsized":"2023-09-30T16:49:11.977323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:14.992346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601810+0000","last_change":"2023-09-30T16:49:10.604164+0000","last_active":"2023-09-30T16:49:11.601810+0000","last_peered":"2023-09-30T16:49:11.601810+0000","last_clean":"2023-09-30T16:49:11.601810+0000","last_became_active":"2023-09-30T16:49:10.603748+0000","last_became_peered":"2023-09-30T16:49:10.603748+0000","last_unstale":"2023-09-30T16:49:11.601810+0000","last_undegraded":"2023-09-30T16:49:11.601810+0000","last_fullsized":"2023-09-30T16:49:11.601810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976548+0000","last_change":"2023-09-30T16:49:10.622204+0000","last_active":"2023-09-30T16:49:11.976548+0000","last_peered":"2023-09-30T16:49:11.976548+0000","last_clean":"2023-09-30T16:49:11.976548+0000","last_became_active":"2023-09-30T16:49:10.621777+0000","last_became_peered":"2023-09-30T16:49:10.621777+0000","last_unstale":"2023-09-30T16:49:11.976548+0000","last_undegraded":"2023-09-30T16:49:11.976548+0000","last_fullsized":"2023-09-30T16:49:11.976548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978154+0000","last_change":"2023-09-30T16:49:10.630731+0000","last_active":"2023-09-30T16:49:11.978154+0000","last_peered":"2023-09-30T16:49:11.978154+0000","last_clean":"2023-09-30T16:49:11.978154+0000","last_became_active":"2023-09-30T16:49:10.630397+0000","last_became_peered":"2023-09-30T16:49:10.630397+0000","last_unstale":"2023-09-30T16:49:11.978154+0000","last_undegraded":"2023-09-30T16:49:11.978154+0000","last_fullsized":"2023-09-30T16:49:11.978154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:56:20.514299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976860+0000","last_change":"2023-09-30T16:49:10.632997+0000","last_active":"2023-09-30T16:49:11.976860+0000","last_peered":"2023-09-30T16:49:11.976860+0000","last_clean":"2023-09-30T16:49:11.976860+0000","last_became_active":"2023-09-30T16:49:10.631924+0000","last_became_peered":"2023-09-30T16:49:10.631924+0000","last_unstale":"2023-09-30T16:49:11.976860+0000","last_undegraded":"2023-09-30T16:49:11.976860+0000","last_fullsized":"2023-09-30T16:49:11.976860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:24.961600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597835+0000","last_change":"2023-09-30T16:49:10.619518+0000","last_active":"2023-09-30T16:49:11.597835+0000","last_peered":"2023-09-30T16:49:11.597835+0000","last_clean":"2023-09-30T16:49:11.597835+0000","last_became_active":"2023-09-30T16:49:10.619041+0000","last_became_peered":"2023-09-30T16:49:10.619041+0000","last_unstale":"2023-09-30T16:49:11.597835+0000","last_undegraded":"2023-09-30T16:49:11.597835+0000","last_fullsized":"2023-09-30T16:49:11.597835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:34:06.083677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601356+0000","last_change":"2023-09-30T16:49:10.623431+0000","last_active":"2023-09-30T16:49:11.601356+0000","last_peered":"2023-09-30T16:49:11.601356+0000","last_clean":"2023-09-30T16:49:11.601356+0000","last_became_active":"2023-09-30T16:49:10.623009+0000","last_became_peered":"2023-09-30T16:49:10.623009+0000","last_unstale":"2023-09-30T16:49:11.601356+0000","last_undegraded":"2023-09-30T16:49:11.601356+0000","last_fullsized":"2023-09-30T16:49:11.601356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601808+0000","last_change":"2023-09-30T16:49:10.639015+0000","last_active":"2023-09-30T16:49:11.601808+0000","last_peered":"2023-09-30T16:49:11.601808+0000","last_clean":"2023-09-30T16:49:11.601808+0000","last_became_active":"2023-09-30T16:49:10.638680+0000","last_became_peered":"2023-09-30T16:49:10.638680+0000","last_unstale":"2023-09-30T16:49:11.601808+0000","last_undegraded":"2023-09-30T16:49:11.601808+0000","last_fullsized":"2023-09-30T16:49:11.601808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976602+0000","last_change":"2023-09-30T16:49:10.623827+0000","last_active":"2023-09-30T16:49:11.976602+0000","last_peered":"2023-09-30T16:49:11.976602+0000","last_clean":"2023-09-30T16:49:11.976602+0000","last_became_active":"2023-09-30T16:49:10.623133+0000","last_became_peered":"2023-09-30T16:49:10.623133+0000","last_unstale":"2023-09-30T16:49:11.976602+0000","last_undegraded":"2023-09-30T16:49:11.976602+0000","last_fullsized":"2023-09-30T16:49:11.976602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976867+0000","last_change":"2023-09-30T16:49:10.632416+0000","last_active":"2023-09-30T16:49:11.976867+0000","last_peered":"2023-09-30T16:49:11.976867+0000","last_clean":"2023-09-30T16:49:11.976867+0000","last_became_active":"2023-09-30T16:49:10.631982+0000","last_became_peered":"2023-09-30T16:49:10.631982+0000","last_unstale":"2023-09-30T16:49:11.976867+0000","last_undegraded":"2023-09-30T16:49:11.976867+0000","last_fullsized":"2023-09-30T16:49:11.976867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975991+0000","last_change":"2023-09-30T16:49:10.624572+0000","last_active":"2023-09-30T16:49:11.975991+0000","last_peered":"2023-09-30T16:49:11.975991+0000","last_clean":"2023-09-30T16:49:11.975991+0000","last_became_active":"2023-09-30T16:49:10.624284+0000","last_became_peered":"2023-09-30T16:49:10.624284+0000","last_unstale":"2023-09-30T16:49:11.975991+0000","last_undegraded":"2023-09-30T16:49:11.975991+0000","last_fullsized":"2023-09-30T16:49:11.975991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.596894+0000","last_change":"2023-09-30T16:49:10.614544+0000","last_active":"2023-09-30T16:49:11.596894+0000","last_peered":"2023-09-30T16:49:11.596894+0000","last_clean":"2023-09-30T16:49:11.596894+0000","last_became_active":"2023-09-30T16:49:10.614152+0000","last_became_peered":"2023-09-30T16:49:10.614152+0000","last_unstale":"2023-09-30T16:49:11.596894+0000","last_undegraded":"2023-09-30T16:49:11.596894+0000","last_fullsized":"2023-09-30T16:49:11.596894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976846+0000","last_change":"2023-09-30T16:49:09.619255+0000","last_active":"2023-09-30T16:49:11.976846+0000","last_peered":"2023-09-30T16:49:11.976846+0000","last_clean":"2023-09-30T16:49:11.976846+0000","last_became_active":"2023-09-30T16:49:09.618555+0000","last_became_peered":"2023-09-30T16:49:09.618555+0000","last_unstale":"2023-09-30T16:49:11.976846+0000","last_undegraded":"2023-09-30T16:49:11.976846+0000","last_fullsized":"2023-09-30T16:49:11.976846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601602+0000","last_change":"2023-09-30T16:49:10.634574+0000","last_active":"2023-09-30T16:49:11.601602+0000","last_peered":"2023-09-30T16:49:11.601602+0000","last_clean":"2023-09-30T16:49:11.601602+0000","last_became_active":"2023-09-30T16:49:10.634290+0000","last_became_peered":"2023-09-30T16:49:10.634290+0000","last_unstale":"2023-09-30T16:49:11.601602+0000","last_undegraded":"2023-09-30T16:49:11.601602+0000","last_fullsized":"2023-09-30T16:49:11.601602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977368+0000","last_change":"2023-09-30T16:49:09.591524+0000","last_active":"2023-09-30T16:49:11.977368+0000","last_peered":"2023-09-30T16:49:11.977368+0000","last_clean":"2023-09-30T16:49:11.977368+0000","last_became_active":"2023-09-30T16:49:09.591196+0000","last_became_peered":"2023-09-30T16:49:09.591196+0000","last_unstale":"2023-09-30T16:49:11.977368+0000","last_undegraded":"2023-09-30T16:49:11.977368+0000","last_fullsized":"2023-09-30T16:49:11.977368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:05.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601646+0000","last_change":"2023-09-30T16:49:09.593605+0000","last_active":"2023-09-30T16:49:11.601646+0000","last_peered":"2023-09-30T16:49:11.601646+0000","last_clean":"2023-09-30T16:49:11.601646+0000","last_became_active":"2023-09-30T16:49:09.592556+0000","last_became_peered":"2023-09-30T16:49:09.592556+0000","last_unstale":"2023-09-30T16:49:11.601646+0000","last_undegraded":"2023-09-30T16:49:11.601646+0000","last_fullsized":"2023-09-30T16:49:11.601646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:22.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977552+0000","last_change":"2023-09-30T16:49:10.626630+0000","last_active":"2023-09-30T16:49:11.977552+0000","last_peered":"2023-09-30T16:49:11.977552+0000","last_clean":"2023-09-30T16:49:11.977552+0000","last_became_active":"2023-09-30T16:49:10.626316+0000","last_became_peered":"2023-09-30T16:49:10.626316+0000","last_unstale":"2023-09-30T16:49:11.977552+0000","last_undegraded":"2023-09-30T16:49:11.977552+0000","last_fullsized":"2023-09-30T16:49:11.977552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:38.419701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978195+0000","last_change":"2023-09-30T16:49:09.594246+0000","last_active":"2023-09-30T16:49:11.978195+0000","last_peered":"2023-09-30T16:49:11.978195+0000","last_clean":"2023-09-30T16:49:11.978195+0000","last_became_active":"2023-09-30T16:49:09.593915+0000","last_became_peered":"2023-09-30T16:49:09.593915+0000","last_unstale":"2023-09-30T16:49:11.978195+0000","last_undegraded":"2023-09-30T16:49:11.978195+0000","last_fullsized":"2023-09-30T16:49:11.978195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601785+0000","last_change":"2023-09-30T16:49:10.626401+0000","last_active":"2023-09-30T16:49:11.601785+0000","last_peered":"2023-09-30T16:49:11.601785+0000","last_clean":"2023-09-30T16:49:11.601785+0000","last_became_active":"2023-09-30T16:49:10.621995+0000","last_became_peered":"2023-09-30T16:49:10.621995+0000","last_unstale":"2023-09-30T16:49:11.601785+0000","last_undegraded":"2023-09-30T16:49:11.601785+0000","last_fullsized":"2023-09-30T16:49:11.601785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.613752+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.613471+0000","last_became_peered":"2023-09-30T16:49:10.613471+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:50.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978231+0000","last_change":"2023-09-30T16:49:09.592279+0000","last_active":"2023-09-30T16:49:11.978231+0000","last_peered":"2023-09-30T16:49:11.978231+0000","last_clean":"2023-09-30T16:49:11.978231+0000","last_became_active":"2023-09-30T16:49:09.591878+0000","last_became_peered":"2023-09-30T16:49:09.591878+0000","last_unstale":"2023-09-30T16:49:11.978231+0000","last_undegraded":"2023-09-30T16:49:11.978231+0000","last_fullsized":"2023-09-30T16:49:11.978231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.044504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977588+0000","last_change":"2023-09-30T16:49:10.628129+0000","last_active":"2023-09-30T16:49:11.977588+0000","last_peered":"2023-09-30T16:49:11.977588+0000","last_clean":"2023-09-30T16:49:11.977588+0000","last_became_active":"2023-09-30T16:49:10.627840+0000","last_became_peered":"2023-09-30T16:49:10.627840+0000","last_unstale":"2023-09-30T16:49:11.977588+0000","last_undegraded":"2023-09-30T16:49:11.977588+0000","last_fullsized":"2023-09-30T16:49:11.977588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:05:15.929844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977128+0000","last_change":"2023-09-30T16:49:09.612101+0000","last_active":"2023-09-30T16:49:11.977128+0000","last_peered":"2023-09-30T16:49:11.977128+0000","last_clean":"2023-09-30T16:49:11.977128+0000","last_became_active":"2023-09-30T16:49:09.611560+0000","last_became_peered":"2023-09-30T16:49:09.611560+0000","last_unstale":"2023-09-30T16:49:11.977128+0000","last_undegraded":"2023-09-30T16:49:11.977128+0000","last_fullsized":"2023-09-30T16:49:11.977128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:15.187430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976893+0000","last_change":"2023-09-30T16:49:10.619592+0000","last_active":"2023-09-30T16:49:11.976893+0000","last_peered":"2023-09-30T16:49:11.976893+0000","last_clean":"2023-09-30T16:49:11.976893+0000","last_became_active":"2023-09-30T16:49:10.619251+0000","last_became_peered":"2023-09-30T16:49:10.619251+0000","last_unstale":"2023-09-30T16:49:11.976893+0000","last_undegraded":"2023-09-30T16:49:11.976893+0000","last_fullsized":"2023-09-30T16:49:11.976893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597687+0000","last_change":"2023-09-30T16:49:09.606217+0000","last_active":"2023-09-30T16:49:11.597687+0000","last_peered":"2023-09-30T16:49:11.597687+0000","last_clean":"2023-09-30T16:49:11.597687+0000","last_became_active":"2023-09-30T16:49:09.605883+0000","last_became_peered":"2023-09-30T16:49:09.605883+0000","last_unstale":"2023-09-30T16:49:11.597687+0000","last_undegraded":"2023-09-30T16:49:11.597687+0000","last_fullsized":"2023-09-30T16:49:11.597687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:20:46.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977809+0000","last_change":"2023-09-30T16:49:10.633013+0000","last_active":"2023-09-30T16:49:11.977809+0000","last_peered":"2023-09-30T16:49:11.977809+0000","last_clean":"2023-09-30T16:49:11.977809+0000","last_became_active":"2023-09-30T16:49:10.626780+0000","last_became_peered":"2023-09-30T16:49:10.626780+0000","last_unstale":"2023-09-30T16:49:11.977809+0000","last_undegraded":"2023-09-30T16:49:11.977809+0000","last_fullsized":"2023-09-30T16:49:11.977809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:14:01.374332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977545+0000","last_change":"2023-09-30T16:49:09.601823+0000","last_active":"2023-09-30T16:49:11.977545+0000","last_peered":"2023-09-30T16:49:11.977545+0000","last_clean":"2023-09-30T16:49:11.977545+0000","last_became_active":"2023-09-30T16:49:09.600844+0000","last_became_peered":"2023-09-30T16:49:09.600844+0000","last_unstale":"2023-09-30T16:49:11.977545+0000","last_undegraded":"2023-09-30T16:49:11.977545+0000","last_fullsized":"2023-09-30T16:49:11.977545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:12:56.898098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601684+0000","last_change":"2023-09-30T16:49:10.619205+0000","last_active":"2023-09-30T16:49:11.601684+0000","last_peered":"2023-09-30T16:49:11.601684+0000","last_clean":"2023-09-30T16:49:11.601684+0000","last_became_active":"2023-09-30T16:49:10.618841+0000","last_became_peered":"2023-09-30T16:49:10.618841+0000","last_unstale":"2023-09-30T16:49:11.601684+0000","last_undegraded":"2023-09-30T16:49:11.601684+0000","last_fullsized":"2023-09-30T16:49:11.601684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977431+0000","last_change":"2023-09-30T16:49:09.596896+0000","last_active":"2023-09-30T16:49:11.977431+0000","last_peered":"2023-09-30T16:49:11.977431+0000","last_clean":"2023-09-30T16:49:11.977431+0000","last_became_active":"2023-09-30T16:49:09.596566+0000","last_became_peered":"2023-09-30T16:49:09.596566+0000","last_unstale":"2023-09-30T16:49:11.977431+0000","last_undegraded":"2023-09-30T16:49:11.977431+0000","last_fullsized":"2023-09-30T16:49:11.977431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:13.982791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979825+0000","last_change":"2023-09-30T16:49:10.637755+0000","last_active":"2023-09-30T16:49:11.979825+0000","last_peered":"2023-09-30T16:49:11.979825+0000","last_clean":"2023-09-30T16:49:11.979825+0000","last_became_active":"2023-09-30T16:49:10.637423+0000","last_became_peered":"2023-09-30T16:49:10.637423+0000","last_unstale":"2023-09-30T16:49:11.979825+0000","last_undegraded":"2023-09-30T16:49:11.979825+0000","last_fullsized":"2023-09-30T16:49:11.979825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:08.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976207+0000","last_change":"2023-09-30T16:49:09.595029+0000","last_active":"2023-09-30T16:49:11.976207+0000","last_peered":"2023-09-30T16:49:11.976207+0000","last_clean":"2023-09-30T16:49:11.976207+0000","last_became_active":"2023-09-30T16:49:09.594386+0000","last_became_peered":"2023-09-30T16:49:09.594386+0000","last_unstale":"2023-09-30T16:49:11.976207+0000","last_undegraded":"2023-09-30T16:49:11.976207+0000","last_fullsized":"2023-09-30T16:49:11.976207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:00.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602079+0000","last_change":"2023-09-30T16:49:09.598236+0000","last_active":"2023-09-30T16:49:11.602079+0000","last_peered":"2023-09-30T16:49:11.602079+0000","last_clean":"2023-09-30T16:49:11.602079+0000","last_became_active":"2023-09-30T16:49:09.597544+0000","last_became_peered":"2023-09-30T16:49:09.597544+0000","last_unstale":"2023-09-30T16:49:11.602079+0000","last_undegraded":"2023-09-30T16:49:11.602079+0000","last_fullsized":"2023-09-30T16:49:11.602079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:55.567056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978555+0000","last_change":"2023-09-30T16:49:10.617486+0000","last_active":"2023-09-30T16:49:11.978555+0000","last_peered":"2023-09-30T16:49:11.978555+0000","last_clean":"2023-09-30T16:49:11.978555+0000","last_became_active":"2023-09-30T16:49:10.617170+0000","last_became_peered":"2023-09-30T16:49:10.617170+0000","last_unstale":"2023-09-30T16:49:11.978555+0000","last_undegraded":"2023-09-30T16:49:11.978555+0000","last_fullsized":"2023-09-30T16:49:11.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:12.868894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978921+0000","last_change":"2023-09-30T16:49:09.614260+0000","last_active":"2023-09-30T16:49:11.978921+0000","last_peered":"2023-09-30T16:49:11.978921+0000","last_clean":"2023-09-30T16:49:11.978921+0000","last_became_active":"2023-09-30T16:49:09.613910+0000","last_became_peered":"2023-09-30T16:49:09.613910+0000","last_unstale":"2023-09-30T16:49:11.978921+0000","last_undegraded":"2023-09-30T16:49:11.978921+0000","last_fullsized":"2023-09-30T16:49:11.978921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598019+0000","last_change":"2023-09-30T16:49:10.631809+0000","last_active":"2023-09-30T16:49:11.598019+0000","last_peered":"2023-09-30T16:49:11.598019+0000","last_clean":"2023-09-30T16:49:11.598019+0000","last_became_active":"2023-09-30T16:49:10.631420+0000","last_became_peered":"2023-09-30T16:49:10.631420+0000","last_unstale":"2023-09-30T16:49:11.598019+0000","last_undegraded":"2023-09-30T16:49:11.598019+0000","last_fullsized":"2023-09-30T16:49:11.598019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:14.134423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602272+0000","last_change":"2023-09-30T16:49:09.624546+0000","last_active":"2023-09-30T16:49:11.602272+0000","last_peered":"2023-09-30T16:49:11.602272+0000","last_clean":"2023-09-30T16:49:11.602272+0000","last_became_active":"2023-09-30T16:49:09.623841+0000","last_became_peered":"2023-09-30T16:49:09.623841+0000","last_unstale":"2023-09-30T16:49:11.602272+0000","last_undegraded":"2023-09-30T16:49:11.602272+0000","last_fullsized":"2023-09-30T16:49:11.602272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:20.760273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978769+0000","last_change":"2023-09-30T16:49:10.638625+0000","last_active":"2023-09-30T16:49:11.978769+0000","last_peered":"2023-09-30T16:49:11.978769+0000","last_clean":"2023-09-30T16:49:11.978769+0000","last_became_active":"2023-09-30T16:49:10.638153+0000","last_became_peered":"2023-09-30T16:49:10.638153+0000","last_unstale":"2023-09-30T16:49:11.978769+0000","last_undegraded":"2023-09-30T16:49:11.978769+0000","last_fullsized":"2023-09-30T16:49:11.978769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976605+0000","last_change":"2023-09-30T16:49:09.604750+0000","last_active":"2023-09-30T16:49:11.976605+0000","last_peered":"2023-09-30T16:49:11.976605+0000","last_clean":"2023-09-30T16:49:11.976605+0000","last_became_active":"2023-09-30T16:49:09.600838+0000","last_became_peered":"2023-09-30T16:49:09.600838+0000","last_unstale":"2023-09-30T16:49:11.976605+0000","last_undegraded":"2023-09-30T16:49:11.976605+0000","last_fullsized":"2023-09-30T16:49:11.976605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977679+0000","last_change":"2023-09-30T16:49:10.637559+0000","last_active":"2023-09-30T16:49:11.977679+0000","last_peered":"2023-09-30T16:49:11.977679+0000","last_clean":"2023-09-30T16:49:11.977679+0000","last_became_active":"2023-09-30T16:49:10.630340+0000","last_became_peered":"2023-09-30T16:49:10.630340+0000","last_unstale":"2023-09-30T16:49:11.977679+0000","last_undegraded":"2023-09-30T16:49:11.977679+0000","last_fullsized":"2023-09-30T16:49:11.977679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:27.229031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601934+0000","last_change":"2023-09-30T16:49:09.600440+0000","last_active":"2023-09-30T16:49:11.601934+0000","last_peered":"2023-09-30T16:49:11.601934+0000","last_clean":"2023-09-30T16:49:11.601934+0000","last_became_active":"2023-09-30T16:49:09.599554+0000","last_became_peered":"2023-09-30T16:49:09.599554+0000","last_unstale":"2023-09-30T16:49:11.601934+0000","last_undegraded":"2023-09-30T16:49:11.601934+0000","last_fullsized":"2023-09-30T16:49:11.601934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979354+0000","last_change":"2023-09-30T16:49:10.620991+0000","last_active":"2023-09-30T16:49:11.979354+0000","last_peered":"2023-09-30T16:49:11.979354+0000","last_clean":"2023-09-30T16:49:11.979354+0000","last_became_active":"2023-09-30T16:49:10.620738+0000","last_became_peered":"2023-09-30T16:49:10.620738+0000","last_unstale":"2023-09-30T16:49:11.979354+0000","last_undegraded":"2023-09-30T16:49:11.979354+0000","last_fullsized":"2023-09-30T16:49:11.979354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:31.181804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.980054+0000","last_change":"2023-09-30T16:49:09.594466+0000","last_active":"2023-09-30T16:49:11.980054+0000","last_peered":"2023-09-30T16:49:11.980054+0000","last_clean":"2023-09-30T16:49:11.980054+0000","last_became_active":"2023-09-30T16:49:09.593975+0000","last_became_peered":"2023-09-30T16:49:09.593975+0000","last_unstale":"2023-09-30T16:49:11.980054+0000","last_undegraded":"2023-09-30T16:49:11.980054+0000","last_fullsized":"2023-09-30T16:49:11.980054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:24.904253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601532+0000","last_change":"2023-09-30T16:49:10.617041+0000","last_active":"2023-09-30T16:49:11.601532+0000","last_peered":"2023-09-30T16:49:11.601532+0000","last_clean":"2023-09-30T16:49:11.601532+0000","last_became_active":"2023-09-30T16:49:10.616673+0000","last_became_peered":"2023-09-30T16:49:10.616673+0000","last_unstale":"2023-09-30T16:49:11.601532+0000","last_undegraded":"2023-09-30T16:49:11.601532+0000","last_fullsized":"2023-09-30T16:49:11.601532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979257+0000","last_change":"2023-09-30T16:49:09.619350+0000","last_active":"2023-09-30T16:49:11.979257+0000","last_peered":"2023-09-30T16:49:11.979257+0000","last_clean":"2023-09-30T16:49:11.979257+0000","last_became_active":"2023-09-30T16:49:09.619032+0000","last_became_peered":"2023-09-30T16:49:09.619032+0000","last_unstale":"2023-09-30T16:49:11.979257+0000","last_undegraded":"2023-09-30T16:49:11.979257+0000","last_fullsized":"2023-09-30T16:49:11.979257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.600797+0000","last_change":"2023-09-30T16:49:10.618387+0000","last_active":"2023-09-30T16:49:11.600797+0000","last_peered":"2023-09-30T16:49:11.600797+0000","last_clean":"2023-09-30T16:49:11.600797+0000","last_became_active":"2023-09-30T16:49:10.618048+0000","last_became_peered":"2023-09-30T16:49:10.618048+0000","last_unstale":"2023-09-30T16:49:11.600797+0000","last_undegraded":"2023-09-30T16:49:11.600797+0000","last_fullsized":"2023-09-30T16:49:11.600797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:31.999294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977896+0000","last_change":"2023-09-30T16:49:09.620418+0000","last_active":"2023-09-30T16:49:11.977896+0000","last_peered":"2023-09-30T16:49:11.977896+0000","last_clean":"2023-09-30T16:49:11.977896+0000","last_became_active":"2023-09-30T16:49:09.619799+0000","last_became_peered":"2023-09-30T16:49:09.619799+0000","last_unstale":"2023-09-30T16:49:11.977896+0000","last_undegraded":"2023-09-30T16:49:11.977896+0000","last_fullsized":"2023-09-30T16:49:11.977896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:38.582461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977037+0000","last_change":"2023-09-30T16:49:10.629792+0000","last_active":"2023-09-30T16:49:11.977037+0000","last_peered":"2023-09-30T16:49:11.977037+0000","last_clean":"2023-09-30T16:49:11.977037+0000","last_became_active":"2023-09-30T16:49:10.629460+0000","last_became_peered":"2023-09-30T16:49:10.629460+0000","last_unstale":"2023-09-30T16:49:11.977037+0000","last_undegraded":"2023-09-30T16:49:11.977037+0000","last_fullsized":"2023-09-30T16:49:11.977037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:20:56.822877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977632+0000","last_change":"2023-09-30T16:49:09.603654+0000","last_active":"2023-09-30T16:49:11.977632+0000","last_peered":"2023-09-30T16:49:11.977632+0000","last_clean":"2023-09-30T16:49:11.977632+0000","last_became_active":"2023-09-30T16:49:09.603267+0000","last_became_peered":"2023-09-30T16:49:09.603267+0000","last_unstale":"2023-09-30T16:49:11.977632+0000","last_undegraded":"2023-09-30T16:49:11.977632+0000","last_fullsized":"2023-09-30T16:49:11.977632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:26.219476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977808+0000","last_change":"2023-09-30T16:49:10.636453+0000","last_active":"2023-09-30T16:49:11.977808+0000","last_peered":"2023-09-30T16:49:11.977808+0000","last_clean":"2023-09-30T16:49:11.977808+0000","last_became_active":"2023-09-30T16:49:10.635319+0000","last_became_peered":"2023-09-30T16:49:10.635319+0000","last_unstale":"2023-09-30T16:49:11.977808+0000","last_undegraded":"2023-09-30T16:49:11.977808+0000","last_fullsized":"2023-09-30T16:49:11.977808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976636+0000","last_change":"2023-09-30T16:49:09.618129+0000","last_active":"2023-09-30T16:49:11.976636+0000","last_peered":"2023-09-30T16:49:11.976636+0000","last_clean":"2023-09-30T16:49:11.976636+0000","last_became_active":"2023-09-30T16:49:09.616087+0000","last_became_peered":"2023-09-30T16:49:09.616087+0000","last_unstale":"2023-09-30T16:49:11.976636+0000","last_undegraded":"2023-09-30T16:49:11.976636+0000","last_fullsized":"2023-09-30T16:49:11.976636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597311+0000","last_change":"2023-09-30T16:49:10.618572+0000","last_active":"2023-09-30T16:49:11.597311+0000","last_peered":"2023-09-30T16:49:11.597311+0000","last_clean":"2023-09-30T16:49:11.597311+0000","last_became_active":"2023-09-30T16:49:10.618246+0000","last_became_peered":"2023-09-30T16:49:10.618246+0000","last_unstale":"2023-09-30T16:49:11.597311+0000","last_undegraded":"2023-09-30T16:49:11.597311+0000","last_fullsized":"2023-09-30T16:49:11.597311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979624+0000","last_change":"2023-09-30T16:49:09.611197+0000","last_active":"2023-09-30T16:49:11.979624+0000","last_peered":"2023-09-30T16:49:11.979624+0000","last_clean":"2023-09-30T16:49:11.979624+0000","last_became_active":"2023-09-30T16:49:09.610929+0000","last_became_peered":"2023-09-30T16:49:09.610929+0000","last_unstale":"2023-09-30T16:49:11.979624+0000","last_undegraded":"2023-09-30T16:49:11.979624+0000","last_fullsized":"2023-09-30T16:49:11.979624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:49.375737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601989+0000","last_change":"2023-09-30T16:49:10.632399+0000","last_active":"2023-09-30T16:49:11.601989+0000","last_peered":"2023-09-30T16:49:11.601989+0000","last_clean":"2023-09-30T16:49:11.601989+0000","last_became_active":"2023-09-30T16:49:10.632044+0000","last_became_peered":"2023-09-30T16:49:10.632044+0000","last_unstale":"2023-09-30T16:49:11.601989+0000","last_undegraded":"2023-09-30T16:49:11.601989+0000","last_fullsized":"2023-09-30T16:49:11.601989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:13.473608+0000","last_change":"2023-09-30T16:49:09.598092+0000","last_active":"2023-09-30T16:49:13.473608+0000","last_peered":"2023-09-30T16:49:13.473608+0000","last_clean":"2023-09-30T16:49:13.473608+0000","last_became_active":"2023-09-30T16:49:09.597294+0000","last_became_peered":"2023-09-30T16:49:09.597294+0000","last_unstale":"2023-09-30T16:49:13.473608+0000","last_undegraded":"2023-09-30T16:49:13.473608+0000","last_fullsized":"2023-09-30T16:49:13.473608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602370+0000","last_change":"2023-09-30T16:49:10.628648+0000","last_active":"2023-09-30T16:49:11.602370+0000","last_peered":"2023-09-30T16:49:11.602370+0000","last_clean":"2023-09-30T16:49:11.602370+0000","last_became_active":"2023-09-30T16:49:10.619172+0000","last_became_peered":"2023-09-30T16:49:10.619172+0000","last_unstale":"2023-09-30T16:49:11.602370+0000","last_undegraded":"2023-09-30T16:49:11.602370+0000","last_fullsized":"2023-09-30T16:49:11.602370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978385+0000","last_change":"2023-09-30T16:49:09.591867+0000","last_active":"2023-09-30T16:49:11.978385+0000","last_peered":"2023-09-30T16:49:11.978385+0000","last_clean":"2023-09-30T16:49:11.978385+0000","last_became_active":"2023-09-30T16:49:09.591062+0000","last_became_peered":"2023-09-30T16:49:09.591062+0000","last_unstale":"2023-09-30T16:49:11.978385+0000","last_undegraded":"2023-09-30T16:49:11.978385+0000","last_fullsized":"2023-09-30T16:49:11.978385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:35.797259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602280+0000","last_change":"2023-09-30T16:49:10.621227+0000","last_active":"2023-09-30T16:49:11.602280+0000","last_peered":"2023-09-30T16:49:11.602280+0000","last_clean":"2023-09-30T16:49:11.602280+0000","last_became_active":"2023-09-30T16:49:10.620861+0000","last_became_peered":"2023-09-30T16:49:10.620861+0000","last_unstale":"2023-09-30T16:49:11.602280+0000","last_undegraded":"2023-09-30T16:49:11.602280+0000","last_fullsized":"2023-09-30T16:49:11.602280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975957+0000","last_change":"2023-09-30T16:49:09.593530+0000","last_active":"2023-09-30T16:49:11.975957+0000","last_peered":"2023-09-30T16:49:11.975957+0000","last_clean":"2023-09-30T16:49:11.975957+0000","last_became_active":"2023-09-30T16:49:09.593238+0000","last_became_peered":"2023-09-30T16:49:09.593238+0000","last_unstale":"2023-09-30T16:49:11.975957+0000","last_undegraded":"2023-09-30T16:49:11.975957+0000","last_fullsized":"2023-09-30T16:49:11.975957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:13.124869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978879+0000","last_change":"2023-09-30T16:49:10.629665+0000","last_active":"2023-09-30T16:49:11.978879+0000","last_peered":"2023-09-30T16:49:11.978879+0000","last_clean":"2023-09-30T16:49:11.978879+0000","last_became_active":"2023-09-30T16:49:10.629348+0000","last_became_peered":"2023-09-30T16:49:10.629348+0000","last_unstale":"2023-09-30T16:49:11.978879+0000","last_undegraded":"2023-09-30T16:49:11.978879+0000","last_fullsized":"2023-09-30T16:49:11.978879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:20:08.861216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602018+0000","last_change":"2023-09-30T16:49:09.595063+0000","last_active":"2023-09-30T16:49:11.602018+0000","last_peered":"2023-09-30T16:49:11.602018+0000","last_clean":"2023-09-30T16:49:11.602018+0000","last_became_active":"2023-09-30T16:49:09.592082+0000","last_became_peered":"2023-09-30T16:49:09.592082+0000","last_unstale":"2023-09-30T16:49:11.602018+0000","last_undegraded":"2023-09-30T16:49:11.602018+0000","last_fullsized":"2023-09-30T16:49:11.602018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:48.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602131+0000","last_change":"2023-09-30T16:49:10.626413+0000","last_active":"2023-09-30T16:49:11.602131+0000","last_peered":"2023-09-30T16:49:11.602131+0000","last_clean":"2023-09-30T16:49:11.602131+0000","last_became_active":"2023-09-30T16:49:10.626088+0000","last_became_peered":"2023-09-30T16:49:10.626088+0000","last_unstale":"2023-09-30T16:49:11.602131+0000","last_undegraded":"2023-09-30T16:49:11.602131+0000","last_fullsized":"2023-09-30T16:49:11.602131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601518+0000","last_change":"2023-09-30T16:49:09.617357+0000","last_active":"2023-09-30T16:49:11.601518+0000","last_peered":"2023-09-30T16:49:11.601518+0000","last_clean":"2023-09-30T16:49:11.601518+0000","last_became_active":"2023-09-30T16:49:09.616658+0000","last_became_peered":"2023-09-30T16:49:09.616658+0000","last_unstale":"2023-09-30T16:49:11.601518+0000","last_undegraded":"2023-09-30T16:49:11.601518+0000","last_fullsized":"2023-09-30T16:49:11.601518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:00.055876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977595+0000","last_change":"2023-09-30T16:49:10.620209+0000","last_active":"2023-09-30T16:49:11.977595+0000","last_peered":"2023-09-30T16:49:11.977595+0000","last_clean":"2023-09-30T16:49:11.977595+0000","last_became_active":"2023-09-30T16:49:10.619843+0000","last_became_peered":"2023-09-30T16:49:10.619843+0000","last_unstale":"2023-09-30T16:49:11.977595+0000","last_undegraded":"2023-09-30T16:49:11.977595+0000","last_fullsized":"2023-09-30T16:49:11.977595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979943+0000","last_change":"2023-09-30T16:49:09.594732+0000","last_active":"2023-09-30T16:49:11.979943+0000","last_peered":"2023-09-30T16:49:11.979943+0000","last_clean":"2023-09-30T16:49:11.979943+0000","last_became_active":"2023-09-30T16:49:09.594408+0000","last_became_peered":"2023-09-30T16:49:09.594408+0000","last_unstale":"2023-09-30T16:49:11.979943+0000","last_undegraded":"2023-09-30T16:49:11.979943+0000","last_fullsized":"2023-09-30T16:49:11.979943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:13.049354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977210+0000","last_change":"2023-09-30T16:49:10.624221+0000","last_active":"2023-09-30T16:49:11.977210+0000","last_peered":"2023-09-30T16:49:11.977210+0000","last_clean":"2023-09-30T16:49:11.977210+0000","last_became_active":"2023-09-30T16:49:10.623805+0000","last_became_peered":"2023-09-30T16:49:10.623805+0000","last_unstale":"2023-09-30T16:49:11.977210+0000","last_undegraded":"2023-09-30T16:49:11.977210+0000","last_fullsized":"2023-09-30T16:49:11.977210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979180+0000","last_change":"2023-09-30T16:49:10.635402+0000","last_active":"2023-09-30T16:49:11.979180+0000","last_peered":"2023-09-30T16:49:11.979180+0000","last_clean":"2023-09-30T16:49:11.979180+0000","last_became_active":"2023-09-30T16:49:10.634645+0000","last_became_peered":"2023-09-30T16:49:10.634645+0000","last_unstale":"2023-09-30T16:49:11.979180+0000","last_undegraded":"2023-09-30T16:49:11.979180+0000","last_fullsized":"2023-09-30T16:49:11.979180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:06.779362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977933+0000","last_change":"2023-09-30T16:49:09.591559+0000","last_active":"2023-09-30T16:49:11.977933+0000","last_peered":"2023-09-30T16:49:11.977933+0000","last_clean":"2023-09-30T16:49:11.977933+0000","last_became_active":"2023-09-30T16:49:09.591265+0000","last_became_peered":"2023-09-30T16:49:09.591265+0000","last_unstale":"2023-09-30T16:49:11.977933+0000","last_undegraded":"2023-09-30T16:49:11.977933+0000","last_fullsized":"2023-09-30T16:49:11.977933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978073+0000","last_change":"2023-09-30T16:49:09.591796+0000","last_active":"2023-09-30T16:49:11.978073+0000","last_peered":"2023-09-30T16:49:11.978073+0000","last_clean":"2023-09-30T16:49:11.978073+0000","last_became_active":"2023-09-30T16:49:09.591474+0000","last_became_peered":"2023-09-30T16:49:09.591474+0000","last_unstale":"2023-09-30T16:49:11.978073+0000","last_undegraded":"2023-09-30T16:49:11.978073+0000","last_fullsized":"2023-09-30T16:49:11.978073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:45.706321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977248+0000","last_change":"2023-09-30T16:49:10.628239+0000","last_active":"2023-09-30T16:49:11.977248+0000","last_peered":"2023-09-30T16:49:11.977248+0000","last_clean":"2023-09-30T16:49:11.977248+0000","last_became_active":"2023-09-30T16:49:10.627915+0000","last_became_peered":"2023-09-30T16:49:10.627915+0000","last_unstale":"2023-09-30T16:49:11.977248+0000","last_undegraded":"2023-09-30T16:49:11.977248+0000","last_fullsized":"2023-09-30T16:49:11.977248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:40:55.750019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:09.612990+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:09.606939+0000","last_became_peered":"2023-09-30T16:49:09.606939+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:00.151397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977818+0000","last_change":"2023-09-30T16:49:10.631974+0000","last_active":"2023-09-30T16:49:11.977818+0000","last_peered":"2023-09-30T16:49:11.977818+0000","last_clean":"2023-09-30T16:49:11.977818+0000","last_became_active":"2023-09-30T16:49:10.631388+0000","last_became_peered":"2023-09-30T16:49:10.631388+0000","last_unstale":"2023-09-30T16:49:11.977818+0000","last_undegraded":"2023-09-30T16:49:11.977818+0000","last_fullsized":"2023-09-30T16:49:11.977818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:01:27.558052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602467+0000","last_change":"2023-09-30T16:49:09.606230+0000","last_active":"2023-09-30T16:49:11.602467+0000","last_peered":"2023-09-30T16:49:11.602467+0000","last_clean":"2023-09-30T16:49:11.602467+0000","last_became_active":"2023-09-30T16:49:09.605614+0000","last_became_peered":"2023-09-30T16:49:09.605614+0000","last_unstale":"2023-09-30T16:49:11.602467+0000","last_undegraded":"2023-09-30T16:49:11.602467+0000","last_fullsized":"2023-09-30T16:49:11.602467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:30.989740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":74251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":74833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":664689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:23.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:49:23.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 Processor -- start 2023-09-30T16:49:23.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 -- start start 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec15a9d0 0x7f3dec15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3dec06d650 0x7f3dec0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec06c240 con 0x7f3dec0b19b0 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec15adb0 con 0x7f3dec06d650 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df4103640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec15ea90 con 0x7f3dec15a9d0 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df26a0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3dec0b19b0 0x7f3dec0b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40100/0 (socket says 172.21.15.52:40100) 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df26a0640 1 -- 172.21.15.52:0/2926016146 learned_addr learned my addr 172.21.15.52:0/2926016146 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df169e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3dec06d650 0x7f3dec0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df1e9f640 1 --2- 172.21.15.52:0/2926016146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec15a9d0 0x7f3dec15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df0e9d640 1 -- 172.21.15.52:0/2926016146 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015384988 0 0) 0x7f3dec06c240 con 0x7f3dec0b19b0 2023-09-30T16:49:23.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df0e9d640 1 -- 172.21.15.52:0/2926016146 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd8003530 con 0x7f3dec0b19b0 2023-09-30T16:49:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df169e640 1 -- 172.21.15.52:0/2926016146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec15a9d0 msgr2=0x7f3dec15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df169e640 1 --2- 172.21.15.52:0/2926016146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec15a9d0 0x7f3dec15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df169e640 1 -- 172.21.15.52:0/2926016146 >> v1:172.21.15.52:6789/0 conn(0x7f3dec0b19b0 legacy=0x7f3dec0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.522+0000 7f3df169e640 1 -- 172.21.15.52:0/2926016146 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec15ed70 con 0x7f3dec06d650 2023-09-30T16:49:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df169e640 1 --2- 172.21.15.52:0/2926016146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec06d650 0x7f3dec0b1470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0097c0 tx=0x7f3ddc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7c3b04cc1d5274 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df0e9d640 1 -- 172.21.15.52:0/2926016146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0ab600 con 0x7f3dec06d650 2023-09-30T16:49:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df0e9d640 1 -- 172.21.15.52:0/2926016146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0a7050 con 0x7f3dec06d650 2023-09-30T16:49:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df0e9d640 1 -- 172.21.15.52:0/2926016146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0ab960 con 0x7f3dec06d650 2023-09-30T16:49:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- 172.21.15.52:0/2926016146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec06d650 msgr2=0x7f3dec0b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 --2- 172.21.15.52:0/2926016146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec06d650 0x7f3dec0b1470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0097c0 tx=0x7f3ddc01c480 comp rx=0 tx=0).stop 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- 172.21.15.52:0/2926016146 shutdown_connections 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 --2- 172.21.15.52:0/2926016146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec06d650 0x7f3dec0b1470 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 --2- 172.21.15.52:0/2926016146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec15a9d0 0x7f3dec15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- 172.21.15.52:0/2926016146 >> 172.21.15.52:0/2926016146 conn(0x7f3dec06a5f0 msgr2=0x7f3dec0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- 172.21.15.52:0/2926016146 shutdown_connections 2023-09-30T16:49:23.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- 172.21.15.52:0/2926016146 wait complete. 2023-09-30T16:49:23.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 Processor -- start 2023-09-30T16:49:23.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- start start 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3dec06d650 0x7f3dec153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec0b19b0 0x7f3dec1f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 0x7f3dec0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1f7420 con 0x7f3dec15a9d0 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c2620 con 0x7f3dec06d650 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df4103640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1f6e60 con 0x7f3dec0b19b0 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 0x7f3dec0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 0x7f3dec0b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54308/0 (socket says 172.21.15.52:54308) 2023-09-30T16:49:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 -- 172.21.15.52:0/933169357 learned_addr learned my addr 172.21.15.52:0/933169357 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df169e640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec0b19b0 0x7f3dec1f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df1e9f640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3dec06d650 0x7f3dec153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 -- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec0b19b0 msgr2=0x7f3dec1f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec0b19b0 0x7f3dec1f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 -- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3dec06d650 msgr2=0x7f3dec153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3dec06d650 0x7f3dec153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df26a0640 1 -- 172.21.15.52:0/933169357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009420 con 0x7f3dec15a9d0 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.526+0000 7f3df169e640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec0b19b0 0x7f3dec1f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3df26a0640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 0x7f3dec0b2de0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3de400cbb0 tx=0x7f3de400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400ad40 con 0x7f3dec15a9d0 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de4012400 con 0x7f3dec15a9d0 2023-09-30T16:49:23.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec1f7140 con 0x7f3dec15a9d0 2023-09-30T16:49:23.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400aea0 con 0x7f3dec15a9d0 2023-09-30T16:49:23.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec153c90 con 0x7f3dec15a9d0 2023-09-30T16:49:23.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec0c2760 con 0x7f3dec15a9d0 2023-09-30T16:49:23.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f3de4007070 con 0x7f3dec15a9d0 2023-09-30T16:49:23.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3de27fc640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3dd0066160 0x7f3dd0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de4083ba0 con 0x7f3dec15a9d0 2023-09-30T16:49:23.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3df1e9f640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3dd0066160 0x7f3dd0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.530+0000 7f3df1e9f640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3dd0066160 0x7f3dd0068620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3de80096f0 tx=0x7f3de8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.534+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f3de4051350 con 0x7f3dec15a9d0 2023-09-30T16:49:23.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.682+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3dec06dab0 con 0x7f3dd0066160 2023-09-30T16:49:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.710+0000 7f3de27fc640 1 -- 172.21.15.52:0/933169357 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264451 (secure 0 0 0) 0x7f3de800e4c0 con 0x7f3dd0066160 2023-09-30T16:49:23.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3dd0066160 msgr2=0x7f3dd0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3dd0066160 0x7f3dd0068620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3de80096f0 tx=0x7f3de8008040 comp rx=0 tx=0).stop 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 msgr2=0x7f3dec0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 0x7f3dec0b2de0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3de400cbb0 tx=0x7f3de400a430 comp rx=0 tx=0).stop 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 shutdown_connections 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3dd0066160 0x7f3dd0068620 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dec15a9d0 0x7f3dec0b2de0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3dec0b19b0 0x7f3dec1f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 --2- 172.21.15.52:0/933169357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3dec06d650 0x7f3dec153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 >> 172.21.15.52:0/933169357 conn(0x7f3dec06a5f0 msgr2=0x7f3dec0ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 shutdown_connections 2023-09-30T16:49:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.714+0000 7f3df4103640 1 -- 172.21.15.52:0/933169357 wait complete. 2023-09-30T16:49:23.736 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-09-30T16:49:23.461246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235708,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739012,"statfs":{"total":773094113280,"available":772852748288,"internally_reserved":0,"allocated":2957312,"data_stored":1779564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.863575"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978658+0000","last_change":"2023-09-30T16:49:10.633322+0000","last_active":"2023-09-30T16:49:11.978658+0000","last_peered":"2023-09-30T16:49:11.978658+0000","last_clean":"2023-09-30T16:49:11.978658+0000","last_became_active":"2023-09-30T16:49:10.631135+0000","last_became_peered":"2023-09-30T16:49:10.631135+0000","last_unstale":"2023-09-30T16:49:11.978658+0000","last_undegraded":"2023-09-30T16:49:11.978658+0000","last_fullsized":"2023-09-30T16:49:11.978658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976757+0000","last_change":"2023-09-30T16:49:10.632204+0000","last_active":"2023-09-30T16:49:11.976757+0000","last_peered":"2023-09-30T16:49:11.976757+0000","last_clean":"2023-09-30T16:49:11.976757+0000","last_became_active":"2023-09-30T16:49:10.631691+0000","last_became_peered":"2023-09-30T16:49:10.631691+0000","last_unstale":"2023-09-30T16:49:11.976757+0000","last_undegraded":"2023-09-30T16:49:11.976757+0000","last_fullsized":"2023-09-30T16:49:11.976757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:56:24.913821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976467+0000","last_change":"2023-09-30T16:49:10.629832+0000","last_active":"2023-09-30T16:49:11.976467+0000","last_peered":"2023-09-30T16:49:11.976467+0000","last_clean":"2023-09-30T16:49:11.976467+0000","last_became_active":"2023-09-30T16:49:10.629449+0000","last_became_peered":"2023-09-30T16:49:10.629449+0000","last_unstale":"2023-09-30T16:49:11.976467+0000","last_undegraded":"2023-09-30T16:49:11.976467+0000","last_fullsized":"2023-09-30T16:49:11.976467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.604692+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.603126+0000","last_became_peered":"2023-09-30T16:49:10.603126+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:34.821952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:10.633644+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:10.630535+0000","last_became_peered":"2023-09-30T16:49:10.630535+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:25.913808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597358+0000","last_change":"2023-09-30T16:49:10.604995+0000","last_active":"2023-09-30T16:49:11.597358+0000","last_peered":"2023-09-30T16:49:11.597358+0000","last_clean":"2023-09-30T16:49:11.597358+0000","last_became_active":"2023-09-30T16:49:10.603075+0000","last_became_peered":"2023-09-30T16:49:10.603075+0000","last_unstale":"2023-09-30T16:49:11.597358+0000","last_undegraded":"2023-09-30T16:49:11.597358+0000","last_fullsized":"2023-09-30T16:49:11.597358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976179+0000","last_change":"2023-09-30T16:49:10.630597+0000","last_active":"2023-09-30T16:49:11.976179+0000","last_peered":"2023-09-30T16:49:11.976179+0000","last_clean":"2023-09-30T16:49:11.976179+0000","last_became_active":"2023-09-30T16:49:10.626842+0000","last_became_peered":"2023-09-30T16:49:10.626842+0000","last_unstale":"2023-09-30T16:49:11.976179+0000","last_undegraded":"2023-09-30T16:49:11.976179+0000","last_fullsized":"2023-09-30T16:49:11.976179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:25:42.884890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977750+0000","last_change":"2023-09-30T16:49:10.633003+0000","last_active":"2023-09-30T16:49:11.977750+0000","last_peered":"2023-09-30T16:49:11.977750+0000","last_clean":"2023-09-30T16:49:11.977750+0000","last_became_active":"2023-09-30T16:49:10.632147+0000","last_became_peered":"2023-09-30T16:49:10.632147+0000","last_unstale":"2023-09-30T16:49:11.977750+0000","last_undegraded":"2023-09-30T16:49:11.977750+0000","last_fullsized":"2023-09-30T16:49:11.977750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:51:01.956500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976237+0000","last_change":"2023-09-30T16:49:10.615545+0000","last_active":"2023-09-30T16:49:11.976237+0000","last_peered":"2023-09-30T16:49:11.976237+0000","last_clean":"2023-09-30T16:49:11.976237+0000","last_became_active":"2023-09-30T16:49:10.614373+0000","last_became_peered":"2023-09-30T16:49:10.614373+0000","last_unstale":"2023-09-30T16:49:11.976237+0000","last_undegraded":"2023-09-30T16:49:11.976237+0000","last_fullsized":"2023-09-30T16:49:11.976237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:39.915274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978014+0000","last_change":"2023-09-30T16:49:10.633201+0000","last_active":"2023-09-30T16:49:11.978014+0000","last_peered":"2023-09-30T16:49:11.978014+0000","last_clean":"2023-09-30T16:49:11.978014+0000","last_became_active":"2023-09-30T16:49:10.631149+0000","last_became_peered":"2023-09-30T16:49:10.631149+0000","last_unstale":"2023-09-30T16:49:11.978014+0000","last_undegraded":"2023-09-30T16:49:11.978014+0000","last_fullsized":"2023-09-30T16:49:11.978014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977411+0000","last_change":"2023-09-30T16:49:10.633919+0000","last_active":"2023-09-30T16:49:11.977411+0000","last_peered":"2023-09-30T16:49:11.977411+0000","last_clean":"2023-09-30T16:49:11.977411+0000","last_became_active":"2023-09-30T16:49:10.633415+0000","last_became_peered":"2023-09-30T16:49:10.633415+0000","last_unstale":"2023-09-30T16:49:11.977411+0000","last_undegraded":"2023-09-30T16:49:11.977411+0000","last_fullsized":"2023-09-30T16:49:11.977411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:06.308183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976984+0000","last_change":"2023-09-30T16:49:10.638963+0000","last_active":"2023-09-30T16:49:11.976984+0000","last_peered":"2023-09-30T16:49:11.976984+0000","last_clean":"2023-09-30T16:49:11.976984+0000","last_became_active":"2023-09-30T16:49:10.638232+0000","last_became_peered":"2023-09-30T16:49:10.638232+0000","last_unstale":"2023-09-30T16:49:11.976984+0000","last_undegraded":"2023-09-30T16:49:11.976984+0000","last_fullsized":"2023-09-30T16:49:11.976984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:14.058908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601136+0000","last_change":"2023-09-30T16:49:10.635159+0000","last_active":"2023-09-30T16:49:11.601136+0000","last_peered":"2023-09-30T16:49:11.601136+0000","last_clean":"2023-09-30T16:49:11.601136+0000","last_became_active":"2023-09-30T16:49:10.634816+0000","last_became_peered":"2023-09-30T16:49:10.634816+0000","last_unstale":"2023-09-30T16:49:11.601136+0000","last_undegraded":"2023-09-30T16:49:11.601136+0000","last_fullsized":"2023-09-30T16:49:11.601136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:56.576610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601222+0000","last_change":"2023-09-30T16:49:10.623197+0000","last_active":"2023-09-30T16:49:11.601222+0000","last_peered":"2023-09-30T16:49:11.601222+0000","last_clean":"2023-09-30T16:49:11.601222+0000","last_became_active":"2023-09-30T16:49:10.622869+0000","last_became_peered":"2023-09-30T16:49:10.622869+0000","last_unstale":"2023-09-30T16:49:11.601222+0000","last_undegraded":"2023-09-30T16:49:11.601222+0000","last_fullsized":"2023-09-30T16:49:11.601222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:50.982816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976170+0000","last_change":"2023-09-30T16:49:10.636242+0000","last_active":"2023-09-30T16:49:11.976170+0000","last_peered":"2023-09-30T16:49:11.976170+0000","last_clean":"2023-09-30T16:49:11.976170+0000","last_became_active":"2023-09-30T16:49:10.635932+0000","last_became_peered":"2023-09-30T16:49:10.635932+0000","last_unstale":"2023-09-30T16:49:11.976170+0000","last_undegraded":"2023-09-30T16:49:11.976170+0000","last_fullsized":"2023-09-30T16:49:11.976170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977806+0000","last_change":"2023-09-30T16:49:10.617833+0000","last_active":"2023-09-30T16:49:11.977806+0000","last_peered":"2023-09-30T16:49:11.977806+0000","last_clean":"2023-09-30T16:49:11.977806+0000","last_became_active":"2023-09-30T16:49:10.617311+0000","last_became_peered":"2023-09-30T16:49:10.617311+0000","last_unstale":"2023-09-30T16:49:11.977806+0000","last_undegraded":"2023-09-30T16:49:11.977806+0000","last_fullsized":"2023-09-30T16:49:11.977806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978520+0000","last_change":"2023-09-30T16:49:10.635091+0000","last_active":"2023-09-30T16:49:11.978520+0000","last_peered":"2023-09-30T16:49:11.978520+0000","last_clean":"2023-09-30T16:49:11.978520+0000","last_became_active":"2023-09-30T16:49:10.633981+0000","last_became_peered":"2023-09-30T16:49:10.633981+0000","last_unstale":"2023-09-30T16:49:11.978520+0000","last_undegraded":"2023-09-30T16:49:11.978520+0000","last_fullsized":"2023-09-30T16:49:11.978520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:09:36.748081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977435+0000","last_change":"2023-09-30T16:49:10.628753+0000","last_active":"2023-09-30T16:49:11.977435+0000","last_peered":"2023-09-30T16:49:11.977435+0000","last_clean":"2023-09-30T16:49:11.977435+0000","last_became_active":"2023-09-30T16:49:10.628478+0000","last_became_peered":"2023-09-30T16:49:10.628478+0000","last_unstale":"2023-09-30T16:49:11.977435+0000","last_undegraded":"2023-09-30T16:49:11.977435+0000","last_fullsized":"2023-09-30T16:49:11.977435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979513+0000","last_change":"2023-09-30T16:49:10.629633+0000","last_active":"2023-09-30T16:49:11.979513+0000","last_peered":"2023-09-30T16:49:11.979513+0000","last_clean":"2023-09-30T16:49:11.979513+0000","last_became_active":"2023-09-30T16:49:10.629202+0000","last_became_peered":"2023-09-30T16:49:10.629202+0000","last_unstale":"2023-09-30T16:49:11.979513+0000","last_undegraded":"2023-09-30T16:49:11.979513+0000","last_fullsized":"2023-09-30T16:49:11.979513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:21:16.999794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977323+0000","last_change":"2023-09-30T16:49:10.638755+0000","last_active":"2023-09-30T16:49:11.977323+0000","last_peered":"2023-09-30T16:49:11.977323+0000","last_clean":"2023-09-30T16:49:11.977323+0000","last_became_active":"2023-09-30T16:49:10.637877+0000","last_became_peered":"2023-09-30T16:49:10.637877+0000","last_unstale":"2023-09-30T16:49:11.977323+0000","last_undegraded":"2023-09-30T16:49:11.977323+0000","last_fullsized":"2023-09-30T16:49:11.977323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:14.992346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601810+0000","last_change":"2023-09-30T16:49:10.604164+0000","last_active":"2023-09-30T16:49:11.601810+0000","last_peered":"2023-09-30T16:49:11.601810+0000","last_clean":"2023-09-30T16:49:11.601810+0000","last_became_active":"2023-09-30T16:49:10.603748+0000","last_became_peered":"2023-09-30T16:49:10.603748+0000","last_unstale":"2023-09-30T16:49:11.601810+0000","last_undegraded":"2023-09-30T16:49:11.601810+0000","last_fullsized":"2023-09-30T16:49:11.601810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976488+0000","last_change":"2023-09-30T16:49:10.619701+0000","last_active":"2023-09-30T16:49:11.976488+0000","last_peered":"2023-09-30T16:49:11.976488+0000","last_clean":"2023-09-30T16:49:11.976488+0000","last_became_active":"2023-09-30T16:49:10.619268+0000","last_became_peered":"2023-09-30T16:49:10.619268+0000","last_unstale":"2023-09-30T16:49:11.976488+0000","last_undegraded":"2023-09-30T16:49:11.976488+0000","last_fullsized":"2023-09-30T16:49:11.976488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:18.446714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976548+0000","last_change":"2023-09-30T16:49:10.622204+0000","last_active":"2023-09-30T16:49:11.976548+0000","last_peered":"2023-09-30T16:49:11.976548+0000","last_clean":"2023-09-30T16:49:11.976548+0000","last_became_active":"2023-09-30T16:49:10.621777+0000","last_became_peered":"2023-09-30T16:49:10.621777+0000","last_unstale":"2023-09-30T16:49:11.976548+0000","last_undegraded":"2023-09-30T16:49:11.976548+0000","last_fullsized":"2023-09-30T16:49:11.976548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978154+0000","last_change":"2023-09-30T16:49:10.630731+0000","last_active":"2023-09-30T16:49:11.978154+0000","last_peered":"2023-09-30T16:49:11.978154+0000","last_clean":"2023-09-30T16:49:11.978154+0000","last_became_active":"2023-09-30T16:49:10.630397+0000","last_became_peered":"2023-09-30T16:49:10.630397+0000","last_unstale":"2023-09-30T16:49:11.978154+0000","last_undegraded":"2023-09-30T16:49:11.978154+0000","last_fullsized":"2023-09-30T16:49:11.978154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:56:20.514299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976860+0000","last_change":"2023-09-30T16:49:10.632997+0000","last_active":"2023-09-30T16:49:11.976860+0000","last_peered":"2023-09-30T16:49:11.976860+0000","last_clean":"2023-09-30T16:49:11.976860+0000","last_became_active":"2023-09-30T16:49:10.631924+0000","last_became_peered":"2023-09-30T16:49:10.631924+0000","last_unstale":"2023-09-30T16:49:11.976860+0000","last_undegraded":"2023-09-30T16:49:11.976860+0000","last_fullsized":"2023-09-30T16:49:11.976860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:24.961600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597835+0000","last_change":"2023-09-30T16:49:10.619518+0000","last_active":"2023-09-30T16:49:11.597835+0000","last_peered":"2023-09-30T16:49:11.597835+0000","last_clean":"2023-09-30T16:49:11.597835+0000","last_became_active":"2023-09-30T16:49:10.619041+0000","last_became_peered":"2023-09-30T16:49:10.619041+0000","last_unstale":"2023-09-30T16:49:11.597835+0000","last_undegraded":"2023-09-30T16:49:11.597835+0000","last_fullsized":"2023-09-30T16:49:11.597835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:34:06.083677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601356+0000","last_change":"2023-09-30T16:49:10.623431+0000","last_active":"2023-09-30T16:49:11.601356+0000","last_peered":"2023-09-30T16:49:11.601356+0000","last_clean":"2023-09-30T16:49:11.601356+0000","last_became_active":"2023-09-30T16:49:10.623009+0000","last_became_peered":"2023-09-30T16:49:10.623009+0000","last_unstale":"2023-09-30T16:49:11.601356+0000","last_undegraded":"2023-09-30T16:49:11.601356+0000","last_fullsized":"2023-09-30T16:49:11.601356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601808+0000","last_change":"2023-09-30T16:49:10.639015+0000","last_active":"2023-09-30T16:49:11.601808+0000","last_peered":"2023-09-30T16:49:11.601808+0000","last_clean":"2023-09-30T16:49:11.601808+0000","last_became_active":"2023-09-30T16:49:10.638680+0000","last_became_peered":"2023-09-30T16:49:10.638680+0000","last_unstale":"2023-09-30T16:49:11.601808+0000","last_undegraded":"2023-09-30T16:49:11.601808+0000","last_fullsized":"2023-09-30T16:49:11.601808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976602+0000","last_change":"2023-09-30T16:49:10.623827+0000","last_active":"2023-09-30T16:49:11.976602+0000","last_peered":"2023-09-30T16:49:11.976602+0000","last_clean":"2023-09-30T16:49:11.976602+0000","last_became_active":"2023-09-30T16:49:10.623133+0000","last_became_peered":"2023-09-30T16:49:10.623133+0000","last_unstale":"2023-09-30T16:49:11.976602+0000","last_undegraded":"2023-09-30T16:49:11.976602+0000","last_fullsized":"2023-09-30T16:49:11.976602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976867+0000","last_change":"2023-09-30T16:49:10.632416+0000","last_active":"2023-09-30T16:49:11.976867+0000","last_peered":"2023-09-30T16:49:11.976867+0000","last_clean":"2023-09-30T16:49:11.976867+0000","last_became_active":"2023-09-30T16:49:10.631982+0000","last_became_peered":"2023-09-30T16:49:10.631982+0000","last_unstale":"2023-09-30T16:49:11.976867+0000","last_undegraded":"2023-09-30T16:49:11.976867+0000","last_fullsized":"2023-09-30T16:49:11.976867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975991+0000","last_change":"2023-09-30T16:49:10.624572+0000","last_active":"2023-09-30T16:49:11.975991+0000","last_peered":"2023-09-30T16:49:11.975991+0000","last_clean":"2023-09-30T16:49:11.975991+0000","last_became_active":"2023-09-30T16:49:10.624284+0000","last_became_peered":"2023-09-30T16:49:10.624284+0000","last_unstale":"2023-09-30T16:49:11.975991+0000","last_undegraded":"2023-09-30T16:49:11.975991+0000","last_fullsized":"2023-09-30T16:49:11.975991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.596894+0000","last_change":"2023-09-30T16:49:10.614544+0000","last_active":"2023-09-30T16:49:11.596894+0000","last_peered":"2023-09-30T16:49:11.596894+0000","last_clean":"2023-09-30T16:49:11.596894+0000","last_became_active":"2023-09-30T16:49:10.614152+0000","last_became_peered":"2023-09-30T16:49:10.614152+0000","last_unstale":"2023-09-30T16:49:11.596894+0000","last_undegraded":"2023-09-30T16:49:11.596894+0000","last_fullsized":"2023-09-30T16:49:11.596894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:17.699333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976840+0000","last_change":"2023-09-30T16:49:10.628445+0000","last_active":"2023-09-30T16:49:11.976840+0000","last_peered":"2023-09-30T16:49:11.976840+0000","last_clean":"2023-09-30T16:49:11.976840+0000","last_became_active":"2023-09-30T16:49:10.628100+0000","last_became_peered":"2023-09-30T16:49:10.628100+0000","last_unstale":"2023-09-30T16:49:11.976840+0000","last_undegraded":"2023-09-30T16:49:11.976840+0000","last_fullsized":"2023-09-30T16:49:11.976840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:21.769827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976846+0000","last_change":"2023-09-30T16:49:09.619255+0000","last_active":"2023-09-30T16:49:11.976846+0000","last_peered":"2023-09-30T16:49:11.976846+0000","last_clean":"2023-09-30T16:49:11.976846+0000","last_became_active":"2023-09-30T16:49:09.618555+0000","last_became_peered":"2023-09-30T16:49:09.618555+0000","last_unstale":"2023-09-30T16:49:11.976846+0000","last_undegraded":"2023-09-30T16:49:11.976846+0000","last_fullsized":"2023-09-30T16:49:11.976846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601602+0000","last_change":"2023-09-30T16:49:10.634574+0000","last_active":"2023-09-30T16:49:11.601602+0000","last_peered":"2023-09-30T16:49:11.601602+0000","last_clean":"2023-09-30T16:49:11.601602+0000","last_became_active":"2023-09-30T16:49:10.634290+0000","last_became_peered":"2023-09-30T16:49:10.634290+0000","last_unstale":"2023-09-30T16:49:11.601602+0000","last_undegraded":"2023-09-30T16:49:11.601602+0000","last_fullsized":"2023-09-30T16:49:11.601602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977368+0000","last_change":"2023-09-30T16:49:09.591524+0000","last_active":"2023-09-30T16:49:11.977368+0000","last_peered":"2023-09-30T16:49:11.977368+0000","last_clean":"2023-09-30T16:49:11.977368+0000","last_became_active":"2023-09-30T16:49:09.591196+0000","last_became_peered":"2023-09-30T16:49:09.591196+0000","last_unstale":"2023-09-30T16:49:11.977368+0000","last_undegraded":"2023-09-30T16:49:11.977368+0000","last_fullsized":"2023-09-30T16:49:11.977368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:58:05.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601646+0000","last_change":"2023-09-30T16:49:09.593605+0000","last_active":"2023-09-30T16:49:11.601646+0000","last_peered":"2023-09-30T16:49:11.601646+0000","last_clean":"2023-09-30T16:49:11.601646+0000","last_became_active":"2023-09-30T16:49:09.592556+0000","last_became_peered":"2023-09-30T16:49:09.592556+0000","last_unstale":"2023-09-30T16:49:11.601646+0000","last_undegraded":"2023-09-30T16:49:11.601646+0000","last_fullsized":"2023-09-30T16:49:11.601646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:22.385046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977552+0000","last_change":"2023-09-30T16:49:10.626630+0000","last_active":"2023-09-30T16:49:11.977552+0000","last_peered":"2023-09-30T16:49:11.977552+0000","last_clean":"2023-09-30T16:49:11.977552+0000","last_became_active":"2023-09-30T16:49:10.626316+0000","last_became_peered":"2023-09-30T16:49:10.626316+0000","last_unstale":"2023-09-30T16:49:11.977552+0000","last_undegraded":"2023-09-30T16:49:11.977552+0000","last_fullsized":"2023-09-30T16:49:11.977552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:38.419701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978195+0000","last_change":"2023-09-30T16:49:09.594246+0000","last_active":"2023-09-30T16:49:11.978195+0000","last_peered":"2023-09-30T16:49:11.978195+0000","last_clean":"2023-09-30T16:49:11.978195+0000","last_became_active":"2023-09-30T16:49:09.593915+0000","last_became_peered":"2023-09-30T16:49:09.593915+0000","last_unstale":"2023-09-30T16:49:11.978195+0000","last_undegraded":"2023-09-30T16:49:11.978195+0000","last_fullsized":"2023-09-30T16:49:11.978195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601785+0000","last_change":"2023-09-30T16:49:10.626401+0000","last_active":"2023-09-30T16:49:11.601785+0000","last_peered":"2023-09-30T16:49:11.601785+0000","last_clean":"2023-09-30T16:49:11.601785+0000","last_became_active":"2023-09-30T16:49:10.621995+0000","last_became_peered":"2023-09-30T16:49:10.621995+0000","last_unstale":"2023-09-30T16:49:11.601785+0000","last_undegraded":"2023-09-30T16:49:11.601785+0000","last_fullsized":"2023-09-30T16:49:11.601785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:01.160951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976463+0000","last_change":"2023-09-30T16:49:09.611747+0000","last_active":"2023-09-30T16:49:11.976463+0000","last_peered":"2023-09-30T16:49:11.976463+0000","last_clean":"2023-09-30T16:49:11.976463+0000","last_became_active":"2023-09-30T16:49:09.611526+0000","last_became_peered":"2023-09-30T16:49:09.611526+0000","last_unstale":"2023-09-30T16:49:11.976463+0000","last_undegraded":"2023-09-30T16:49:11.976463+0000","last_fullsized":"2023-09-30T16:49:11.976463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:17.735069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598032+0000","last_change":"2023-09-30T16:49:10.613752+0000","last_active":"2023-09-30T16:49:11.598032+0000","last_peered":"2023-09-30T16:49:11.598032+0000","last_clean":"2023-09-30T16:49:11.598032+0000","last_became_active":"2023-09-30T16:49:10.613471+0000","last_became_peered":"2023-09-30T16:49:10.613471+0000","last_unstale":"2023-09-30T16:49:11.598032+0000","last_undegraded":"2023-09-30T16:49:11.598032+0000","last_fullsized":"2023-09-30T16:49:11.598032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:50.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978231+0000","last_change":"2023-09-30T16:49:09.592279+0000","last_active":"2023-09-30T16:49:11.978231+0000","last_peered":"2023-09-30T16:49:11.978231+0000","last_clean":"2023-09-30T16:49:11.978231+0000","last_became_active":"2023-09-30T16:49:09.591878+0000","last_became_peered":"2023-09-30T16:49:09.591878+0000","last_unstale":"2023-09-30T16:49:11.978231+0000","last_undegraded":"2023-09-30T16:49:11.978231+0000","last_fullsized":"2023-09-30T16:49:11.978231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.044504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977588+0000","last_change":"2023-09-30T16:49:10.628129+0000","last_active":"2023-09-30T16:49:11.977588+0000","last_peered":"2023-09-30T16:49:11.977588+0000","last_clean":"2023-09-30T16:49:11.977588+0000","last_became_active":"2023-09-30T16:49:10.627840+0000","last_became_peered":"2023-09-30T16:49:10.627840+0000","last_unstale":"2023-09-30T16:49:11.977588+0000","last_undegraded":"2023-09-30T16:49:11.977588+0000","last_fullsized":"2023-09-30T16:49:11.977588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:05:15.929844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977128+0000","last_change":"2023-09-30T16:49:09.612101+0000","last_active":"2023-09-30T16:49:11.977128+0000","last_peered":"2023-09-30T16:49:11.977128+0000","last_clean":"2023-09-30T16:49:11.977128+0000","last_became_active":"2023-09-30T16:49:09.611560+0000","last_became_peered":"2023-09-30T16:49:09.611560+0000","last_unstale":"2023-09-30T16:49:11.977128+0000","last_undegraded":"2023-09-30T16:49:11.977128+0000","last_fullsized":"2023-09-30T16:49:11.977128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:16:15.187430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976893+0000","last_change":"2023-09-30T16:49:10.619592+0000","last_active":"2023-09-30T16:49:11.976893+0000","last_peered":"2023-09-30T16:49:11.976893+0000","last_clean":"2023-09-30T16:49:11.976893+0000","last_became_active":"2023-09-30T16:49:10.619251+0000","last_became_peered":"2023-09-30T16:49:10.619251+0000","last_unstale":"2023-09-30T16:49:11.976893+0000","last_undegraded":"2023-09-30T16:49:11.976893+0000","last_fullsized":"2023-09-30T16:49:11.976893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:29:13.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597687+0000","last_change":"2023-09-30T16:49:09.606217+0000","last_active":"2023-09-30T16:49:11.597687+0000","last_peered":"2023-09-30T16:49:11.597687+0000","last_clean":"2023-09-30T16:49:11.597687+0000","last_became_active":"2023-09-30T16:49:09.605883+0000","last_became_peered":"2023-09-30T16:49:09.605883+0000","last_unstale":"2023-09-30T16:49:11.597687+0000","last_undegraded":"2023-09-30T16:49:11.597687+0000","last_fullsized":"2023-09-30T16:49:11.597687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:20:46.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977809+0000","last_change":"2023-09-30T16:49:10.633013+0000","last_active":"2023-09-30T16:49:11.977809+0000","last_peered":"2023-09-30T16:49:11.977809+0000","last_clean":"2023-09-30T16:49:11.977809+0000","last_became_active":"2023-09-30T16:49:10.626780+0000","last_became_peered":"2023-09-30T16:49:10.626780+0000","last_unstale":"2023-09-30T16:49:11.977809+0000","last_undegraded":"2023-09-30T16:49:11.977809+0000","last_fullsized":"2023-09-30T16:49:11.977809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:14:01.374332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977545+0000","last_change":"2023-09-30T16:49:09.601823+0000","last_active":"2023-09-30T16:49:11.977545+0000","last_peered":"2023-09-30T16:49:11.977545+0000","last_clean":"2023-09-30T16:49:11.977545+0000","last_became_active":"2023-09-30T16:49:09.600844+0000","last_became_peered":"2023-09-30T16:49:09.600844+0000","last_unstale":"2023-09-30T16:49:11.977545+0000","last_undegraded":"2023-09-30T16:49:11.977545+0000","last_fullsized":"2023-09-30T16:49:11.977545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:12:56.898098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601684+0000","last_change":"2023-09-30T16:49:10.619205+0000","last_active":"2023-09-30T16:49:11.601684+0000","last_peered":"2023-09-30T16:49:11.601684+0000","last_clean":"2023-09-30T16:49:11.601684+0000","last_became_active":"2023-09-30T16:49:10.618841+0000","last_became_peered":"2023-09-30T16:49:10.618841+0000","last_unstale":"2023-09-30T16:49:11.601684+0000","last_undegraded":"2023-09-30T16:49:11.601684+0000","last_fullsized":"2023-09-30T16:49:11.601684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:50:31.963046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977431+0000","last_change":"2023-09-30T16:49:09.596896+0000","last_active":"2023-09-30T16:49:11.977431+0000","last_peered":"2023-09-30T16:49:11.977431+0000","last_clean":"2023-09-30T16:49:11.977431+0000","last_became_active":"2023-09-30T16:49:09.596566+0000","last_became_peered":"2023-09-30T16:49:09.596566+0000","last_unstale":"2023-09-30T16:49:11.977431+0000","last_undegraded":"2023-09-30T16:49:11.977431+0000","last_fullsized":"2023-09-30T16:49:11.977431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:17:13.982791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979825+0000","last_change":"2023-09-30T16:49:10.637755+0000","last_active":"2023-09-30T16:49:11.979825+0000","last_peered":"2023-09-30T16:49:11.979825+0000","last_clean":"2023-09-30T16:49:11.979825+0000","last_became_active":"2023-09-30T16:49:10.637423+0000","last_became_peered":"2023-09-30T16:49:10.637423+0000","last_unstale":"2023-09-30T16:49:11.979825+0000","last_undegraded":"2023-09-30T16:49:11.979825+0000","last_fullsized":"2023-09-30T16:49:11.979825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:08.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976207+0000","last_change":"2023-09-30T16:49:09.595029+0000","last_active":"2023-09-30T16:49:11.976207+0000","last_peered":"2023-09-30T16:49:11.976207+0000","last_clean":"2023-09-30T16:49:11.976207+0000","last_became_active":"2023-09-30T16:49:09.594386+0000","last_became_peered":"2023-09-30T16:49:09.594386+0000","last_unstale":"2023-09-30T16:49:11.976207+0000","last_undegraded":"2023-09-30T16:49:11.976207+0000","last_fullsized":"2023-09-30T16:49:11.976207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:00.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975177+0000","last_change":"2023-09-30T16:49:10.630355+0000","last_active":"2023-09-30T16:49:11.975177+0000","last_peered":"2023-09-30T16:49:11.975177+0000","last_clean":"2023-09-30T16:49:11.975177+0000","last_became_active":"2023-09-30T16:49:10.630070+0000","last_became_peered":"2023-09-30T16:49:10.630070+0000","last_unstale":"2023-09-30T16:49:11.975177+0000","last_undegraded":"2023-09-30T16:49:11.975177+0000","last_fullsized":"2023-09-30T16:49:11.975177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:02:47.440872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602079+0000","last_change":"2023-09-30T16:49:09.598236+0000","last_active":"2023-09-30T16:49:11.602079+0000","last_peered":"2023-09-30T16:49:11.602079+0000","last_clean":"2023-09-30T16:49:11.602079+0000","last_became_active":"2023-09-30T16:49:09.597544+0000","last_became_peered":"2023-09-30T16:49:09.597544+0000","last_unstale":"2023-09-30T16:49:11.602079+0000","last_undegraded":"2023-09-30T16:49:11.602079+0000","last_fullsized":"2023-09-30T16:49:11.602079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:34:55.567056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978555+0000","last_change":"2023-09-30T16:49:10.617486+0000","last_active":"2023-09-30T16:49:11.978555+0000","last_peered":"2023-09-30T16:49:11.978555+0000","last_clean":"2023-09-30T16:49:11.978555+0000","last_became_active":"2023-09-30T16:49:10.617170+0000","last_became_peered":"2023-09-30T16:49:10.617170+0000","last_unstale":"2023-09-30T16:49:11.978555+0000","last_undegraded":"2023-09-30T16:49:11.978555+0000","last_fullsized":"2023-09-30T16:49:11.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:19:12.868894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978921+0000","last_change":"2023-09-30T16:49:09.614260+0000","last_active":"2023-09-30T16:49:11.978921+0000","last_peered":"2023-09-30T16:49:11.978921+0000","last_clean":"2023-09-30T16:49:11.978921+0000","last_became_active":"2023-09-30T16:49:09.613910+0000","last_became_peered":"2023-09-30T16:49:09.613910+0000","last_unstale":"2023-09-30T16:49:11.978921+0000","last_undegraded":"2023-09-30T16:49:11.978921+0000","last_fullsized":"2023-09-30T16:49:11.978921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.598019+0000","last_change":"2023-09-30T16:49:10.631809+0000","last_active":"2023-09-30T16:49:11.598019+0000","last_peered":"2023-09-30T16:49:11.598019+0000","last_clean":"2023-09-30T16:49:11.598019+0000","last_became_active":"2023-09-30T16:49:10.631420+0000","last_became_peered":"2023-09-30T16:49:10.631420+0000","last_unstale":"2023-09-30T16:49:11.598019+0000","last_undegraded":"2023-09-30T16:49:11.598019+0000","last_fullsized":"2023-09-30T16:49:11.598019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:14.134423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602272+0000","last_change":"2023-09-30T16:49:09.624546+0000","last_active":"2023-09-30T16:49:11.602272+0000","last_peered":"2023-09-30T16:49:11.602272+0000","last_clean":"2023-09-30T16:49:11.602272+0000","last_became_active":"2023-09-30T16:49:09.623841+0000","last_became_peered":"2023-09-30T16:49:09.623841+0000","last_unstale":"2023-09-30T16:49:11.602272+0000","last_undegraded":"2023-09-30T16:49:11.602272+0000","last_fullsized":"2023-09-30T16:49:11.602272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:31:20.760273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978769+0000","last_change":"2023-09-30T16:49:10.638625+0000","last_active":"2023-09-30T16:49:11.978769+0000","last_peered":"2023-09-30T16:49:11.978769+0000","last_clean":"2023-09-30T16:49:11.978769+0000","last_became_active":"2023-09-30T16:49:10.638153+0000","last_became_peered":"2023-09-30T16:49:10.638153+0000","last_unstale":"2023-09-30T16:49:11.978769+0000","last_undegraded":"2023-09-30T16:49:11.978769+0000","last_fullsized":"2023-09-30T16:49:11.978769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:18.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976605+0000","last_change":"2023-09-30T16:49:09.604750+0000","last_active":"2023-09-30T16:49:11.976605+0000","last_peered":"2023-09-30T16:49:11.976605+0000","last_clean":"2023-09-30T16:49:11.976605+0000","last_became_active":"2023-09-30T16:49:09.600838+0000","last_became_peered":"2023-09-30T16:49:09.600838+0000","last_unstale":"2023-09-30T16:49:11.976605+0000","last_undegraded":"2023-09-30T16:49:11.976605+0000","last_fullsized":"2023-09-30T16:49:11.976605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977679+0000","last_change":"2023-09-30T16:49:10.637559+0000","last_active":"2023-09-30T16:49:11.977679+0000","last_peered":"2023-09-30T16:49:11.977679+0000","last_clean":"2023-09-30T16:49:11.977679+0000","last_became_active":"2023-09-30T16:49:10.630340+0000","last_became_peered":"2023-09-30T16:49:10.630340+0000","last_unstale":"2023-09-30T16:49:11.977679+0000","last_undegraded":"2023-09-30T16:49:11.977679+0000","last_fullsized":"2023-09-30T16:49:11.977679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:27.229031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601934+0000","last_change":"2023-09-30T16:49:09.600440+0000","last_active":"2023-09-30T16:49:11.601934+0000","last_peered":"2023-09-30T16:49:11.601934+0000","last_clean":"2023-09-30T16:49:11.601934+0000","last_became_active":"2023-09-30T16:49:09.599554+0000","last_became_peered":"2023-09-30T16:49:09.599554+0000","last_unstale":"2023-09-30T16:49:11.601934+0000","last_undegraded":"2023-09-30T16:49:11.601934+0000","last_fullsized":"2023-09-30T16:49:11.601934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979354+0000","last_change":"2023-09-30T16:49:10.620991+0000","last_active":"2023-09-30T16:49:11.979354+0000","last_peered":"2023-09-30T16:49:11.979354+0000","last_clean":"2023-09-30T16:49:11.979354+0000","last_became_active":"2023-09-30T16:49:10.620738+0000","last_became_peered":"2023-09-30T16:49:10.620738+0000","last_unstale":"2023-09-30T16:49:11.979354+0000","last_undegraded":"2023-09-30T16:49:11.979354+0000","last_fullsized":"2023-09-30T16:49:11.979354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:49:31.181804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T16:49:10.598403+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:49:10.598403+0000","last_peered":"2023-09-30T16:49:10.598403+0000","last_clean":"2023-09-30T16:49:10.598403+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:49:10.598403+0000","last_undegraded":"2023-09-30T16:49:10.598403+0000","last_fullsized":"2023-09-30T16:49:10.598403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.980054+0000","last_change":"2023-09-30T16:49:09.594466+0000","last_active":"2023-09-30T16:49:11.980054+0000","last_peered":"2023-09-30T16:49:11.980054+0000","last_clean":"2023-09-30T16:49:11.980054+0000","last_became_active":"2023-09-30T16:49:09.593975+0000","last_became_peered":"2023-09-30T16:49:09.593975+0000","last_unstale":"2023-09-30T16:49:11.980054+0000","last_undegraded":"2023-09-30T16:49:11.980054+0000","last_fullsized":"2023-09-30T16:49:11.980054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:53:24.904253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601532+0000","last_change":"2023-09-30T16:49:10.617041+0000","last_active":"2023-09-30T16:49:11.601532+0000","last_peered":"2023-09-30T16:49:11.601532+0000","last_clean":"2023-09-30T16:49:11.601532+0000","last_became_active":"2023-09-30T16:49:10.616673+0000","last_became_peered":"2023-09-30T16:49:10.616673+0000","last_unstale":"2023-09-30T16:49:11.601532+0000","last_undegraded":"2023-09-30T16:49:11.601532+0000","last_fullsized":"2023-09-30T16:49:11.601532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:55.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979257+0000","last_change":"2023-09-30T16:49:09.619350+0000","last_active":"2023-09-30T16:49:11.979257+0000","last_peered":"2023-09-30T16:49:11.979257+0000","last_clean":"2023-09-30T16:49:11.979257+0000","last_became_active":"2023-09-30T16:49:09.619032+0000","last_became_peered":"2023-09-30T16:49:09.619032+0000","last_unstale":"2023-09-30T16:49:11.979257+0000","last_undegraded":"2023-09-30T16:49:11.979257+0000","last_fullsized":"2023-09-30T16:49:11.979257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:56:08.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.600797+0000","last_change":"2023-09-30T16:49:10.618387+0000","last_active":"2023-09-30T16:49:11.600797+0000","last_peered":"2023-09-30T16:49:11.600797+0000","last_clean":"2023-09-30T16:49:11.600797+0000","last_became_active":"2023-09-30T16:49:10.618048+0000","last_became_peered":"2023-09-30T16:49:10.618048+0000","last_unstale":"2023-09-30T16:49:11.600797+0000","last_undegraded":"2023-09-30T16:49:11.600797+0000","last_fullsized":"2023-09-30T16:49:11.600797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:31.999294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977896+0000","last_change":"2023-09-30T16:49:09.620418+0000","last_active":"2023-09-30T16:49:11.977896+0000","last_peered":"2023-09-30T16:49:11.977896+0000","last_clean":"2023-09-30T16:49:11.977896+0000","last_became_active":"2023-09-30T16:49:09.619799+0000","last_became_peered":"2023-09-30T16:49:09.619799+0000","last_unstale":"2023-09-30T16:49:11.977896+0000","last_undegraded":"2023-09-30T16:49:11.977896+0000","last_fullsized":"2023-09-30T16:49:11.977896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:38.582461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977037+0000","last_change":"2023-09-30T16:49:10.629792+0000","last_active":"2023-09-30T16:49:11.977037+0000","last_peered":"2023-09-30T16:49:11.977037+0000","last_clean":"2023-09-30T16:49:11.977037+0000","last_became_active":"2023-09-30T16:49:10.629460+0000","last_became_peered":"2023-09-30T16:49:10.629460+0000","last_unstale":"2023-09-30T16:49:11.977037+0000","last_undegraded":"2023-09-30T16:49:11.977037+0000","last_fullsized":"2023-09-30T16:49:11.977037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:20:56.822877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977632+0000","last_change":"2023-09-30T16:49:09.603654+0000","last_active":"2023-09-30T16:49:11.977632+0000","last_peered":"2023-09-30T16:49:11.977632+0000","last_clean":"2023-09-30T16:49:11.977632+0000","last_became_active":"2023-09-30T16:49:09.603267+0000","last_became_peered":"2023-09-30T16:49:09.603267+0000","last_unstale":"2023-09-30T16:49:11.977632+0000","last_undegraded":"2023-09-30T16:49:11.977632+0000","last_fullsized":"2023-09-30T16:49:11.977632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:43:26.219476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977808+0000","last_change":"2023-09-30T16:49:10.636453+0000","last_active":"2023-09-30T16:49:11.977808+0000","last_peered":"2023-09-30T16:49:11.977808+0000","last_clean":"2023-09-30T16:49:11.977808+0000","last_became_active":"2023-09-30T16:49:10.635319+0000","last_became_peered":"2023-09-30T16:49:10.635319+0000","last_unstale":"2023-09-30T16:49:11.977808+0000","last_undegraded":"2023-09-30T16:49:11.977808+0000","last_fullsized":"2023-09-30T16:49:11.977808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:58.647756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.976636+0000","last_change":"2023-09-30T16:49:09.618129+0000","last_active":"2023-09-30T16:49:11.976636+0000","last_peered":"2023-09-30T16:49:11.976636+0000","last_clean":"2023-09-30T16:49:11.976636+0000","last_became_active":"2023-09-30T16:49:09.616087+0000","last_became_peered":"2023-09-30T16:49:09.616087+0000","last_unstale":"2023-09-30T16:49:11.976636+0000","last_undegraded":"2023-09-30T16:49:11.976636+0000","last_fullsized":"2023-09-30T16:49:11.976636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:29:38.905719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.597311+0000","last_change":"2023-09-30T16:49:10.618572+0000","last_active":"2023-09-30T16:49:11.597311+0000","last_peered":"2023-09-30T16:49:11.597311+0000","last_clean":"2023-09-30T16:49:11.597311+0000","last_became_active":"2023-09-30T16:49:10.618246+0000","last_became_peered":"2023-09-30T16:49:10.618246+0000","last_unstale":"2023-09-30T16:49:11.597311+0000","last_undegraded":"2023-09-30T16:49:11.597311+0000","last_fullsized":"2023-09-30T16:49:11.597311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:05:11.689316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979624+0000","last_change":"2023-09-30T16:49:09.611197+0000","last_active":"2023-09-30T16:49:11.979624+0000","last_peered":"2023-09-30T16:49:11.979624+0000","last_clean":"2023-09-30T16:49:11.979624+0000","last_became_active":"2023-09-30T16:49:09.610929+0000","last_became_peered":"2023-09-30T16:49:09.610929+0000","last_unstale":"2023-09-30T16:49:11.979624+0000","last_undegraded":"2023-09-30T16:49:11.979624+0000","last_fullsized":"2023-09-30T16:49:11.979624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:49.375737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601989+0000","last_change":"2023-09-30T16:49:10.632399+0000","last_active":"2023-09-30T16:49:11.601989+0000","last_peered":"2023-09-30T16:49:11.601989+0000","last_clean":"2023-09-30T16:49:11.601989+0000","last_became_active":"2023-09-30T16:49:10.632044+0000","last_became_peered":"2023-09-30T16:49:10.632044+0000","last_unstale":"2023-09-30T16:49:11.601989+0000","last_undegraded":"2023-09-30T16:49:11.601989+0000","last_fullsized":"2023-09-30T16:49:11.601989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:12:51.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:13.473608+0000","last_change":"2023-09-30T16:49:09.598092+0000","last_active":"2023-09-30T16:49:13.473608+0000","last_peered":"2023-09-30T16:49:13.473608+0000","last_clean":"2023-09-30T16:49:13.473608+0000","last_became_active":"2023-09-30T16:49:09.597294+0000","last_became_peered":"2023-09-30T16:49:09.597294+0000","last_unstale":"2023-09-30T16:49:13.473608+0000","last_undegraded":"2023-09-30T16:49:13.473608+0000","last_fullsized":"2023-09-30T16:49:13.473608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:17.437160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602370+0000","last_change":"2023-09-30T16:49:10.628648+0000","last_active":"2023-09-30T16:49:11.602370+0000","last_peered":"2023-09-30T16:49:11.602370+0000","last_clean":"2023-09-30T16:49:11.602370+0000","last_became_active":"2023-09-30T16:49:10.619172+0000","last_became_peered":"2023-09-30T16:49:10.619172+0000","last_unstale":"2023-09-30T16:49:11.602370+0000","last_undegraded":"2023-09-30T16:49:11.602370+0000","last_fullsized":"2023-09-30T16:49:11.602370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:00:32.534601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978385+0000","last_change":"2023-09-30T16:49:09.591867+0000","last_active":"2023-09-30T16:49:11.978385+0000","last_peered":"2023-09-30T16:49:11.978385+0000","last_clean":"2023-09-30T16:49:11.978385+0000","last_became_active":"2023-09-30T16:49:09.591062+0000","last_became_peered":"2023-09-30T16:49:09.591062+0000","last_unstale":"2023-09-30T16:49:11.978385+0000","last_undegraded":"2023-09-30T16:49:11.978385+0000","last_fullsized":"2023-09-30T16:49:11.978385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:35.797259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602280+0000","last_change":"2023-09-30T16:49:10.621227+0000","last_active":"2023-09-30T16:49:11.602280+0000","last_peered":"2023-09-30T16:49:11.602280+0000","last_clean":"2023-09-30T16:49:11.602280+0000","last_became_active":"2023-09-30T16:49:10.620861+0000","last_became_peered":"2023-09-30T16:49:10.620861+0000","last_unstale":"2023-09-30T16:49:11.602280+0000","last_undegraded":"2023-09-30T16:49:11.602280+0000","last_fullsized":"2023-09-30T16:49:11.602280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:23:58.208457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975957+0000","last_change":"2023-09-30T16:49:09.593530+0000","last_active":"2023-09-30T16:49:11.975957+0000","last_peered":"2023-09-30T16:49:11.975957+0000","last_clean":"2023-09-30T16:49:11.975957+0000","last_became_active":"2023-09-30T16:49:09.593238+0000","last_became_peered":"2023-09-30T16:49:09.593238+0000","last_unstale":"2023-09-30T16:49:11.975957+0000","last_undegraded":"2023-09-30T16:49:11.975957+0000","last_fullsized":"2023-09-30T16:49:11.975957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:06:13.124869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978879+0000","last_change":"2023-09-30T16:49:10.629665+0000","last_active":"2023-09-30T16:49:11.978879+0000","last_peered":"2023-09-30T16:49:11.978879+0000","last_clean":"2023-09-30T16:49:11.978879+0000","last_became_active":"2023-09-30T16:49:10.629348+0000","last_became_peered":"2023-09-30T16:49:10.629348+0000","last_unstale":"2023-09-30T16:49:11.978879+0000","last_undegraded":"2023-09-30T16:49:11.978879+0000","last_fullsized":"2023-09-30T16:49:11.978879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:20:08.861216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602018+0000","last_change":"2023-09-30T16:49:09.595063+0000","last_active":"2023-09-30T16:49:11.602018+0000","last_peered":"2023-09-30T16:49:11.602018+0000","last_clean":"2023-09-30T16:49:11.602018+0000","last_became_active":"2023-09-30T16:49:09.592082+0000","last_became_peered":"2023-09-30T16:49:09.592082+0000","last_unstale":"2023-09-30T16:49:11.602018+0000","last_undegraded":"2023-09-30T16:49:11.602018+0000","last_fullsized":"2023-09-30T16:49:11.602018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:48.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602131+0000","last_change":"2023-09-30T16:49:10.626413+0000","last_active":"2023-09-30T16:49:11.602131+0000","last_peered":"2023-09-30T16:49:11.602131+0000","last_clean":"2023-09-30T16:49:11.602131+0000","last_became_active":"2023-09-30T16:49:10.626088+0000","last_became_peered":"2023-09-30T16:49:10.626088+0000","last_unstale":"2023-09-30T16:49:11.602131+0000","last_undegraded":"2023-09-30T16:49:11.602131+0000","last_fullsized":"2023-09-30T16:49:11.602131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:00.151545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.601518+0000","last_change":"2023-09-30T16:49:09.617357+0000","last_active":"2023-09-30T16:49:11.601518+0000","last_peered":"2023-09-30T16:49:11.601518+0000","last_clean":"2023-09-30T16:49:11.601518+0000","last_became_active":"2023-09-30T16:49:09.616658+0000","last_became_peered":"2023-09-30T16:49:09.616658+0000","last_unstale":"2023-09-30T16:49:11.601518+0000","last_undegraded":"2023-09-30T16:49:11.601518+0000","last_fullsized":"2023-09-30T16:49:11.601518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:12:00.055876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977595+0000","last_change":"2023-09-30T16:49:10.620209+0000","last_active":"2023-09-30T16:49:11.977595+0000","last_peered":"2023-09-30T16:49:11.977595+0000","last_clean":"2023-09-30T16:49:11.977595+0000","last_became_active":"2023-09-30T16:49:10.619843+0000","last_became_peered":"2023-09-30T16:49:10.619843+0000","last_unstale":"2023-09-30T16:49:11.977595+0000","last_undegraded":"2023-09-30T16:49:11.977595+0000","last_fullsized":"2023-09-30T16:49:11.977595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:43:19.176556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979943+0000","last_change":"2023-09-30T16:49:09.594732+0000","last_active":"2023-09-30T16:49:11.979943+0000","last_peered":"2023-09-30T16:49:11.979943+0000","last_clean":"2023-09-30T16:49:11.979943+0000","last_became_active":"2023-09-30T16:49:09.594408+0000","last_became_peered":"2023-09-30T16:49:09.594408+0000","last_unstale":"2023-09-30T16:49:11.979943+0000","last_undegraded":"2023-09-30T16:49:11.979943+0000","last_fullsized":"2023-09-30T16:49:11.979943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:43:13.049354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977210+0000","last_change":"2023-09-30T16:49:10.624221+0000","last_active":"2023-09-30T16:49:11.977210+0000","last_peered":"2023-09-30T16:49:11.977210+0000","last_clean":"2023-09-30T16:49:11.977210+0000","last_became_active":"2023-09-30T16:49:10.623805+0000","last_became_peered":"2023-09-30T16:49:10.623805+0000","last_unstale":"2023-09-30T16:49:11.977210+0000","last_undegraded":"2023-09-30T16:49:11.977210+0000","last_fullsized":"2023-09-30T16:49:11.977210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:37:59.015690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.979180+0000","last_change":"2023-09-30T16:49:10.635402+0000","last_active":"2023-09-30T16:49:11.979180+0000","last_peered":"2023-09-30T16:49:11.979180+0000","last_clean":"2023-09-30T16:49:11.979180+0000","last_became_active":"2023-09-30T16:49:10.634645+0000","last_became_peered":"2023-09-30T16:49:10.634645+0000","last_unstale":"2023-09-30T16:49:11.979180+0000","last_undegraded":"2023-09-30T16:49:11.979180+0000","last_fullsized":"2023-09-30T16:49:11.979180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:31:06.779362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977933+0000","last_change":"2023-09-30T16:49:09.591559+0000","last_active":"2023-09-30T16:49:11.977933+0000","last_peered":"2023-09-30T16:49:11.977933+0000","last_clean":"2023-09-30T16:49:11.977933+0000","last_became_active":"2023-09-30T16:49:09.591265+0000","last_became_peered":"2023-09-30T16:49:09.591265+0000","last_unstale":"2023-09-30T16:49:11.977933+0000","last_undegraded":"2023-09-30T16:49:11.977933+0000","last_fullsized":"2023-09-30T16:49:11.977933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:17.133805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.975985+0000","last_change":"2023-09-30T16:49:10.638648+0000","last_active":"2023-09-30T16:49:11.975985+0000","last_peered":"2023-09-30T16:49:11.975985+0000","last_clean":"2023-09-30T16:49:11.975985+0000","last_became_active":"2023-09-30T16:49:10.638269+0000","last_became_peered":"2023-09-30T16:49:10.638269+0000","last_unstale":"2023-09-30T16:49:11.975985+0000","last_undegraded":"2023-09-30T16:49:11.975985+0000","last_fullsized":"2023-09-30T16:49:11.975985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:08:49.853742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.978073+0000","last_change":"2023-09-30T16:49:09.591796+0000","last_active":"2023-09-30T16:49:11.978073+0000","last_peered":"2023-09-30T16:49:11.978073+0000","last_clean":"2023-09-30T16:49:11.978073+0000","last_became_active":"2023-09-30T16:49:09.591474+0000","last_became_peered":"2023-09-30T16:49:09.591474+0000","last_unstale":"2023-09-30T16:49:11.978073+0000","last_undegraded":"2023-09-30T16:49:11.978073+0000","last_fullsized":"2023-09-30T16:49:11.978073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:45.706321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977248+0000","last_change":"2023-09-30T16:49:10.628239+0000","last_active":"2023-09-30T16:49:11.977248+0000","last_peered":"2023-09-30T16:49:11.977248+0000","last_clean":"2023-09-30T16:49:11.977248+0000","last_became_active":"2023-09-30T16:49:10.627915+0000","last_became_peered":"2023-09-30T16:49:10.627915+0000","last_unstale":"2023-09-30T16:49:11.977248+0000","last_undegraded":"2023-09-30T16:49:11.977248+0000","last_fullsized":"2023-09-30T16:49:11.977248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:40:55.750019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977412+0000","last_change":"2023-09-30T16:49:09.612990+0000","last_active":"2023-09-30T16:49:11.977412+0000","last_peered":"2023-09-30T16:49:11.977412+0000","last_clean":"2023-09-30T16:49:11.977412+0000","last_became_active":"2023-09-30T16:49:09.606939+0000","last_became_peered":"2023-09-30T16:49:09.606939+0000","last_unstale":"2023-09-30T16:49:11.977412+0000","last_undegraded":"2023-09-30T16:49:11.977412+0000","last_fullsized":"2023-09-30T16:49:11.977412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:10:00.151397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.977818+0000","last_change":"2023-09-30T16:49:10.631974+0000","last_active":"2023-09-30T16:49:11.977818+0000","last_peered":"2023-09-30T16:49:11.977818+0000","last_clean":"2023-09-30T16:49:11.977818+0000","last_became_active":"2023-09-30T16:49:10.631388+0000","last_became_peered":"2023-09-30T16:49:10.631388+0000","last_unstale":"2023-09-30T16:49:11.977818+0000","last_undegraded":"2023-09-30T16:49:11.977818+0000","last_fullsized":"2023-09-30T16:49:11.977818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:09.560735+0000","last_clean_scrub_stamp":"2023-09-30T16:49:09.560735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:01:27.558052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T16:49:11.602467+0000","last_change":"2023-09-30T16:49:09.606230+0000","last_active":"2023-09-30T16:49:11.602467+0000","last_peered":"2023-09-30T16:49:11.602467+0000","last_clean":"2023-09-30T16:49:11.602467+0000","last_became_active":"2023-09-30T16:49:09.605614+0000","last_became_peered":"2023-09-30T16:49:09.605614+0000","last_unstale":"2023-09-30T16:49:11.602467+0000","last_undegraded":"2023-09-30T16:49:11.602467+0000","last_fullsized":"2023-09-30T16:49:11.602467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:08.551181+0000","last_clean_scrub_stamp":"2023-09-30T16:49:08.551181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:30.989740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":74251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":664711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":74833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":664689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:49:23.741 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T16:49:23.741 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T16:49:23.741 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T16:49:23.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T16:49:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.894+0000 7fe1172b7640 1 Processor -- start 2023-09-30T16:49:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.894+0000 7fe1172b7640 1 -- start start 2023-09-30T16:49:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe1172b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe110158640 0x7fe11015af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe1172b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe11015b4b0 0x7fe1100cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe1172b7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11006d290 con 0x7fe1100cb940 2023-09-30T16:49:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe1172b7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11015bf60 con 0x7fe11015b4b0 2023-09-30T16:49:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe1172b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11006cf40 con 0x7fe110158640 2023-09-30T16:49:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe115053640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe110158640 0x7fe11015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe114852640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe11015b4b0 0x7fe1100cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe115053640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe110158640 0x7fe11015af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:46850/0 (socket says 172.21.15.52:46850) 2023-09-30T16:49:23.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe115854640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe1100cb940 0x7fe11006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:51204/0 (socket says 172.21.15.52:51204) 2023-09-30T16:49:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe115053640 1 -- 172.21.15.52:0/2713990540 learned_addr learned my addr 172.21.15.52:0/2713990540 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe114852640 1 -- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe110158640 msgr2=0x7fe11015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe114852640 1 --2- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe110158640 0x7fe11015af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe114852640 1 -- 172.21.15.52:0/2713990540 >> v1:172.21.15.186:6789/0 conn(0x7fe1100cb940 legacy=0x7fe11006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe114852640 1 -- 172.21.15.52:0/2713990540 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11015b9a0 con 0x7fe11015b4b0 2023-09-30T16:49:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe114852640 1 --2- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe11015b4b0 0x7fe1100cb400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=163a24db2dab5267 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe107fff640 1 -- 172.21.15.52:0/2713990540 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000ab670 con 0x7fe11015b4b0 2023-09-30T16:49:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe107fff640 1 -- 172.21.15.52:0/2713990540 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1000ab7d0 con 0x7fe11015b4b0 2023-09-30T16:49:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.898+0000 7fe107fff640 1 -- 172.21.15.52:0/2713990540 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000abb60 con 0x7fe11015b4b0 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe11015b4b0 msgr2=0x7fe1100cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 --2- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe11015b4b0 0x7fe1100cb400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c450 comp rx=0 tx=0).stop 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/2713990540 shutdown_connections 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 --2- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe11015b4b0 0x7fe1100cb400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 --2- 172.21.15.52:0/2713990540 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe110158640 0x7fe11015af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/2713990540 >> 172.21.15.52:0/2713990540 conn(0x7fe110098b10 msgr2=0x7fe1100cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/2713990540 shutdown_connections 2023-09-30T16:49:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/2713990540 wait complete. 2023-09-30T16:49:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 Processor -- start 2023-09-30T16:49:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- start start 2023-09-30T16:49:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1100cb940 0x7fe1101f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 0x7fe1101f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe11015b4b0 0x7fe110157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101f55b0 con 0x7fe110158640 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101f5890 con 0x7fe1100cb940 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101f5b70 con 0x7fe11015b4b0 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 0x7fe1101f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 0x7fe1101f7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54322/0 (socket says 172.21.15.52:54322) 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 -- 172.21.15.52:0/3935258854 learned_addr learned my addr 172.21.15.52:0/3935258854 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe115854640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe11015b4b0 0x7fe110157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe115053640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1100cb940 0x7fe1101f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 -- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe11015b4b0 msgr2=0x7fe110157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe11015b4b0 0x7fe110157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 -- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1100cb940 msgr2=0x7fe1101f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1100cb940 0x7fe1101f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 -- 172.21.15.52:0/3935258854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009420 con 0x7fe110158640 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe114852640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 0x7fe1101f7f80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ad040 tx=0x7fe10001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000bf610 con 0x7fe110158640 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1000bf770 con 0x7fe110158640 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1101f5e50 con 0x7fe110158640 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000bfae0 con 0x7fe110158640 2023-09-30T16:49:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110164650 con 0x7fe110158640 2023-09-30T16:49:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.902+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1101647e0 con 0x7fe110158640 2023-09-30T16:49:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.906+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe1000bfc40 con 0x7fe110158640 2023-09-30T16:49:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.906+0000 7fe105ffb640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0f4066190 0x7fe0f4068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.906+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe10011e6e0 con 0x7fe110158640 2023-09-30T16:49:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.906+0000 7fe115053640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0f4066190 0x7fe0f4068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.906+0000 7fe115053640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0f4066190 0x7fe0f4068650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe110150580 tx=0x7fe10c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:23.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:23.910+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe1000ebe30 con 0x7fe110158640 2023-09-30T16:49:24.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.086+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe11004e0e0 con 0x7fe110158640 2023-09-30T16:49:24.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe105ffb640 1 -- 172.21.15.52:0/3935258854 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe1000ef450 con 0x7fe110158640 2023-09-30T16:49:24.095 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:24.095 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0f4066190 msgr2=0x7fe0f4068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0f4066190 0x7fe0f4068650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe110150580 tx=0x7fe10c008040 comp rx=0 tx=0).stop 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 msgr2=0x7fe1101f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 0x7fe1101f7f80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ad040 tx=0x7fe10001ac90 comp rx=0 tx=0).stop 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 shutdown_connections 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0f4066190 0x7fe0f4068650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe11015b4b0 0x7fe110157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe110158640 0x7fe1101f7f80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 --2- 172.21.15.52:0/3935258854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1100cb940 0x7fe1101f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 >> 172.21.15.52:0/3935258854 conn(0x7fe110098b10 msgr2=0x7fe110069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 shutdown_connections 2023-09-30T16:49:24.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.090+0000 7fe1172b7640 1 -- 172.21.15.52:0/3935258854 wait complete. 2023-09-30T16:49:24.112 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T16:49:24.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:24.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.226+0000 7efdc5fc4640 1 Processor -- start 2023-09-30T16:49:24.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.226+0000 7efdc5fc4640 1 -- start start 2023-09-30T16:49:24.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efdc01599d0 0x7efdc00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdc00d0160 0x7efdc00cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc00ce720 con 0x7efdc00d0160 2023-09-30T16:49:24.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc00ca7a0 con 0x7efdc01599d0 2023-09-30T16:49:24.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00caa80 con 0x7efdc00cb560 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdc00d0160 0x7efdc00cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdc00d0160 0x7efdc00cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54332/0 (socket says 172.21.15.52:54332) 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 -- 172.21.15.52:0/2909786003 learned_addr learned my addr 172.21.15.52:0/2909786003 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdbffff640 1 --2- 172.21.15.52:0/2909786003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdbf7fe640 1 --2- 172.21.15.52:0/2909786003 >> v2:172.21.15.186:3300/0 conn(0x7efdc01599d0 0x7efdc00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 -- 172.21.15.52:0/2909786003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 msgr2=0x7efdc00ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 --2- 172.21.15.52:0/2909786003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 -- 172.21.15.52:0/2909786003 >> v2:172.21.15.186:3300/0 conn(0x7efdc01599d0 msgr2=0x7efdc00cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:24.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 --2- 172.21.15.52:0/2909786003 >> v2:172.21.15.186:3300/0 conn(0x7efdc01599d0 0x7efdc00cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 -- 172.21.15.52:0/2909786003 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc00cad60 con 0x7efdc00d0160 2023-09-30T16:49:24.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdbf7fe640 1 --2- 172.21.15.52:0/2909786003 >> v2:172.21.15.186:3300/0 conn(0x7efdc01599d0 0x7efdc00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:24.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdb7fff640 1 --2- 172.21.15.52:0/2909786003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc00cdca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efdc00991a0 tx=0x7efda801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da92ad0abcf616df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdbeffd640 1 -- 172.21.15.52:0/2909786003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80ab600 con 0x7efdc00d0160 2023-09-30T16:49:24.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdbeffd640 1 -- 172.21.15.52:0/2909786003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80a7050 con 0x7efdc00d0160 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdbeffd640 1 -- 172.21.15.52:0/2909786003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80ab980 con 0x7efdc00d0160 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- 172.21.15.52:0/2909786003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 msgr2=0x7efdc00cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/2909786003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc00cdca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efdc00991a0 tx=0x7efda801c470 comp rx=0 tx=0).stop 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- 172.21.15.52:0/2909786003 shutdown_connections 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/2909786003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/2909786003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc00cdca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/2909786003 >> v2:172.21.15.186:3300/0 conn(0x7efdc01599d0 0x7efdc00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- 172.21.15.52:0/2909786003 >> 172.21.15.52:0/2909786003 conn(0x7efdc0098a60 msgr2=0x7efdc00cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:24.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- 172.21.15.52:0/2909786003 shutdown_connections 2023-09-30T16:49:24.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.230+0000 7efdc5fc4640 1 -- 172.21.15.52:0/2909786003 wait complete. 2023-09-30T16:49:24.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 Processor -- start 2023-09-30T16:49:24.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- start start 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdc01599d0 0x7efdc0150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00c3910 con 0x7efdc00d0160 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00c32e0 con 0x7efdc01599d0 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00c9220 con 0x7efdc00cb560 2023-09-30T16:49:24.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc014fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54348/0 (socket says 172.21.15.52:54348) 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 -- 172.21.15.52:0/484746695 learned_addr learned my addr 172.21.15.52:0/484746695 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbffff640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdc01599d0 0x7efdc0150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbf7fe640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 -- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 msgr2=0x7efdc00c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 -- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdc01599d0 msgr2=0x7efdc0150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdc01599d0 0x7efdc0150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 -- 172.21.15.52:0/484746695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80094d0 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbf7fe640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdb7fff640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc014fd10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efda801ab20 tx=0x7efda8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80b4420 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80b4580 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc00c9500 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80b48f0 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc00c6080 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc00c3a80 con 0x7efdc00d0160 2023-09-30T16:49:24.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.234+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7efda80b2070 con 0x7efdc00d0160 2023-09-30T16:49:24.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.238+0000 7efdbcff9640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda0066190 0x7efda0068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.238+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efda811d170 con 0x7efdc00d0160 2023-09-30T16:49:24.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.238+0000 7efdbf7fe640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda0066190 0x7efda0068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.238+0000 7efdbf7fe640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda0066190 0x7efda0068650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efdb000b840 tx=0x7efdb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.242+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7efda80ea6f0 con 0x7efdc00d0160 2023-09-30T16:49:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.390+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdc00740a0 con 0x7efdc00d0160 2023-09-30T16:49:24.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.390+0000 7efdbcff9640 1 -- 172.21.15.52:0/484746695 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7efda80edd10 con 0x7efdc00d0160 2023-09-30T16:49:24.398 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:24.398 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda0066190 msgr2=0x7efda0068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda0066190 0x7efda0068650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efdb000b840 tx=0x7efdb0008040 comp rx=0 tx=0).stop 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 msgr2=0x7efdc014fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc014fd10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efda801ab20 tx=0x7efda8019210 comp rx=0 tx=0).stop 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 shutdown_connections 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda0066190 0x7efda0068650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdc01599d0 0x7efdc0150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdc00d0160 0x7efdc014fd10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 --2- 172.21.15.52:0/484746695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdc00cb560 0x7efdc00c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 >> 172.21.15.52:0/484746695 conn(0x7efdc0098a60 msgr2=0x7efdc006d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:24.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 shutdown_connections 2023-09-30T16:49:24.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.394+0000 7efdc5fc4640 1 -- 172.21.15.52:0/484746695 wait complete. 2023-09-30T16:49:24.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:24.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.534+0000 7ff2fb8c6640 1 Processor -- start 2023-09-30T16:49:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2fb8c6640 1 -- start start 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2fb8c6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2f40d0210 0x7ff2f40d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2fb8c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f40d25b0 0x7ff2f40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2fb8c6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40d39b0 con 0x7ff2f415cc60 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2fb8c6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f415d040 con 0x7ff2f40d0210 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2fb8c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40d2da0 con 0x7ff2f40d25b0 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f9662640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff2f415cc60 0x7ff2f40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40112/0 (socket says 172.21.15.52:40112) 2023-09-30T16:49:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f9662640 1 -- 172.21.15.52:0/3386896788 learned_addr learned my addr 172.21.15.52:0/3386896788 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f8e61640 1 --2- 172.21.15.52:0/3386896788 >> v2:172.21.15.52:3300/0 conn(0x7ff2f40d0210 0x7ff2f40d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f9e63640 1 --2- 172.21.15.52:0/3386896788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f40d25b0 0x7ff2f40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3386896788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f40d25b0 msgr2=0x7ff2f40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f8e61640 1 --2- 172.21.15.52:0/3386896788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f40d25b0 0x7ff2f40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3386896788 >> v1:172.21.15.52:6789/0 conn(0x7ff2f415cc60 legacy=0x7ff2f40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2ebfff640 1 -- 172.21.15.52:0/3386896788 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502420634 0 0) 0x7ff2f40d39b0 con 0x7ff2f415cc60 2023-09-30T16:49:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3386896788 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40d3080 con 0x7ff2f40d0210 2023-09-30T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.538+0000 7ff2f8e61640 1 --2- 172.21.15.52:0/3386896788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d0210 0x7ff2f40d2070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40097c0 tx=0x7ff2e401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc3353c0aad932 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2ebfff640 1 -- 172.21.15.52:0/3386896788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40ab650 con 0x7ff2f40d0210 2023-09-30T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2ebfff640 1 -- 172.21.15.52:0/3386896788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40ab7b0 con 0x7ff2f40d0210 2023-09-30T16:49:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2ebfff640 1 -- 172.21.15.52:0/3386896788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40abb40 con 0x7ff2f40d0210 2023-09-30T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3386896788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d0210 msgr2=0x7ff2f40d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3386896788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d0210 0x7ff2f40d2070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40097c0 tx=0x7ff2e401c450 comp rx=0 tx=0).stop 2023-09-30T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3386896788 shutdown_connections 2023-09-30T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3386896788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f40d25b0 0x7ff2f40b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3386896788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d0210 0x7ff2f40d2070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3386896788 >> 172.21.15.52:0/3386896788 conn(0x7ff2f4071930 msgr2=0x7ff2f4071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3386896788 shutdown_connections 2023-09-30T16:49:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3386896788 wait complete. 2023-09-30T16:49:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 Processor -- start 2023-09-30T16:49:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- start start 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2f40d0210 0x7ff2f4154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 0x7ff2f4152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f415cc60 0x7ff2f41476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f415f4d0 con 0x7ff2f40d25b0 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f415d180 con 0x7ff2f40d0210 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f415d460 con 0x7ff2f415cc60 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 0x7ff2f4152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 0x7ff2f4152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54364/0 (socket says 172.21.15.52:54364) 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3063180570 learned_addr learned my addr 172.21.15.52:0/3063180570 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f9e63640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f415cc60 0x7ff2f41476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f9662640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2f40d0210 0x7ff2f4154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f415cc60 msgr2=0x7ff2f41476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f415cc60 0x7ff2f41476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2f40d0210 msgr2=0x7ff2f4154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2f40d0210 0x7ff2f4154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 -- 172.21.15.52:0/3063180570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4009420 con 0x7ff2f40d25b0 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f9e63640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f415cc60 0x7ff2f41476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2f8e61640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 0x7ff2f4152e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff2e401a080 tx=0x7ff2e401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40b5810 con 0x7ff2f40d25b0 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40b5990 con 0x7ff2f40d25b0 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40b5d40 con 0x7ff2f40d25b0 2023-09-30T16:49:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f415d740 con 0x7ff2f40d25b0 2023-09-30T16:49:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.542+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f415dd00 con 0x7ff2f40d25b0 2023-09-30T16:49:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.546+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f415def0 con 0x7ff2f40d25b0 2023-09-30T16:49:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.546+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff2e40b4390 con 0x7ff2f40d25b0 2023-09-30T16:49:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.546+0000 7ff2e9ffb640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff2d8066160 0x7ff2d8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.546+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2e411e7a0 con 0x7ff2f40d25b0 2023-09-30T16:49:24.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.546+0000 7ff2f9662640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff2d8066160 0x7ff2d8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.546+0000 7ff2f9662640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff2d8066160 0x7ff2d8068620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0000f70 tx=0x7ff2f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.550+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff2e40ebe40 con 0x7ff2f40d25b0 2023-09-30T16:49:24.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.706+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2f40740a0 con 0x7ff2f40d25b0 2023-09-30T16:49:24.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.706+0000 7ff2e9ffb640 1 -- 172.21.15.52:0/3063180570 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2e40ef460 con 0x7ff2f40d25b0 2023-09-30T16:49:24.712 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff2d8066160 msgr2=0x7ff2d8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff2d8066160 0x7ff2d8068620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0000f70 tx=0x7ff2f0009040 comp rx=0 tx=0).stop 2023-09-30T16:49:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 msgr2=0x7ff2f4152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 0x7ff2f4152e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff2e401a080 tx=0x7ff2e401ac90 comp rx=0 tx=0).stop 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 shutdown_connections 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff2d8066160 0x7ff2d8068620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2f415cc60 0x7ff2f41476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f40d25b0 0x7ff2f4152e70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 --2- 172.21.15.52:0/3063180570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2f40d0210 0x7ff2f4154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 >> 172.21.15.52:0/3063180570 conn(0x7ff2f4071930 msgr2=0x7ff2f40b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:24.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 shutdown_connections 2023-09-30T16:49:24.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.710+0000 7ff2fb8c6640 1 -- 172.21.15.52:0/3063180570 wait complete. 2023-09-30T16:49:24.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 Processor -- start 2023-09-30T16:49:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 -- start start 2023-09-30T16:49:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f911815cb50 0x7f9118070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f911806d730 0x7f91180c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9118070f10 con 0x7f91180c9120 2023-09-30T16:49:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91180c9530 con 0x7f911815cb50 2023-09-30T16:49:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911f87d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9118070670 con 0x7f911806d730 2023-09-30T16:49:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911de1a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f91180c9120 0x7f9118160d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40124/0 (socket says 172.21.15.52:40124) 2023-09-30T16:49:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911d619640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f911815cb50 0x7f9118070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911de1a640 1 -- 172.21.15.52:0/537392165 learned_addr learned my addr 172.21.15.52:0/537392165 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911ce18640 1 --2- 172.21.15.52:0/537392165 >> v2:172.21.15.186:3300/0 conn(0x7f911806d730 0x7f91180c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f910ffff640 1 -- 172.21.15.52:0/537392165 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905895422 0 0) 0x7f9118070f10 con 0x7f91180c9120 2023-09-30T16:49:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f910ffff640 1 -- 172.21.15.52:0/537392165 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9104003530 con 0x7f91180c9120 2023-09-30T16:49:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911d619640 1 -- 172.21.15.52:0/537392165 >> v2:172.21.15.186:3300/0 conn(0x7f911806d730 msgr2=0x7f91180c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911d619640 1 --2- 172.21.15.52:0/537392165 >> v2:172.21.15.186:3300/0 conn(0x7f911806d730 0x7f91180c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911d619640 1 -- 172.21.15.52:0/537392165 >> v1:172.21.15.52:6789/0 conn(0x7f91180c9120 legacy=0x7f9118160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.858+0000 7f911d619640 1 -- 172.21.15.52:0/537392165 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118070950 con 0x7f911815cb50 2023-09-30T16:49:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911d619640 1 --2- 172.21.15.52:0/537392165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911815cb50 0x7f9118070070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91180b0e60 tx=0x7f911401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a30ac767a849a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f910ffff640 1 -- 172.21.15.52:0/537392165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a8950 con 0x7f911815cb50 2023-09-30T16:49:24.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f910ffff640 1 -- 172.21.15.52:0/537392165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140a8ab0 con 0x7f911815cb50 2023-09-30T16:49:24.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f910ffff640 1 -- 172.21.15.52:0/537392165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a8e20 con 0x7f911815cb50 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 -- 172.21.15.52:0/537392165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911815cb50 msgr2=0x7f9118070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 --2- 172.21.15.52:0/537392165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911815cb50 0x7f9118070070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91180b0e60 tx=0x7f911401ec50 comp rx=0 tx=0).stop 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 -- 172.21.15.52:0/537392165 shutdown_connections 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 --2- 172.21.15.52:0/537392165 >> v2:172.21.15.186:3300/0 conn(0x7f911806d730 0x7f91180c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 --2- 172.21.15.52:0/537392165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911815cb50 0x7f9118070070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 -- 172.21.15.52:0/537392165 >> 172.21.15.52:0/537392165 conn(0x7f911806a5c0 msgr2=0x7f91180ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 -- 172.21.15.52:0/537392165 shutdown_connections 2023-09-30T16:49:24.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 -- 172.21.15.52:0/537392165 wait complete. 2023-09-30T16:49:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 Processor -- start 2023-09-30T16:49:24.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.862+0000 7f911f87d640 1 -- start start 2023-09-30T16:49:24.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 0x7f91181f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91180c9120 0x7f91180c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f911815cb50 0x7f91181f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180c6970 con 0x7f911806d730 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91180c85a0 con 0x7f911815cb50 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91180c5d60 con 0x7f91180c9120 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 0x7f91181f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 0x7f91181f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54388/0 (socket says 172.21.15.52:54388) 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 -- 172.21.15.52:0/3154010983 learned_addr learned my addr 172.21.15.52:0/3154010983 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911ce18640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91180c9120 0x7f91180c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911de1a640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f911815cb50 0x7f91181f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 -- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91180c9120 msgr2=0x7f91180c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91180c9120 0x7f91180c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 -- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f911815cb50 msgr2=0x7f91181f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f911815cb50 0x7f91181f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 -- 172.21.15.52:0/3154010983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009420 con 0x7f911806d730 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911ce18640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91180c9120 0x7f91180c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911d619640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 0x7f91181f2350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9114000c10 tx=0x7f911401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140b1de0 con 0x7f911806d730 2023-09-30T16:49:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140b9410 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91180c6040 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140b97c0 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91180c6600 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91180740a0 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f91140b7040 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f910dffb640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f90fc066160 0x7f90fc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.866+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9114121630 con 0x7f911806d730 2023-09-30T16:49:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.870+0000 7f911ce18640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f90fc066160 0x7f90fc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:24.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.870+0000 7f911ce18640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f90fc066160 0x7f90fc068620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91181606b0 tx=0x7f9108008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:24.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:24.870+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f91140eec50 con 0x7f911806d730 2023-09-30T16:49:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.034+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91180cf2d0 con 0x7f911806d730 2023-09-30T16:49:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.034+0000 7f910dffb640 1 -- 172.21.15.52:0/3154010983 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91140f2270 con 0x7f911806d730 2023-09-30T16:49:25.041 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f90fc066160 msgr2=0x7f90fc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f90fc066160 0x7f90fc068620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91181606b0 tx=0x7f9108008040 comp rx=0 tx=0).stop 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 msgr2=0x7f91181f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 0x7f91181f2350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9114000c10 tx=0x7f911401b9f0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 shutdown_connections 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f90fc066160 0x7f90fc068620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f911815cb50 0x7f91181f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91180c9120 0x7f91180c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 --2- 172.21.15.52:0/3154010983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f911806d730 0x7f91181f2350 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 >> 172.21.15.52:0/3154010983 conn(0x7f911806a5c0 msgr2=0x7f91180ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 shutdown_connections 2023-09-30T16:49:25.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.038+0000 7f911f87d640 1 -- 172.21.15.52:0/3154010983 wait complete. 2023-09-30T16:49:25.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.182+0000 7f45d09fb640 1 Processor -- start 2023-09-30T16:49:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.182+0000 7f45d09fb640 1 -- start start 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f45cc06d730 0x7f45cc070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45cc160d30 0x7f45cc161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc070f10 con 0x7f45cc15cb50 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc161680 con 0x7f45cc160d30 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc070670 con 0x7f45cc06d730 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45cc160d30 0x7f45cc161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45cc160d30 0x7f45cc161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54404/0 (socket says 172.21.15.52:54404) 2023-09-30T16:49:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/1697971335 learned_addr learned my addr 172.21.15.52:0/1697971335 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45c9d9b640 1 --2- 172.21.15.52:0/1697971335 >> v2:172.21.15.186:3300/0 conn(0x7f45cc06d730 0x7f45cc070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/1697971335 >> v2:172.21.15.186:3300/0 conn(0x7f45cc06d730 msgr2=0x7f45cc070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- 172.21.15.52:0/1697971335 >> v2:172.21.15.186:3300/0 conn(0x7f45cc06d730 0x7f45cc070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/1697971335 >> v1:172.21.15.186:6789/0 conn(0x7f45cc15cb50 legacy=0x7f45cc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/1697971335 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc070950 con 0x7f45cc160d30 2023-09-30T16:49:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- 172.21.15.52:0/1697971335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc161140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0adf50 tx=0x7f45c401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d681e8647b80632 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45c959a640 1 -- 172.21.15.52:0/1697971335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40af400 con 0x7f45cc160d30 2023-09-30T16:49:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45c959a640 1 -- 172.21.15.52:0/1697971335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40ab050 con 0x7f45cc160d30 2023-09-30T16:49:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45c959a640 1 -- 172.21.15.52:0/1697971335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40af780 con 0x7f45cc160d30 2023-09-30T16:49:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/1697971335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 msgr2=0x7f45cc161140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- 172.21.15.52:0/1697971335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc161140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0adf50 tx=0x7f45c401f180 comp rx=0 tx=0).stop 2023-09-30T16:49:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/1697971335 shutdown_connections 2023-09-30T16:49:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- 172.21.15.52:0/1697971335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc161140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- 172.21.15.52:0/1697971335 >> v2:172.21.15.186:3300/0 conn(0x7f45cc06d730 0x7f45cc070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/1697971335 >> 172.21.15.52:0/1697971335 conn(0x7f45cc06a5c0 msgr2=0x7f45cc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/1697971335 shutdown_connections 2023-09-30T16:49:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/1697971335 wait complete. 2023-09-30T16:49:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 Processor -- start 2023-09-30T16:49:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- start start 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45cc06d730 0x7f45cc0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45cc15cb50 0x7f45cc15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc15bf90 con 0x7f45cc160d30 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc15f2e0 con 0x7f45cc06d730 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0c6630 con 0x7f45cc15cb50 2023-09-30T16:49:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc15eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54406/0 (socket says 172.21.15.52:54406) 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/54396935 learned_addr learned my addr 172.21.15.52:0/54396935 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45c9d9b640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45cc15cb50 0x7f45cc15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45ca59c640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45cc06d730 0x7f45cc0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45cc15cb50 msgr2=0x7f45cc15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45cc15cb50 0x7f45cc15ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45cc06d730 msgr2=0x7f45cc0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45cc06d730 0x7f45cc0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 -- 172.21.15.52:0/54396935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009b30 con 0x7f45cc160d30 2023-09-30T16:49:25.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45c9d9b640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45cc15cb50 0x7f45cc15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45cad9d640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc15eda0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45c401cdb0 tx=0x7f45c401bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40afde0 con 0x7f45cc160d30 2023-09-30T16:49:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c4009510 con 0x7f45cc160d30 2023-09-30T16:49:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40ba660 con 0x7f45cc160d30 2023-09-30T16:49:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc0c6910 con 0x7f45cc160d30 2023-09-30T16:49:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.186+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc0c6ed0 con 0x7f45cc160d30 2023-09-30T16:49:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.190+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc0740a0 con 0x7f45cc160d30 2023-09-30T16:49:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.190+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f45c40b6040 con 0x7f45cc160d30 2023-09-30T16:49:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.190+0000 7f45baffd640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f45ac066160 0x7f45ac068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.190+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45c4122620 con 0x7f45cc160d30 2023-09-30T16:49:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.190+0000 7f45ca59c640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f45ac066160 0x7f45ac068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.190+0000 7f45ca59c640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f45ac066160 0x7f45ac068620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45bc004e30 tx=0x7f45bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.194+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f45c40efd20 con 0x7f45cc160d30 2023-09-30T16:49:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.346+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45cc0ca660 con 0x7f45cc160d30 2023-09-30T16:49:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.346+0000 7f45baffd640 1 -- 172.21.15.52:0/54396935 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45c40f3340 con 0x7f45cc160d30 2023-09-30T16:49:25.354 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f45ac066160 msgr2=0x7f45ac068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f45ac066160 0x7f45ac068620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45bc004e30 tx=0x7f45bc009040 comp rx=0 tx=0).stop 2023-09-30T16:49:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 msgr2=0x7f45cc15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc15eda0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45c401cdb0 tx=0x7f45c401bf20 comp rx=0 tx=0).stop 2023-09-30T16:49:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 shutdown_connections 2023-09-30T16:49:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f45ac066160 0x7f45ac068620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45cc160d30 0x7f45cc15eda0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45cc15cb50 0x7f45cc15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 --2- 172.21.15.52:0/54396935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45cc06d730 0x7f45cc0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 >> 172.21.15.52:0/54396935 conn(0x7f45cc06a5c0 msgr2=0x7f45cc0ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 shutdown_connections 2023-09-30T16:49:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.350+0000 7f45d09fb640 1 -- 172.21.15.52:0/54396935 wait complete. 2023-09-30T16:49:25.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:49:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 Processor -- start 2023-09-30T16:49:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 -- start start 2023-09-30T16:49:25.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff750159850 0x7ff7500cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7500cdb30 0x7ff7500ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7500ccb20 con 0x7ff7500cc6c0 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7500cdf70 con 0x7ff7500cdb30 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff7567f6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500ce170 con 0x7ff750159850 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7500cdb30 0x7ff7500ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff74f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff7500cc6c0 0x7ff7500cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57716/0 (socket says 172.21.15.52:57716) 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7500cdb30 0x7ff7500ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35088/0 (socket says 172.21.15.52:35088) 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff74f7fe640 1 -- 172.21.15.52:0/3555725932 learned_addr learned my addr 172.21.15.52:0/3555725932 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff74ffff640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff750159850 0x7ff7500cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 -- 172.21.15.52:0/3555725932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff750159850 msgr2=0x7ff7500cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff750159850 0x7ff7500cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 -- 172.21.15.52:0/3555725932 >> v1:172.21.15.52:6789/0 conn(0x7ff7500cc6c0 legacy=0x7ff7500cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 -- 172.21.15.52:0/3555725932 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75006eea0 con 0x7ff7500cdb30 2023-09-30T16:49:25.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff74ffff640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff750159850 0x7ff7500cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:25.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff74effd640 1 -- 172.21.15.52:0/3555725932 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014967571 0 0) 0x7ff7500ccb20 con 0x7ff7500cc6c0 2023-09-30T16:49:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.482+0000 7ff754d93640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7500cdb30 0x7ff7500ce560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff74800bfa0 tx=0x7ff74801ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d428d56a3ad059 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74effd640 1 -- 172.21.15.52:0/3555725932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74800b2d0 con 0x7ff7500cdb30 2023-09-30T16:49:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74effd640 1 -- 172.21.15.52:0/3555725932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480a7960 con 0x7ff7500cdb30 2023-09-30T16:49:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74effd640 1 -- 172.21.15.52:0/3555725932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480a7cf0 con 0x7ff7500cdb30 2023-09-30T16:49:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/3555725932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7500cdb30 msgr2=0x7ff7500ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7500cdb30 0x7ff7500ce560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff74800bfa0 tx=0x7ff74801ea90 comp rx=0 tx=0).stop 2023-09-30T16:49:25.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/3555725932 shutdown_connections 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7500cdb30 0x7ff7500ce560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 --2- 172.21.15.52:0/3555725932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff750159850 0x7ff7500cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/3555725932 >> 172.21.15.52:0/3555725932 conn(0x7ff75006d320 msgr2=0x7ff75006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/3555725932 shutdown_connections 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/3555725932 wait complete. 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 Processor -- start 2023-09-30T16:49:25.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- start start 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7500cc6c0 0x7ff75014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7500cdb30 0x7ff7500b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 0x7ff750152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500c7570 con 0x7ff750159850 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500c7850 con 0x7ff7500cdb30 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500c7b30 con 0x7ff7500cc6c0 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 0x7ff750152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 0x7ff750152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35104/0 (socket says 172.21.15.52:35104) 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 -- 172.21.15.52:0/2522082673 learned_addr learned my addr 172.21.15.52:0/2522082673 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74ffff640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7500cc6c0 0x7ff75014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74f7fe640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7500cdb30 0x7ff7500b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 -- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7500cc6c0 msgr2=0x7ff75014dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7500cc6c0 0x7ff75014dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 -- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7500cdb30 msgr2=0x7ff7500b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7500cdb30 0x7ff7500b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 -- 172.21.15.52:0/2522082673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74800bc80 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff754d93640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 0x7ff750152be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff74800bfa0 tx=0x7ff74801b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748003ba0 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff748003d00 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7500c7e10 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748004270 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.486+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff750159f70 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.490+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7500b25c0 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.490+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff7480043d0 con 0x7ff750159850 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.490+0000 7ff74cff9640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff73c066190 0x7ff73c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.490+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff748120c80 con 0x7ff750159850 2023-09-30T16:49:25.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.490+0000 7ff74ffff640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff73c066190 0x7ff73c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.490+0000 7ff74ffff640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff73c066190 0x7ff73c068650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff7500afd40 tx=0x7ff740008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.494+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff7480ee330 con 0x7ff750159850 2023-09-30T16:49:25.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.674+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7500740a0 con 0x7ff750159850 2023-09-30T16:49:25.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff74cff9640 1 -- 172.21.15.52:0/2522082673 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7ff7480f1950 con 0x7ff750159850 2023-09-30T16:49:25.679 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:25.679 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:49:25.680 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:49:25.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff73c066190 msgr2=0x7ff73c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff73c066190 0x7ff73c068650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff7500afd40 tx=0x7ff740008040 comp rx=0 tx=0).stop 2023-09-30T16:49:25.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 msgr2=0x7ff750152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 0x7ff750152be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff74800bfa0 tx=0x7ff74801b830 comp rx=0 tx=0).stop 2023-09-30T16:49:25.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 shutdown_connections 2023-09-30T16:49:25.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff73c066190 0x7ff73c068650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff750159850 0x7ff750152be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7500cdb30 0x7ff7500b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 --2- 172.21.15.52:0/2522082673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7500cc6c0 0x7ff75014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 >> 172.21.15.52:0/2522082673 conn(0x7ff75006d320 msgr2=0x7ff7500b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 shutdown_connections 2023-09-30T16:49:25.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.678+0000 7ff7567f6640 1 -- 172.21.15.52:0/2522082673 wait complete. 2023-09-30T16:49:25.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:25.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 Processor -- start 2023-09-30T16:49:25.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 -- start start 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ba415ad00 0x7f5ba406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba40c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40c4b50 con 0x7f5ba406a6a0 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba406ee10 con 0x7f5ba415ad00 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba9077640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba406f0f0 con 0x7f5ba40c41b0 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ba415ad00 0x7f5ba406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ba415ad00 0x7f5ba406e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35116/0 (socket says 172.21.15.52:35116) 2023-09-30T16:49:25.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/2097226820 learned_addr learned my addr 172.21.15.52:0/2097226820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:25.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba259c640 1 --2- 172.21.15.52:0/2097226820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba40c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/2097226820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 msgr2=0x7f5ba40c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:25.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 --2- 172.21.15.52:0/2097226820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba40c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/2097226820 >> v1:172.21.15.186:6789/0 conn(0x7f5ba406a6a0 legacy=0x7f5ba406aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:25.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.806+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/2097226820 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba406f3d0 con 0x7f5ba415ad00 2023-09-30T16:49:25.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba2d9d640 1 --2- 172.21.15.52:0/2097226820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba415ad00 0x7f5ba406e7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009870 tx=0x7f5b9401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ba307cfaa564cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba1d9b640 1 -- 172.21.15.52:0/2097226820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940ab650 con 0x7f5ba415ad00 2023-09-30T16:49:25.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba1d9b640 1 -- 172.21.15.52:0/2097226820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b940ab7b0 con 0x7f5ba415ad00 2023-09-30T16:49:25.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba1d9b640 1 -- 172.21.15.52:0/2097226820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940abb40 con 0x7f5ba415ad00 2023-09-30T16:49:25.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- 172.21.15.52:0/2097226820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba415ad00 msgr2=0x7f5ba406e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 --2- 172.21.15.52:0/2097226820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba415ad00 0x7f5ba406e7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009870 tx=0x7f5b9401c4d0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- 172.21.15.52:0/2097226820 shutdown_connections 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 --2- 172.21.15.52:0/2097226820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba40c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 --2- 172.21.15.52:0/2097226820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba415ad00 0x7f5ba406e7d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- 172.21.15.52:0/2097226820 >> 172.21.15.52:0/2097226820 conn(0x7f5ba40b0b80 msgr2=0x7f5ba40b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- 172.21.15.52:0/2097226820 shutdown_connections 2023-09-30T16:49:25.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- 172.21.15.52:0/2097226820 wait complete. 2023-09-30T16:49:25.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 Processor -- start 2023-09-30T16:49:25.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- start start 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 0x7f5ba414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba4147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ba415ad00 0x7f5ba415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4148450 con 0x7f5ba406a6a0 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4150a30 con 0x7f5ba415ad00 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba9077640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4150100 con 0x7f5ba40c41b0 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 0x7f5ba414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 0x7f5ba414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35132/0 (socket says 172.21.15.52:35132) 2023-09-30T16:49:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/1665049279 learned_addr learned my addr 172.21.15.52:0/1665049279 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba259c640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba4147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.810+0000 7f5ba359e640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ba415ad00 0x7f5ba415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 msgr2=0x7f5ba4147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba2d9d640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba4147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ba415ad00 msgr2=0x7f5ba415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba2d9d640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ba415ad00 0x7f5ba415b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba2d9d640 1 -- 172.21.15.52:0/1665049279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940094d0 con 0x7f5ba406a6a0 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba359e640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ba415ad00 0x7f5ba415b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba2d9d640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 0x7f5ba414b320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b940ad040 tx=0x7f5b9401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940b4800 con 0x7f5ba406a6a0 2023-09-30T16:49:25.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b940b4980 con 0x7f5ba406a6a0 2023-09-30T16:49:25.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba41503e0 con 0x7f5ba406a6a0 2023-09-30T16:49:25.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940b4d30 con 0x7f5ba406a6a0 2023-09-30T16:49:25.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba415bc50 con 0x7f5ba406a6a0 2023-09-30T16:49:25.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba40c96d0 con 0x7f5ba406a6a0 2023-09-30T16:49:25.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f5b940c7440 con 0x7f5ba406a6a0 2023-09-30T16:49:25.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5b8b7fe640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b90066160 0x7f5b90068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:25.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b9411e780 con 0x7f5ba406a6a0 2023-09-30T16:49:25.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba259c640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b90066160 0x7f5b90068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:25.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.814+0000 7f5ba259c640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b90066160 0x7f5b90068620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40b5310 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:25.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.818+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5b940ebe30 con 0x7f5ba406a6a0 2023-09-30T16:49:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.974+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba40740a0 con 0x7f5ba406a6a0 2023-09-30T16:49:25.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.974+0000 7f5b8b7fe640 1 -- 172.21.15.52:0/1665049279 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f5b940ef450 con 0x7f5ba406a6a0 2023-09-30T16:49:25.978 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:25.978 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b90066160 msgr2=0x7f5b90068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b90066160 0x7f5b90068620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40b5310 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 msgr2=0x7f5ba414b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 0x7f5ba414b320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b940ad040 tx=0x7f5b9401ad10 comp rx=0 tx=0).stop 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 shutdown_connections 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5b90066160 0x7f5b90068620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ba415ad00 0x7f5ba415b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ba40c41b0 0x7f5ba4147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 --2- 172.21.15.52:0/1665049279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ba406a6a0 0x7f5ba414b320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 >> 172.21.15.52:0/1665049279 conn(0x7f5ba40b0b80 msgr2=0x7f5ba414eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 shutdown_connections 2023-09-30T16:49:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:25.978+0000 7f5ba9077640 1 -- 172.21.15.52:0/1665049279 wait complete. 2023-09-30T16:49:25.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:25.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:26.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.126+0000 7fa0e544b640 1 Processor -- start 2023-09-30T16:49:26.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.126+0000 7fa0e544b640 1 -- start start 2023-09-30T16:49:26.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0e544b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0e015aa40 0x7fa0e00c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0e544b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e00b1470 0x7fa0e00b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0e544b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa0e006d500 0x7fa0e00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0e544b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00b4610 con 0x7fa0e015aa40 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0e544b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e015e750 con 0x7fa0e006d500 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0e544b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e015ea30 con 0x7fa0e00b1470 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0e015aa40 0x7fa0e00c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa0e015aa40 0x7fa0e00c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35136/0 (socket says 172.21.15.52:35136) 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 -- 172.21.15.52:0/2893084909 learned_addr learned my addr 172.21.15.52:0/2893084909 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0de7fc640 1 --2- 172.21.15.52:0/2893084909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e00b1470 0x7fa0e00b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0df7fe640 1 --2- 172.21.15.52:0/2893084909 >> v2:172.21.15.186:3300/0 conn(0x7fa0e006d500 0x7fa0e00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 -- 172.21.15.52:0/2893084909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e00b1470 msgr2=0x7fa0e00b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 --2- 172.21.15.52:0/2893084909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e00b1470 0x7fa0e00b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 -- 172.21.15.52:0/2893084909 >> v2:172.21.15.186:3300/0 conn(0x7fa0e006d500 msgr2=0x7fa0e00b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 --2- 172.21.15.52:0/2893084909 >> v2:172.21.15.186:3300/0 conn(0x7fa0e006d500 0x7fa0e00b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 -- 172.21.15.52:0/2893084909 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e015ed10 con 0x7fa0e015aa40 2023-09-30T16:49:26.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0deffd640 1 --2- 172.21.15.52:0/2893084909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e015aa40 0x7fa0e00c95f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0e006d990 tx=0x7fa0d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27db4e683e848e3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0ddffb640 1 -- 172.21.15.52:0/2893084909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00aa5f0 con 0x7fa0e015aa40 2023-09-30T16:49:26.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0ddffb640 1 -- 172.21.15.52:0/2893084909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00aa750 con 0x7fa0e015aa40 2023-09-30T16:49:26.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.130+0000 7fa0ddffb640 1 -- 172.21.15.52:0/2893084909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00aaae0 con 0x7fa0e015aa40 2023-09-30T16:49:26.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- 172.21.15.52:0/2893084909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e015aa40 msgr2=0x7fa0e00c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- 172.21.15.52:0/2893084909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e015aa40 0x7fa0e00c95f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0e006d990 tx=0x7fa0d001c4d0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- 172.21.15.52:0/2893084909 shutdown_connections 2023-09-30T16:49:26.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- 172.21.15.52:0/2893084909 >> v2:172.21.15.186:3300/0 conn(0x7fa0e006d500 0x7fa0e00b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- 172.21.15.52:0/2893084909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e00b1470 0x7fa0e00b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- 172.21.15.52:0/2893084909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e015aa40 0x7fa0e00c95f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- 172.21.15.52:0/2893084909 >> 172.21.15.52:0/2893084909 conn(0x7fa0e006a5c0 msgr2=0x7fa0e00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- 172.21.15.52:0/2893084909 shutdown_connections 2023-09-30T16:49:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- 172.21.15.52:0/2893084909 wait complete. 2023-09-30T16:49:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 Processor -- start 2023-09-30T16:49:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- start start 2023-09-30T16:49:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e006d500 0x7fa0e00af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 0x7fa0e0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e015aa40 0x7fa0e01553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0158e10 con 0x7fa0e00b1470 2023-09-30T16:49:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0158b30 con 0x7fa0e015aa40 2023-09-30T16:49:26.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0e544b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00aeb50 con 0x7fa0e006d500 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 0x7fa0e0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 0x7fa0e0152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35150/0 (socket says 172.21.15.52:35150) 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 -- 172.21.15.52:0/63288404 learned_addr learned my addr 172.21.15.52:0/63288404 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0deffd640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e006d500 0x7fa0e00af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0df7fe640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e015aa40 0x7fa0e01553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 -- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e006d500 msgr2=0x7fa0e00af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e006d500 0x7fa0e00af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 -- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e015aa40 msgr2=0x7fa0e01553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e015aa40 0x7fa0e01553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 -- 172.21.15.52:0/63288404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00094d0 con 0x7fa0e00b1470 2023-09-30T16:49:26.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0deffd640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e006d500 0x7fa0e00af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0de7fc640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 0x7fa0e0152e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400d7d0 tx=0x7fa0d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400b6c0 con 0x7fa0e00b1470 2023-09-30T16:49:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d400b820 con 0x7fa0e00b1470 2023-09-30T16:49:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.134+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400bbd0 con 0x7fa0e00b1470 2023-09-30T16:49:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e00aee30 con 0x7fa0e00b1470 2023-09-30T16:49:26.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e00afb70 con 0x7fa0e00b1470 2023-09-30T16:49:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e00740a0 con 0x7fa0e00b1470 2023-09-30T16:49:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa0d400bd30 con 0x7fa0e00b1470 2023-09-30T16:49:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0c77fe640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa0cc066160 0x7fa0cc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0d4084090 con 0x7fa0e00b1470 2023-09-30T16:49:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0deffd640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa0cc066160 0x7fa0cc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.138+0000 7fa0deffd640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa0cc066160 0x7fa0cc068620 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00ae000 tx=0x7fa0d00a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.142+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fa0d4051610 con 0x7fa0e00b1470 2023-09-30T16:49:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.298+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0e00cf0b0 con 0x7fa0e00b1470 2023-09-30T16:49:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.298+0000 7fa0c77fe640 1 -- 172.21.15.52:0/63288404 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0d4054c30 con 0x7fa0e00b1470 2023-09-30T16:49:26.301 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:26.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa0cc066160 msgr2=0x7fa0cc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa0cc066160 0x7fa0cc068620 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00ae000 tx=0x7fa0d00a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:26.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 msgr2=0x7fa0e0152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 0x7fa0e0152e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400d7d0 tx=0x7fa0d400dc90 comp rx=0 tx=0).stop 2023-09-30T16:49:26.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 shutdown_connections 2023-09-30T16:49:26.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa0cc066160 0x7fa0cc068620 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0e015aa40 0x7fa0e01553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e00b1470 0x7fa0e0152e60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 --2- 172.21.15.52:0/63288404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0e006d500 0x7fa0e00af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 >> 172.21.15.52:0/63288404 conn(0x7fa0e006a5c0 msgr2=0x7fa0e00cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 shutdown_connections 2023-09-30T16:49:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.302+0000 7fa0e544b640 1 -- 172.21.15.52:0/63288404 wait complete. 2023-09-30T16:49:26.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.446+0000 7fdd34a4a640 1 Processor -- start 2023-09-30T16:49:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.446+0000 7fdd34a4a640 1 -- start start 2023-09-30T16:49:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd34a4a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdd3006d730 0x7fdd30070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd34a4a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd30070f10 con 0x7fdd30160d30 2023-09-30T16:49:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd34a4a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd30070670 con 0x7fdd3015cb50 2023-09-30T16:49:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd34a4a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd30070950 con 0x7fdd3006d730 2023-09-30T16:49:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdd30160d30 0x7fdd300b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57730/0 (socket says 172.21.15.52:57730) 2023-09-30T16:49:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 -- 172.21.15.52:0/2527436340 learned_addr learned my addr 172.21.15.52:0/2527436340 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2dd9b640 1 --2- 172.21.15.52:0/2527436340 >> v2:172.21.15.186:3300/0 conn(0x7fdd3006d730 0x7fdd30070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674935268 0 0) 0x7fdd30070f10 con 0x7fdd30160d30 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd18003530 con 0x7fdd30160d30 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3593719038 0 0) 0x7fdd18003530 con 0x7fdd30160d30 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 >> v2:172.21.15.186:3300/0 conn(0x7fdd3006d730 msgr2=0x7fdd30070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 --2- 172.21.15.52:0/2527436340 >> v2:172.21.15.186:3300/0 conn(0x7fdd3006d730 0x7fdd30070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 >> v1:172.21.15.186:6789/0 conn(0x7fdd3015cb50 legacy=0x7fdd300c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30070c30 con 0x7fdd30160d30 2023-09-30T16:49:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fdd28001a00 con 0x7fdd30160d30 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 >> v1:172.21.15.52:6789/0 conn(0x7fdd30160d30 legacy=0x7fdd300b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd18003980 0x7fdd18003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180047d0 0x7fdd18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30070950 con 0x7fdd18005190 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1800c040 con 0x7fdd18003980 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1800c200 con 0x7fdd180047d0 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2e59c640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd18003980 0x7fdd18003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2dd9b640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180047d0 0x7fdd18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 -- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180047d0 msgr2=0x7fdd18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180047d0 0x7fdd18004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 -- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd18003980 msgr2=0x7fdd18003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd18003980 0x7fdd18003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.450+0000 7fdd2ed9d640 1 -- 172.21.15.52:0/2527436340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18003530 con 0x7fdd18005190 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2ed9d640 1 -- 172.21.15.52:0/2527436340 reap_dead start 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2ed9d640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd1800b990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800a830 tx=0x7fdd2801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed16fb3f4b3b6e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd280072d0 con 0x7fdd18005190 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd280a8070 con 0x7fdd18005190 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2d59a640 1 -- 172.21.15.52:0/2527436340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd280076b0 con 0x7fdd18005190 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/2527436340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 msgr2=0x7fdd1800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd1800b990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800a830 tx=0x7fdd2801d340 comp rx=0 tx=0).stop 2023-09-30T16:49:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/2527436340 shutdown_connections 2023-09-30T16:49:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/2527436340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd1800b990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/2527436340 >> 172.21.15.52:0/2527436340 conn(0x7fdd3006a5c0 msgr2=0x7fdd300ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/2527436340 shutdown_connections 2023-09-30T16:49:26.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/2527436340 wait complete. 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 Processor -- start 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- start start 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd30159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd300c5870 0x7fdd300c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd300c5cd0 0x7fdd300c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c6250 con 0x7fdd18005190 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c6530 con 0x7fdd300c5cd0 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c6810 con 0x7fdd300c5870 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd30159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd30159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35160/0 (socket says 172.21.15.52:35160) 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 -- 172.21.15.52:0/1458261050 learned_addr learned my addr 172.21.15.52:0/1458261050 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2dd9b640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd300c5870 0x7fdd300c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 -- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd300c5870 msgr2=0x7fdd300c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2ed9d640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd300c5cd0 0x7fdd300c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd300c5870 0x7fdd300c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 -- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd300c5cd0 msgr2=0x7fdd300c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd300c5cd0 0x7fdd300c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 -- 172.21.15.52:0/1458261050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300c6af0 con 0x7fdd18005190 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd2e59c640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd30159a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000e4b0 tx=0x7fdd2000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200052e0 con 0x7fdd18005190 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20005440 con 0x7fdd18005190 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd300c6dd0 con 0x7fdd18005190 2023-09-30T16:49:26.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20003840 con 0x7fdd18005190 2023-09-30T16:49:26.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.454+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd301f2630 con 0x7fdd18005190 2023-09-30T16:49:26.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.458+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd301f2850 con 0x7fdd18005190 2023-09-30T16:49:26.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.458+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fdd200039a0 con 0x7fdd18005190 2023-09-30T16:49:26.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.458+0000 7fdd1effd640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdd10066190 0x7fdd10068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.458+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd200838b0 con 0x7fdd18005190 2023-09-30T16:49:26.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.458+0000 7fdd2dd9b640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdd10066190 0x7fdd10068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.458+0000 7fdd2dd9b640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdd10066190 0x7fdd10068650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd300c5800 tx=0x7fdd24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.462+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fdd301f2850 con 0x7fdd18005190 2023-09-30T16:49:26.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd301f2850 con 0x7fdd18005190 2023-09-30T16:49:26.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd1effd640 1 -- 172.21.15.52:0/1458261050 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd301f2850 con 0x7fdd18005190 2023-09-30T16:49:26.620 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdd10066190 msgr2=0x7fdd10068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdd10066190 0x7fdd10068650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd300c5800 tx=0x7fdd24008040 comp rx=0 tx=0).stop 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 msgr2=0x7fdd30159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd30159a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000e4b0 tx=0x7fdd2000e970 comp rx=0 tx=0).stop 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 shutdown_connections 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdd10066190 0x7fdd10068650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd300c5cd0 0x7fdd300c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd300c5870 0x7fdd300c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 --2- 172.21.15.52:0/1458261050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd18005190 0x7fdd30159a10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 >> 172.21.15.52:0/1458261050 conn(0x7fdd3006a5c0 msgr2=0x7fdd300acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:26.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 shutdown_connections 2023-09-30T16:49:26.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.618+0000 7fdd34a4a640 1 -- 172.21.15.52:0/1458261050 wait complete. 2023-09-30T16:49:26.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:26.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.758+0000 7f44995fe640 1 Processor -- start 2023-09-30T16:49:26.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.758+0000 7f44995fe640 1 -- start start 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.758+0000 7f44995fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f449415a9e0 0x7f4494070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44940b63e0 0x7f44940b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44940b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940b2ce0 con 0x7f44940b63e0 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940ce770 con 0x7f449415a9e0 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940cea10 con 0x7f44940b2310 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44940b63e0 0x7f44940b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44940b63e0 0x7f44940b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35162/0 (socket says 172.21.15.52:35162) 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 -- 172.21.15.52:0/94221116 learned_addr learned my addr 172.21.15.52:0/94221116 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f4492ffd640 1 --2- 172.21.15.52:0/94221116 >> v2:172.21.15.186:3300/0 conn(0x7f449415a9e0 0x7f4494070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44937fe640 1 --2- 172.21.15.52:0/94221116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44940b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 -- 172.21.15.52:0/94221116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 msgr2=0x7f44940b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 --2- 172.21.15.52:0/94221116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44940b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 -- 172.21.15.52:0/94221116 >> v2:172.21.15.186:3300/0 conn(0x7f449415a9e0 msgr2=0x7f4494070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 --2- 172.21.15.52:0/94221116 >> v2:172.21.15.186:3300/0 conn(0x7f449415a9e0 0x7f4494070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 -- 172.21.15.52:0/94221116 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940cecf0 con 0x7f44940b63e0 2023-09-30T16:49:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44927fc640 1 --2- 172.21.15.52:0/94221116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44940b63e0 0x7f44940b37e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44940cdf50 tx=0x7f448801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f64d8f64e2dd06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f4491ffb640 1 -- 172.21.15.52:0/94221116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880ab600 con 0x7f44940b63e0 2023-09-30T16:49:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f4491ffb640 1 -- 172.21.15.52:0/94221116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44880ab760 con 0x7f44940b63e0 2023-09-30T16:49:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f4491ffb640 1 -- 172.21.15.52:0/94221116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880abaf0 con 0x7f44940b63e0 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- 172.21.15.52:0/94221116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44940b63e0 msgr2=0x7f44940b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 --2- 172.21.15.52:0/94221116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44940b63e0 0x7f44940b37e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44940cdf50 tx=0x7f448801c440 comp rx=0 tx=0).stop 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- 172.21.15.52:0/94221116 shutdown_connections 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 --2- 172.21.15.52:0/94221116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44940b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 --2- 172.21.15.52:0/94221116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44940b63e0 0x7f44940b37e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 --2- 172.21.15.52:0/94221116 >> v2:172.21.15.186:3300/0 conn(0x7f449415a9e0 0x7f4494070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- 172.21.15.52:0/94221116 >> 172.21.15.52:0/94221116 conn(0x7f44940cd310 msgr2=0x7f44940cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:26.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- 172.21.15.52:0/94221116 shutdown_connections 2023-09-30T16:49:26.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.762+0000 7f44995fe640 1 -- 172.21.15.52:0/94221116 wait complete. 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 Processor -- start 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- start start 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44941f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44940b63e0 0x7f449414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 0x7f44940b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941f3480 con 0x7f449415a9e0 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941f3760 con 0x7f44940b63e0 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44941f3a40 con 0x7f44940b2310 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 0x7f44940b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 0x7f44940b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35164/0 (socket says 172.21.15.52:35164) 2023-09-30T16:49:26.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 -- 172.21.15.52:0/4202948225 learned_addr learned my addr 172.21.15.52:0/4202948225 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44927fc640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44940b63e0 0x7f449414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f4492ffd640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44941f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 -- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 msgr2=0x7f44941f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44941f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 -- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44940b63e0 msgr2=0x7f449414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44940b63e0 0x7f449414a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 -- 172.21.15.52:0/4202948225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44880094d0 con 0x7f449415a9e0 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44937fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 0x7f44940b4970 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f448c00eed0 tx=0x7f448c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c010040 con 0x7f449415a9e0 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00bd10 con 0x7f449415a9e0 2023-09-30T16:49:26.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449415af40 con 0x7f449415a9e0 2023-09-30T16:49:26.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c014640 con 0x7f449415a9e0 2023-09-30T16:49:26.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940c7c40 con 0x7f449415a9e0 2023-09-30T16:49:26.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494066750 con 0x7f449415a9e0 2023-09-30T16:49:26.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.766+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f448c0147a0 con 0x7f449415a9e0 2023-09-30T16:49:26.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.770+0000 7f447b7fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4480066160 0x7f4480068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:26.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.770+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f448c084110 con 0x7f449415a9e0 2023-09-30T16:49:26.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.770+0000 7f4492ffd640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4480066160 0x7f4480068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:26.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.770+0000 7f4492ffd640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4480066160 0x7f4480068620 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4484009990 tx=0x7f4484008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:26.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.774+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f448c051720 con 0x7f449415a9e0 2023-09-30T16:49:26.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.926+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44940c7e30 con 0x7f449415a9e0 2023-09-30T16:49:26.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.926+0000 7f447b7fe640 1 -- 172.21.15.52:0/4202948225 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f448c054d40 con 0x7f449415a9e0 2023-09-30T16:49:26.929 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:26.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4480066160 msgr2=0x7f4480068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4480066160 0x7f4480068620 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4484009990 tx=0x7f4484008040 comp rx=0 tx=0).stop 2023-09-30T16:49:26.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 msgr2=0x7f44940b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:26.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 0x7f44940b4970 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f448c00eed0 tx=0x7f448c00b480 comp rx=0 tx=0).stop 2023-09-30T16:49:26.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 shutdown_connections 2023-09-30T16:49:26.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4480066160 0x7f4480068620 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449415a9e0 0x7f44940b4970 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44940b63e0 0x7f449414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 --2- 172.21.15.52:0/4202948225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44940b2310 0x7f44941f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:26.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 >> 172.21.15.52:0/4202948225 conn(0x7f44940cd310 msgr2=0x7f44940b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:26.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 shutdown_connections 2023-09-30T16:49:26.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:26.930+0000 7f44995fe640 1 -- 172.21.15.52:0/4202948225 wait complete. 2023-09-30T16:49:26.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:49:27.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 Processor -- start 2023-09-30T16:49:27.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 -- start start 2023-09-30T16:49:27.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f634c06b660 0x7f634c0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0caf90 con 0x7f634c0b2850 2023-09-30T16:49:27.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0b2ce0 con 0x7f634c06b660 2023-09-30T16:49:27.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.058+0000 7f6351375640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c06c440 con 0x7f634c1600a0 2023-09-30T16:49:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f6343fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f634c06b660 0x7f634c0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c06b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:35278/0 (socket says 172.21.15.52:35278) 2023-09-30T16:49:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f6343fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f634c06b660 0x7f634c0b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:39688/0 (socket says 172.21.15.52:39688) 2023-09-30T16:49:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 -- 172.21.15.52:0/666510907 learned_addr learned my addr 172.21.15.52:0/666510907 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 -- 172.21.15.52:0/666510907 >> v2:172.21.15.186:3300/0 conn(0x7f634c06b660 msgr2=0x7f634c0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 --2- 172.21.15.52:0/666510907 >> v2:172.21.15.186:3300/0 conn(0x7f634c06b660 0x7f634c0b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 -- 172.21.15.52:0/666510907 >> v1:172.21.15.186:6789/0 conn(0x7f634c0b2850 legacy=0x7f634c06fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.062+0000 7f634affd640 1 -- 172.21.15.52:0/666510907 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0cb230 con 0x7f634c1600a0 2023-09-30T16:49:27.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 --2- 172.21.15.52:0/666510907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c06b120 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6334009870 tx=0x7f633401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d651ca284e1a9589 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634a7fc640 1 -- 172.21.15.52:0/666510907 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340a8a30 con 0x7f634c1600a0 2023-09-30T16:49:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634a7fc640 1 -- 172.21.15.52:0/666510907 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63340a8b90 con 0x7f634c1600a0 2023-09-30T16:49:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634a7fc640 1 -- 172.21.15.52:0/666510907 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340b0440 con 0x7f634c1600a0 2023-09-30T16:49:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- 172.21.15.52:0/666510907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 msgr2=0x7f634c06b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 --2- 172.21.15.52:0/666510907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c06b120 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6334009870 tx=0x7f633401ed30 comp rx=0 tx=0).stop 2023-09-30T16:49:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- 172.21.15.52:0/666510907 shutdown_connections 2023-09-30T16:49:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 --2- 172.21.15.52:0/666510907 >> v2:172.21.15.186:3300/0 conn(0x7f634c06b660 0x7f634c0b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 --2- 172.21.15.52:0/666510907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c06b120 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- 172.21.15.52:0/666510907 >> 172.21.15.52:0/666510907 conn(0x7f634c0cd310 msgr2=0x7f634c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- 172.21.15.52:0/666510907 shutdown_connections 2023-09-30T16:49:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- 172.21.15.52:0/666510907 wait complete. 2023-09-30T16:49:27.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 Processor -- start 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- start start 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 0x7f634c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c0b2850 0x7f634c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c8780 con 0x7f634c06b660 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1532f0 con 0x7f634c0b2850 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6351375640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b3a90 con 0x7f634c1600a0 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 0x7f634c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 0x7f634c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35166/0 (socket says 172.21.15.52:35166) 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 -- 172.21.15.52:0/4025744804 learned_addr learned my addr 172.21.15.52:0/4025744804 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634b7fe640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f6343fff640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c0b2850 0x7f634c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 -- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 msgr2=0x7f634c152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 -- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c0b2850 msgr2=0x7f634c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c0b2850 0x7f634c0c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634affd640 1 -- 172.21.15.52:0/4025744804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340094d0 con 0x7f634c06b660 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.066+0000 7f634b7fe640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f634affd640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 0x7f634c0b34b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63340b3040 tx=0x7f633401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340b9620 con 0x7f634c06b660 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63340b9780 con 0x7f634c06b660 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c0b3d70 con 0x7f634c06b660 2023-09-30T16:49:27.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340b9b30 con 0x7f634c06b660 2023-09-30T16:49:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0b4330 con 0x7f634c06b660 2023-09-30T16:49:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c066750 con 0x7f634c06b660 2023-09-30T16:49:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f63340b7070 con 0x7f634c06b660 2023-09-30T16:49:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f63437fe640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f632c066190 0x7f632c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6334121a00 con 0x7f634c06b660 2023-09-30T16:49:27.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f6343fff640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f632c066190 0x7f632c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.070+0000 7f6343fff640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f632c066190 0x7f632c068650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f634c0d1760 tx=0x7f633c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.074+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f63340eef80 con 0x7f634c06b660 2023-09-30T16:49:27.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.254+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f634c0740a0 con 0x7f634c06b660 2023-09-30T16:49:27.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.254+0000 7f63437fe640 1 -- 172.21.15.52:0/4025744804 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f63340b5090 con 0x7f634c06b660 2023-09-30T16:49:27.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:27.258 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:49:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f632c066190 msgr2=0x7f632c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f632c066190 0x7f632c068650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f634c0d1760 tx=0x7f633c008040 comp rx=0 tx=0).stop 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 msgr2=0x7f634c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 0x7f634c0b34b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63340b3040 tx=0x7f633401bad0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 shutdown_connections 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f632c066190 0x7f632c068650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c1600a0 0x7f634c152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c0b2850 0x7f634c0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 --2- 172.21.15.52:0/4025744804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f634c06b660 0x7f634c0b34b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 >> 172.21.15.52:0/4025744804 conn(0x7f634c0cd310 msgr2=0x7f634c15db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 shutdown_connections 2023-09-30T16:49:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.258+0000 7f6351375640 1 -- 172.21.15.52:0/4025744804 wait complete. 2023-09-30T16:49:27.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd8a8a640 1 Processor -- start 2023-09-30T16:49:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd8a8a640 1 -- start start 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd8a8a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2bd415e4b0 0x7f2bd40b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd8a8a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd406c240 con 0x7f2bd415a9d0 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd8a8a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd415adb0 con 0x7f2bd40b19b0 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd8a8a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd415ea90 con 0x7f2bd415e4b0 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd259c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2bd415a9d0 0x7f2bd406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57736/0 (socket says 172.21.15.52:57736) 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd259c640 1 -- 172.21.15.52:0/695230616 learned_addr learned my addr 172.21.15.52:0/695230616 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bcbfff640 1 --2- 172.21.15.52:0/695230616 >> v2:172.21.15.52:3300/0 conn(0x7f2bd415e4b0 0x7f2bd40b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd1d9b640 1 -- 172.21.15.52:0/695230616 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783123583 0 0) 0x7f2bd406c240 con 0x7f2bd415a9d0 2023-09-30T16:49:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bd1d9b640 1 -- 172.21.15.52:0/695230616 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc0003530 con 0x7f2bd415a9d0 2023-09-30T16:49:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bcbfff640 1 -- 172.21.15.52:0/695230616 >> v1:172.21.15.186:6789/0 conn(0x7f2bd40b19b0 legacy=0x7f2bd40b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bcbfff640 1 -- 172.21.15.52:0/695230616 >> v1:172.21.15.52:6789/0 conn(0x7f2bd415a9d0 legacy=0x7f2bd406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.398+0000 7f2bcbfff640 1 -- 172.21.15.52:0/695230616 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd415ed70 con 0x7f2bd415e4b0 2023-09-30T16:49:27.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bcbfff640 1 --2- 172.21.15.52:0/695230616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd40b1470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0097c0 tx=0x7f2bbc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e84e4763359a93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd1d9b640 1 -- 172.21.15.52:0/695230616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0ab600 con 0x7f2bd415e4b0 2023-09-30T16:49:27.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd1d9b640 1 -- 172.21.15.52:0/695230616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0a7050 con 0x7f2bd415e4b0 2023-09-30T16:49:27.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd1d9b640 1 -- 172.21.15.52:0/695230616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0ab960 con 0x7f2bd415e4b0 2023-09-30T16:49:27.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/695230616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 msgr2=0x7f2bd40b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/695230616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd40b1470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0097c0 tx=0x7f2bbc01c440 comp rx=0 tx=0).stop 2023-09-30T16:49:27.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/695230616 shutdown_connections 2023-09-30T16:49:27.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/695230616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd40b1470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/695230616 >> 172.21.15.52:0/695230616 conn(0x7f2bd406a5f0 msgr2=0x7f2bd40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:27.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/695230616 shutdown_connections 2023-09-30T16:49:27.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/695230616 wait complete. 2023-09-30T16:49:27.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 Processor -- start 2023-09-30T16:49:27.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- start start 2023-09-30T16:49:27.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bd40b19b0 0x7f2bd41514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd415a9d0 0x7f2bd40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd4149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd41486d0 con 0x7f2bd415e4b0 2023-09-30T16:49:27.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4151cf0 con 0x7f2bd415a9d0 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4148970 con 0x7f2bd40b19b0 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd4149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd4149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35184/0 (socket says 172.21.15.52:35184) 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 -- 172.21.15.52:0/2247294825 learned_addr learned my addr 172.21.15.52:0/2247294825 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd259c640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bd40b19b0 0x7f2bd41514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bcbfff640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd415a9d0 0x7f2bd40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 -- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bd40b19b0 msgr2=0x7f2bd41514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bd40b19b0 0x7f2bd41514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 -- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd415a9d0 msgr2=0x7f2bd40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd415a9d0 0x7f2bd40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 -- 172.21.15.52:0/2247294825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc009420 con 0x7f2bd415e4b0 2023-09-30T16:49:27.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd2d9d640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd4149170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c780 tx=0x7f2bcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc004b70 con 0x7f2bd415e4b0 2023-09-30T16:49:27.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00ce90 con 0x7f2bd415e4b0 2023-09-30T16:49:27.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd4148c50 con 0x7f2bd415e4b0 2023-09-30T16:49:27.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00a850 con 0x7f2bd415e4b0 2023-09-30T16:49:27.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.402+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd4151fd0 con 0x7f2bd415e4b0 2023-09-30T16:49:27.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.406+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4148e40 con 0x7f2bd415e4b0 2023-09-30T16:49:27.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.406+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f2bcc00a9b0 con 0x7f2bd415e4b0 2023-09-30T16:49:27.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.406+0000 7f2bcaffd640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2bb4066160 0x7f2bb4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.406+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bcc083cb0 con 0x7f2bd415e4b0 2023-09-30T16:49:27.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.406+0000 7f2bd259c640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2bb4066160 0x7f2bb4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.406+0000 7f2bd259c640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2bb4066160 0x7f2bb4068620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4005890 tx=0x7f2bc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.410+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f2bcc051230 con 0x7f2bd415e4b0 2023-09-30T16:49:27.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.566+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd40740a0 con 0x7f2bd415e4b0 2023-09-30T16:49:27.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bcaffd640 1 -- 172.21.15.52:0/2247294825 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f2bcc054850 con 0x7f2bd415e4b0 2023-09-30T16:49:27.571 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:27.571 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2bb4066160 msgr2=0x7f2bb4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2bb4066160 0x7f2bb4068620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4005890 tx=0x7f2bc4009040 comp rx=0 tx=0).stop 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 msgr2=0x7f2bd4149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd4149170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c780 tx=0x7f2bcc00cc40 comp rx=0 tx=0).stop 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 shutdown_connections 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2bb4066160 0x7f2bb4068620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bd415e4b0 0x7f2bd4149170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd415a9d0 0x7f2bd40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 --2- 172.21.15.52:0/2247294825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bd40b19b0 0x7f2bd41514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 >> 172.21.15.52:0/2247294825 conn(0x7f2bd406a5f0 msgr2=0x7f2bd40cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 shutdown_connections 2023-09-30T16:49:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.570+0000 7f2bd8a8a640 1 -- 172.21.15.52:0/2247294825 wait complete. 2023-09-30T16:49:27.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:49:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 Processor -- start 2023-09-30T16:49:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 -- start start 2023-09-30T16:49:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdea01574c0 0x7fdea00cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea00ca590 0x7fdea00caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea00ce2f0 con 0x7fdea0159df0 2023-09-30T16:49:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea015ae50 con 0x7fdea01574c0 2023-09-30T16:49:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea6ea4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00caf40 con 0x7fdea00ca590 2023-09-30T16:49:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fde9ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdea0159df0 0x7fdea006bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57750/0 (socket says 172.21.15.52:57750) 2023-09-30T16:49:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fde9ffff640 1 -- 172.21.15.52:0/1757619142 learned_addr learned my addr 172.21.15.52:0/1757619142 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea5441640 1 --2- 172.21.15.52:0/1757619142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea00ca590 0x7fdea00caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea4c40640 1 --2- 172.21.15.52:0/1757619142 >> v2:172.21.15.186:3300/0 conn(0x7fdea01574c0 0x7fdea00cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea5441640 1 -- 172.21.15.52:0/1757619142 >> v2:172.21.15.186:3300/0 conn(0x7fdea01574c0 msgr2=0x7fdea00cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea5441640 1 --2- 172.21.15.52:0/1757619142 >> v2:172.21.15.186:3300/0 conn(0x7fdea01574c0 0x7fdea00cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea5441640 1 -- 172.21.15.52:0/1757619142 >> v1:172.21.15.52:6789/0 conn(0x7fdea0159df0 legacy=0x7fdea006bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.714+0000 7fdea5441640 1 -- 172.21.15.52:0/1757619142 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00c9dd0 con 0x7fdea00ca590 2023-09-30T16:49:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.718+0000 7fdea5441640 1 --2- 172.21.15.52:0/1757619142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea00ca590 0x7fdea00caa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fde98009d90 tx=0x7fde9801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a751998b227f21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9f7fe640 1 -- 172.21.15.52:0/1757619142 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980a5900 con 0x7fdea00ca590 2023-09-30T16:49:27.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9f7fe640 1 -- 172.21.15.52:0/1757619142 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980a5a60 con 0x7fdea00ca590 2023-09-30T16:49:27.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9f7fe640 1 -- 172.21.15.52:0/1757619142 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980a5df0 con 0x7fdea00ca590 2023-09-30T16:49:27.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1757619142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea00ca590 msgr2=0x7fdea00caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1757619142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea00ca590 0x7fdea00caa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fde98009d90 tx=0x7fde9801c950 comp rx=0 tx=0).stop 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1757619142 shutdown_connections 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1757619142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea00ca590 0x7fdea00caa00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1757619142 >> v2:172.21.15.186:3300/0 conn(0x7fdea01574c0 0x7fdea00cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1757619142 >> 172.21.15.52:0/1757619142 conn(0x7fdea006a5f0 msgr2=0x7fdea00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1757619142 shutdown_connections 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1757619142 wait complete. 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 Processor -- start 2023-09-30T16:49:27.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- start start 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdea00ca590 0x7fdea0158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 0x7fdea014f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea0159df0 0x7fdea00c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea014f830 con 0x7fdea01574c0 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea014fb10 con 0x7fdea00ca590 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea6ea4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea014fdf0 con 0x7fdea0159df0 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 0x7fdea014f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 0x7fdea014f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35200/0 (socket says 172.21.15.52:35200) 2023-09-30T16:49:27.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 -- 172.21.15.52:0/1534545870 learned_addr learned my addr 172.21.15.52:0/1534545870 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea4c40640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdea00ca590 0x7fdea0158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fdea5441640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea0159df0 0x7fdea00c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 -- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea0159df0 msgr2=0x7fdea00c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea0159df0 0x7fdea00c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 -- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdea00ca590 msgr2=0x7fdea0158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdea00ca590 0x7fdea0158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.722+0000 7fde9ffff640 1 -- 172.21.15.52:0/1534545870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009a70 con 0x7fdea01574c0 2023-09-30T16:49:27.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9ffff640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 0x7fdea014f130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c400 tx=0x7fde8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c005cf0 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c005e50 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea01500d0 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0072d0 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea00c3910 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea014c140 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fde8c007430 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9d7fa640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fde84066160 0x7fde84068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde8c083080 con 0x7fdea01574c0 2023-09-30T16:49:27.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fdea4c40640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fde84066160 0x7fde84068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:27.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.726+0000 7fdea4c40640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fde84066160 0x7fde84068620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde94009af0 tx=0x7fde94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:27.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.730+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fde8c0b3ed0 con 0x7fdea01574c0 2023-09-30T16:49:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.918+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdea015ab40 con 0x7fdea01574c0 2023-09-30T16:49:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.918+0000 7fde9d7fa640 1 -- 172.21.15.52:0/1534545870 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fde8c050630 con 0x7fdea01574c0 2023-09-30T16:49:27.922 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:27.922 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:49:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fde84066160 msgr2=0x7fde84068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fde84066160 0x7fde84068620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde94009af0 tx=0x7fde94008040 comp rx=0 tx=0).stop 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 msgr2=0x7fdea014f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 0x7fdea014f130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c400 tx=0x7fde8c00c8c0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 shutdown_connections 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fde84066160 0x7fde84068620 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdea0159df0 0x7fdea00c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdea01574c0 0x7fdea014f130 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 --2- 172.21.15.52:0/1534545870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdea00ca590 0x7fdea0158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:27.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 >> 172.21.15.52:0/1534545870 conn(0x7fdea006a5f0 msgr2=0x7fdea00c4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:27.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 shutdown_connections 2023-09-30T16:49:27.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:27.922+0000 7fdea6ea4640 1 -- 172.21.15.52:0/1534545870 wait complete. 2023-09-30T16:49:28.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T16:49:09.938337+0000', 'modified': '2023-09-30T16:49:13.002923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6835/2416621285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 2416621285}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 2416621285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T16:49:28.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T16:49:28.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-30T16:49:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 Processor -- start 2023-09-30T16:49:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 -- start start 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9780b2310 0x7fa9780b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9780cb710 0x7fa9780cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780b2cb0 con 0x7fa9781600a0 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97806c440 con 0x7fa9780cb710 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97fcba640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780caf90 con 0x7fa9780b2310 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97e257640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9780cb710 0x7fa9780cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97d255640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9780b2310 0x7fa9780b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97e257640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9780cb710 0x7fa9780cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:39716/0 (socket says 172.21.15.52:39716) 2023-09-30T16:49:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97da56640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa9781600a0 0x7fa97806b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:47670/0 (socket says 172.21.15.52:47670) 2023-09-30T16:49:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97e257640 1 -- 172.21.15.52:0/1358243857 learned_addr learned my addr 172.21.15.52:0/1358243857 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97d255640 1 -- 172.21.15.52:0/1358243857 >> v2:172.21.15.186:3300/0 conn(0x7fa9780cb710 msgr2=0x7fa9780cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97d255640 1 --2- 172.21.15.52:0/1358243857 >> v2:172.21.15.186:3300/0 conn(0x7fa9780cb710 0x7fa9780cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97d255640 1 -- 172.21.15.52:0/1358243857 >> v1:172.21.15.186:6789/0 conn(0x7fa9781600a0 legacy=0x7fa97806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97ca54640 1 -- 172.21.15.52:0/1358243857 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710545376 0 0) 0x7fa9780b2cb0 con 0x7fa9781600a0 2023-09-30T16:49:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.482+0000 7fa97d255640 1 -- 172.21.15.52:0/1358243857 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780cb230 con 0x7fa9780b2310 2023-09-30T16:49:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97d255640 1 --2- 172.21.15.52:0/1358243857 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9780b2310 0x7fa9780b2770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9680097c0 tx=0x7fa96801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb058bf8463e20e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97ca54640 1 -- 172.21.15.52:0/1358243857 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680a8970 con 0x7fa9780b2310 2023-09-30T16:49:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97ca54640 1 -- 172.21.15.52:0/1358243857 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680a8ad0 con 0x7fa9780b2310 2023-09-30T16:49:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97ca54640 1 -- 172.21.15.52:0/1358243857 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680a8e60 con 0x7fa9780b2310 2023-09-30T16:49:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 -- 172.21.15.52:0/1358243857 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9780b2310 msgr2=0x7fa9780b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 --2- 172.21.15.52:0/1358243857 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9780b2310 0x7fa9780b2770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9680097c0 tx=0x7fa96801ec70 comp rx=0 tx=0).stop 2023-09-30T16:49:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 -- 172.21.15.52:0/1358243857 shutdown_connections 2023-09-30T16:49:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 --2- 172.21.15.52:0/1358243857 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9780b2310 0x7fa9780b2770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 --2- 172.21.15.52:0/1358243857 >> v2:172.21.15.186:3300/0 conn(0x7fa9780cb710 0x7fa9780cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 -- 172.21.15.52:0/1358243857 >> 172.21.15.52:0/1358243857 conn(0x7fa9780cd310 msgr2=0x7fa9780cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 -- 172.21.15.52:0/1358243857 shutdown_connections 2023-09-30T16:49:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.486+0000 7fa97fcba640 1 -- 172.21.15.52:0/1358243857 wait complete. 2023-09-30T16:49:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 Processor -- start 2023-09-30T16:49:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 -- start start 2023-09-30T16:49:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9780b2310 0x7fa9781f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 0x7fa9780c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9781600a0 0x7fa9780c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978154c20 con 0x7fa9780cb710 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978154f00 con 0x7fa9780b2310 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781551e0 con 0x7fa9781600a0 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 0x7fa9780c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 0x7fa9780c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35204/0 (socket says 172.21.15.52:35204) 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 -- 172.21.15.52:0/4125517245 learned_addr learned my addr 172.21.15.52:0/4125517245 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97da56640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9780b2310 0x7fa9781f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97e257640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9781600a0 0x7fa9780c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 -- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9781600a0 msgr2=0x7fa9780c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9781600a0 0x7fa9780c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 -- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9780b2310 msgr2=0x7fa9781f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9780b2310 0x7fa9781f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 -- 172.21.15.52:0/4125517245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968009420 con 0x7fa9780cb710 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97d255640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 0x7fa9780c7960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9680b3040 tx=0x7fa96801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa96e7fc640 1 -- 172.21.15.52:0/4125517245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680b9630 con 0x7fa9780cb710 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa96e7fc640 1 -- 172.21.15.52:0/4125517245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680b97b0 con 0x7fa9780cb710 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa96e7fc640 1 -- 172.21.15.52:0/4125517245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680b9b60 con 0x7fa9780cb710 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9781554c0 con 0x7fa9780cb710 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9781f2140 con 0x7fa9780cb710 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.490+0000 7fa96e7fc640 1 -- 172.21.15.52:0/4125517245 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa9680b7040 con 0x7fa9780cb710 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa96e7fc640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa95c066160 0x7fa95c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa96e7fc640 1 -- 172.21.15.52:0/4125517245 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa968121950 con 0x7fa9780cb710 2023-09-30T16:49:28.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97da56640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa95c066160 0x7fa95c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 Processor -- start 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- start start 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97da56640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa95c066160 0x7fa95c068620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa974000f70 tx=0x7fa974007df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cca19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc57810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481cc58130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481ca4ccc0 con 0x56481cca1f00 2023-09-30T16:49:28.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481caaf8e0 con 0x56481cca15e0 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56481caace10 con 0x56481cc57d50 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc57810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc57810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35206/0 (socket says 172.21.15.52:35206) 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 -- 172.21.15.52:0/581829687 learned_addr learned my addr 172.21.15.52:0/581829687 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97da56640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cca19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97e257640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481cc58130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 -- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 msgr2=0x56481cc58130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481cc58130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 -- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 msgr2=0x56481cca19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cca19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 -- 172.21.15.52:0/581829687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56481c7a1890 con 0x56481cca1f00 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97da56640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cca19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97e257640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481cc58130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa97d255640 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc57810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa96801b880 tx=0x7fa9680f2800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd43f35fbb6be1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa95b7fe640 1 -- 172.21.15.52:0/581829687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96810a070 con 0x56481cca1f00 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa95b7fe640 1 -- 172.21.15.52:0/581829687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680f2cc0 con 0x56481cca1f00 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa95b7fe640 1 -- 172.21.15.52:0/581829687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680f6e10 con 0x56481cca1f00 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- 172.21.15.52:0/581829687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 msgr2=0x56481cc57810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc57810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa96801b880 tx=0x7fa9680f2800 comp rx=0 tx=0).stop 2023-09-30T16:49:28.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- 172.21.15.52:0/581829687 shutdown_connections 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481cc58130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc57810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 --2- 172.21.15.52:0/581829687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cca19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- 172.21.15.52:0/581829687 >> 172.21.15.52:0/581829687 conn(0x56481cc5e4e0 msgr2=0x56481cc560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- 172.21.15.52:0/581829687 shutdown_connections 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- 172.21.15.52:0/581829687 wait complete. 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 -- start start 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.494+0000 7fa982e01000 1 Processor -- start 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481cc5d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cc5d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca1f00 0x56481cc629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481caa8700 con 0x56481cc57d50 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481ca67d10 con 0x56481cca15e0 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56481ca679b0 con 0x56481cca1f00 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 10 client.0 _ll_register_callbacks cb 0x56481cc436f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481cc5d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481cc5d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35212/0 (socket says 172.21.15.52:35212) 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 -- 172.21.15.52:0/757342355 learned_addr learned my addr 172.21.15.52:0/757342355 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97e257640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca1f00 0x56481cc629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97d255640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cc5d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 -- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca1f00 msgr2=0x56481cc629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca1f00 0x56481cc629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 -- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 msgr2=0x56481cc5d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cc5d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 -- 172.21.15.52:0/757342355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9781f2140 con 0x56481cc57d50 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97da56640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481cc5d320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa974013670 tx=0x7fa974001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181f0467d838d875 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 1 -- 172.21.15.52:0/757342355 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974007ab0 con 0x56481cc57d50 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 1 -- 172.21.15.52:0/757342355 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa97401b040 con 0x56481cc57d50 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56481ca5c370 con 0x56481cc57d50 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 1 -- 172.21.15.52:0/757342355 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa974012560 con 0x56481cc57d50 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 10 client.4650 fetch_fsmap learned FSMap version 8 2023-09-30T16:49:28.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56481ca6a460 con 0x56481cc57d50 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 1 -- 172.21.15.52:0/757342355 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56481ca5c370 con 0x56481cc57d50 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 1 -- 172.21.15.52:0/757342355 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa974012070 con 0x56481cc57d50 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 10 client.4650 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 20 client.4650 populate_metadata read hostname 'smithi052' 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481ccb0880 0x56481ccb2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 4 client.4650 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 --> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56481ca422d0 con 0x56481ccb0880 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97d255640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481ccb0880 0x56481ccb2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa958ff9640 10 client.4650 ms_handle_connect on v2:172.21.15.186:6834/2416621285 2023-09-30T16:49:28.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.498+0000 7fa97d255640 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481ccb0880 0x56481ccb2c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b97f135da5bd0a server_cookie=fd0609eabad5f49b in_seq=0 out_seq=0 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa958ff9640 1 -- 172.21.15.52:0/757342355 <== mds.0 v2:172.21.15.186:6834/2416621285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56481ca422d0 con 0x56481ccb0880 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa958ff9640 10 client.4650 handle_command_reply: tid=0 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 client.4650 shutdown 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 msgr2=0x56481cc5d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481cc5d320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa974013670 tx=0x7fa974001090 comp rx=0 tx=0).stop 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 shutdown_connections 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481ccb0880 0x56481ccb2c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca1f00 0x56481cc629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa958ff9640 0 client.4650 ms_handle_reset on v2:172.21.15.186:6834/2416621285 2023-09-30T16:49:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481cc5d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 --2- 172.21.15.52:0/757342355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481cc5d320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 >> 172.21.15.52:0/757342355 conn(0x56481cc5e4e0 msgr2=0x56481cc567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 shutdown_connections 2023-09-30T16:49:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 1 -- 172.21.15.52:0/757342355 wait complete. 2023-09-30T16:49:28.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.502+0000 7fa982e01000 20 client.4650 trim_cache size 0 max 16384 2023-09-30T16:49:28.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 Processor -- start 2023-09-30T16:49:28.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- start start 2023-09-30T16:49:28.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481ccb4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481ccb48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc9b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481c762940 con 0x56481cca1f00 2023-09-30T16:49:28.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481ca71720 con 0x56481cca15e0 2023-09-30T16:49:28.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56481ca7ebb0 con 0x56481cc57d50 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc9b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc9b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35216/0 (socket says 172.21.15.52:35216) 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 -- 172.21.15.52:0/3496293005 learned_addr learned my addr 172.21.15.52:0/3496293005 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 -- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 msgr2=0x56481ccb4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97da56640 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481ccb4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481ccb4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97d255640 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481ccb48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 -- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 msgr2=0x56481ccb48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481ccb48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 -- 172.21.15.52:0/3496293005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56481ca50760 con 0x56481cca1f00 2023-09-30T16:49:28.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa97e257640 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc9b8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa970009400 tx=0x7fa97000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c7d87b918e17e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa95bfff640 1 -- 172.21.15.52:0/3496293005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e030 con 0x56481cca1f00 2023-09-30T16:49:28.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa95bfff640 1 -- 172.21.15.52:0/3496293005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970014560 con 0x56481cca1f00 2023-09-30T16:49:28.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa95bfff640 1 -- 172.21.15.52:0/3496293005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970007ea0 con 0x56481cca1f00 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- 172.21.15.52:0/3496293005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 msgr2=0x56481cc9b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc9b8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa970009400 tx=0x7fa97000b040 comp rx=0 tx=0).stop 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- 172.21.15.52:0/3496293005 shutdown_connections 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cca1f00 0x56481cc9b8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca15e0 0x56481ccb48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 --2- 172.21.15.52:0/3496293005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cc57d50 0x56481ccb4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- 172.21.15.52:0/3496293005 >> 172.21.15.52:0/3496293005 conn(0x56481cc5e4e0 msgr2=0x56481ccb2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- 172.21.15.52:0/3496293005 shutdown_connections 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- 172.21.15.52:0/3496293005 wait complete. 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 -- start start 2023-09-30T16:49:28.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.518+0000 7fa982e01000 1 Processor -- start 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481ccff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca15e0 0x56481ccffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca1f00 0x56481cc9f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481caad870 con 0x56481cc57d50 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481ca566c0 con 0x56481cca1f00 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56481caa2a00 con 0x56481cca15e0 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 10 client.0 _ll_register_callbacks cb 0x7fa968006c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481ccff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481ccff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35218/0 (socket says 172.21.15.52:35218) 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 -- 172.21.15.52:0/2848148724 learned_addr learned my addr 172.21.15.52:0/2848148724 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97d255640 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca15e0 0x56481ccffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 -- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca15e0 msgr2=0x56481ccffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca15e0 0x56481ccffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 -- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca1f00 msgr2=0x56481cc9f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca1f00 0x56481cc9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 -- 172.21.15.52:0/2848148724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9700090b0 con 0x56481cc57d50 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97da56640 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481ccff520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa974001020 tx=0x7fa974014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba63b40f65f8c75c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 1 -- 172.21.15.52:0/2848148724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974012560 con 0x56481cc57d50 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 1 -- 172.21.15.52:0/2848148724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa974007a10 con 0x56481cc57d50 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56481ca406f0 con 0x56481cc57d50 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 1 -- 172.21.15.52:0/2848148724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa974001c10 con 0x56481cc57d50 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 10 client.4656 fetch_fsmap learned FSMap version 8 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56481c7a1cc0 con 0x56481cc57d50 2023-09-30T16:49:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 1 -- 172.21.15.52:0/2848148724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56481ca406f0 con 0x56481cc57d50 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 1 -- 172.21.15.52:0/2848148724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa974012040 con 0x56481cc57d50 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 20 client.4656 populate_metadata read hostname 'smithi052' 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481cc9fa40 0x56481cc9fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 4 client.4656 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 --> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56481caa16e0 con 0x56481cc9fa40 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97d255640 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481cc9fa40 0x56481cc9fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 10 client.4656 ms_handle_connect on v2:172.21.15.186:6834/2416621285 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97d255640 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481cc9fa40 0x56481cc9fe20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a3171c23f94afe server_cookie=12e71ea0bb7b9295 in_seq=0 out_seq=0 2023-09-30T16:49:28.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 1 -- 172.21.15.52:0/2848148724 <== mds.0 v2:172.21.15.186:6834/2416621285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56481caa16e0 con 0x56481cc9fa40 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 10 client.4656 handle_command_reply: tid=0 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 client.4656 shutdown 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 msgr2=0x56481ccff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481ccff520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa974001020 tx=0x7fa974014000 comp rx=0 tx=0).stop 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 shutdown_connections 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:6834/2416621285,v1:172.21.15.186:6835/2416621285] conn(0x56481cc9fa40 0x56481cc9fe20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56481cca1f00 0x56481cc9f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa958ff9640 0 client.4656 ms_handle_reset on v2:172.21.15.186:6834/2416621285 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56481cca15e0 0x56481ccffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 --2- 172.21.15.52:0/2848148724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56481cc57d50 0x56481ccff520 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 >> 172.21.15.52:0/2848148724 conn(0x56481cc5e4e0 msgr2=0x56481ccb3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 shutdown_connections 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 1 -- 172.21.15.52:0/2848148724 wait complete. 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa982e01000 20 client.4656 trim_cache size 0 max 16384 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "a2b00988-da85-4e26-9767-73ee6224a074", 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4279, 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-09-30T16:49:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 17.932791000000002, 2023-09-30T16:49:28.533 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 8, 2023-09-30T16:49:28.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 21, 2023-09-30T16:49:28.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 21, 2023-09-30T16:49:28.533 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 23.288895641 2023-09-30T16:49:28.533 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa95c066160 msgr2=0x7fa95c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa95c066160 0x7fa95c068620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa974000f70 tx=0x7fa974007df0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 msgr2=0x7fa9780c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 0x7fa9780c7960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9680b3040 tx=0x7fa96801ba10 comp rx=0 tx=0).stop 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 shutdown_connections 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa95c066160 0x7fa95c068620 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9781600a0 0x7fa9780c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9780cb710 0x7fa9780c7960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 --2- 172.21.15.52:0/4125517245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9780b2310 0x7fa9781f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 >> 172.21.15.52:0/4125517245 conn(0x7fa9780cd310 msgr2=0x7fa97815cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 shutdown_connections 2023-09-30T16:49:28.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.522+0000 7fa97fcba640 1 -- 172.21.15.52:0/4125517245 wait complete. 2023-09-30T16:49:28.542 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-30T16:49:28.569 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-30T16:49:28.570 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-30T16:49:28.570 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-30T16:49:28.570 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T16:49:28.570 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:28.570 INFO:tasks.ceph_fuse:client.2 config is {} 2023-09-30T16:49:28.570 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T16:49:28.570 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:28.571 INFO:tasks.ceph_fuse:client.1 config is {} 2023-09-30T16:49:28.571 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T16:49:28.571 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:28.571 INFO:tasks.ceph_fuse:client.3 config is {} 2023-09-30T16:49:28.571 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T16:49:28.571 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:28.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:28.571 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2023-09-30T16:49:28.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:28.579 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2023-09-30T16:49:28.639 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2023-09-30T16:49:28.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:49:28.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:28.640 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-09-30T16:49:28.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:28.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-09-30T16:49:28.705 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2023-09-30T16:49:28.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:49:28.707 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-30T16:49:28.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T16:49:28.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.878+0000 7ffa24a52640 1 Processor -- start 2023-09-30T16:49:28.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.878+0000 7ffa24a52640 1 -- start start 2023-09-30T16:49:28.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa24a52640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200d1fb0 0x7ffa200b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa24a52640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa200cdf80 0x7ffa200b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa24a52640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa200b7570 con 0x7ffa2015ce10 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa24a52640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200b7850 con 0x7ffa200cdf80 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa24a52640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200b7b30 con 0x7ffa200d1fb0 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa200cdf80 0x7ffa200b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa200cdf80 0x7ffa200b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35228/0 (socket says 172.21.15.52:35228) 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/123849720 learned_addr learned my addr 172.21.15.52:0/123849720 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1dd9b640 1 --2- 172.21.15.52:0/123849720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200d1fb0 0x7ffa200b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/123849720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200d1fb0 msgr2=0x7ffa200b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 --2- 172.21.15.52:0/123849720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200d1fb0 0x7ffa200b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/123849720 >> v1:172.21.15.186:6789/0 conn(0x7ffa2015ce10 legacy=0x7ffa200cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/123849720 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200b7e10 con 0x7ffa200cdf80 2023-09-30T16:49:28.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1ed9d640 1 --2- 172.21.15.52:0/123849720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa200cdf80 0x7ffa200b5c10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffa180098a0 tx=0x7ffa1801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aadd4928a07bd0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1d59a640 1 -- 172.21.15.52:0/123849720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180aa610 con 0x7ffa200cdf80 2023-09-30T16:49:28.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1d59a640 1 -- 172.21.15.52:0/123849720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180a6040 con 0x7ffa200cdf80 2023-09-30T16:49:28.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.882+0000 7ffa1d59a640 1 -- 172.21.15.52:0/123849720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180aa990 con 0x7ffa200cdf80 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/123849720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa200cdf80 msgr2=0x7ffa200b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 --2- 172.21.15.52:0/123849720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa200cdf80 0x7ffa200b5c10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffa180098a0 tx=0x7ffa1801c490 comp rx=0 tx=0).stop 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/123849720 shutdown_connections 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 --2- 172.21.15.52:0/123849720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa200cdf80 0x7ffa200b5c10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 --2- 172.21.15.52:0/123849720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200d1fb0 0x7ffa200b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/123849720 >> 172.21.15.52:0/123849720 conn(0x7ffa20071930 msgr2=0x7ffa20071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/123849720 shutdown_connections 2023-09-30T16:49:28.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/123849720 wait complete. 2023-09-30T16:49:28.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 Processor -- start 2023-09-30T16:49:28.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- start start 2023-09-30T16:49:28.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200cdf80 0x7ffa20148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa200d1fb0 0x7ffa201520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 0x7ffa200d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200c68e0 con 0x7ffa20152610 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200c4b60 con 0x7ffa200d1fb0 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200c4e40 con 0x7ffa200cdf80 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 0x7ffa200d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 0x7ffa200d2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35244/0 (socket says 172.21.15.52:35244) 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/3253082322 learned_addr learned my addr 172.21.15.52:0/3253082322 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1e59c640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200cdf80 0x7ffa20148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1dd9b640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa200d1fb0 0x7ffa201520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200cdf80 msgr2=0x7ffa20148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200cdf80 0x7ffa20148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa200d1fb0 msgr2=0x7ffa201520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa200d1fb0 0x7ffa201520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 -- 172.21.15.52:0/3253082322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180094d0 con 0x7ffa20152610 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1e59c640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200cdf80 0x7ffa20148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1dd9b640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa200d1fb0 0x7ffa201520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa1ed9d640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 0x7ffa200d2ed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa1801a0c0 tx=0x7ffa1801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180b3800 con 0x7ffa20152610 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180b3960 con 0x7ffa20152610 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa200c5120 con 0x7ffa20152610 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180b3cf0 con 0x7ffa20152610 2023-09-30T16:49:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.886+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa201492a0 con 0x7ffa20152610 2023-09-30T16:49:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.890+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa200c55d0 con 0x7ffa20152610 2023-09-30T16:49:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.890+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ffa180b1410 con 0x7ffa20152610 2023-09-30T16:49:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.890+0000 7ffa16ffd640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffa00066160 0x7ffa00068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.890+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa1811e790 con 0x7ffa20152610 2023-09-30T16:49:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.890+0000 7ffa1e59c640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffa00066160 0x7ffa00068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:28.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.890+0000 7ffa1e59c640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffa00066160 0x7ffa00068620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa200d1ad0 tx=0x7ffa08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:28.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:28.894+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ffa180ebdb0 con 0x7ffa20152610 2023-09-30T16:49:29.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.082+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa200740a0 con 0x7ffa20152610 2023-09-30T16:49:29.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa16ffd640 1 -- 172.21.15.52:0/3253082322 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffa180ef3d0 con 0x7ffa20152610 2023-09-30T16:49:29.086 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T16:49:29.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffa00066160 msgr2=0x7ffa00068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:29.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffa00066160 0x7ffa00068620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa200d1ad0 tx=0x7ffa08009040 comp rx=0 tx=0).stop 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 msgr2=0x7ffa200d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 0x7ffa200d2ed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa1801a0c0 tx=0x7ffa1801acd0 comp rx=0 tx=0).stop 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 shutdown_connections 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffa00066160 0x7ffa00068620 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa20152610 0x7ffa200d2ed0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa200d1fb0 0x7ffa201520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 --2- 172.21.15.52:0/3253082322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa200cdf80 0x7ffa20148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 >> 172.21.15.52:0/3253082322 conn(0x7ffa20071930 msgr2=0x7ffa200d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 shutdown_connections 2023-09-30T16:49:29.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:29.086+0000 7ffa24a52640 1 -- 172.21.15.52:0/3253082322 wait complete. 2023-09-30T16:49:29.105 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T16:49:29.106 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T16:49:29.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.107 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-09-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:29.113 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2023-09-30T16:49:29.114 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42434sec preferred_lft 42434sec 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:29.115 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2023-09-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi052.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 02:42:57:b4:1e:67 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-30T16:49:29.116 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:29.116 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T16:49:29.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T16:49:29.117 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:29.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.191 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T16:49:29.243 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-09-30T16:49:29.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.245 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-09-30T16:49:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-09-30T16:49:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T16:49:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-09-30T16:49:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-30T16:49:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-09-30T16:49:29.319 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T16:49:29.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.320 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:29.320 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:29.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-30T16:49:29.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-30T16:49:29.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-30T16:49:29.320 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:29.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.401 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-09-30T16:49:29.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.447 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2023-09-30T16:49:29.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.495 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:29.495 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:29.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:29.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T16:49:29.495 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:29.564 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T16:49:29.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T16:49:29.565 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:29.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.668 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:29.668 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:29.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-09-30T16:49:29.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T16:49:29.668 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:29.687 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T16:49:29.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:29.687 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:29.734 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T16:49:29.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:29.734 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:29.782 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:49:29.839 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:49:29.888 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:49:29.889 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:29.890 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:29.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:29.891 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:49:29.939 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T16:49:29.939 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T16:49:29.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:49:29.998 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:49:30.048 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:49:30.049 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:49:30.050 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:30.051 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:30.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:30.052 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:49:30.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2023-09-30T16:49:30.078+0000 7f47e7e97580 -1 init, newargv = 0x562e39813dc0 newargc=15 2023-09-30T16:49:30.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[44130]: starting ceph client 2023-09-30T16:49:30.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[44130]: starting fuse 2023-09-30T16:49:31.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:49:31.205 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:31.254 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:49:31.254 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:49:31.254 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:49:31.254 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:49:31.254 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:49:31.254 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:49:31.255 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:49:31.256 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:31.257 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:31.257 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:31.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:31.258 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:49:31.307 INFO:teuthology.orchestra.run.smithi052.stdout:45 2023-09-30T16:49:31.308 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> import re 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> import os 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T16:49:31.308 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2023-09-30T16:49:31.309 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> return f 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:31.310 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2023-09-30T16:49:31.311 DEBUG:teuthology.orchestra.run.smithi052:> ' 2023-09-30T16:49:31.434 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.44130.asok 2023-09-30T16:49:31.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T16:49:31.446 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44130.asok 2023-09-30T16:49:31.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:31.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44130.asok status 2023-09-30T16:49:31.606 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-09-30T16:49:31.606 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "44130", 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2023-09-30T16:49:31.607 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4665, 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 4665 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3196044507 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:49:31.608 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3196044507 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.4665 192.168.0.1:0/3196044507", 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/3196044507", 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 8, 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 21, 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2023-09-30T16:49:31.609 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2023-09-30T16:49:31.610 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2023-09-30T16:49:31.610 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-09-30T16:49:31.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T16:49:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.746+0000 7f8fae7ed640 1 Processor -- start 2023-09-30T16:49:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.746+0000 7f8fae7ed640 1 -- start start 2023-09-30T16:49:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fae7ed640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fa815ce10 0x7f8fa80b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fae7ed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80d1fb0 0x7f8fa80b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fae7ed640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80b7570 con 0x7f8fa80cd870 2023-09-30T16:49:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fae7ed640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa80b7850 con 0x7f8fa815ce10 2023-09-30T16:49:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fae7ed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80b7b30 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fa815ce10 0x7f8fa80b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8facd8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80d1fb0 0x7f8fa80b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fa815ce10 0x7f8fa80b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35246/0 (socket says 172.21.15.52:35246) 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8facd8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80d1fb0 0x7f8fa80b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:35408/0 (socket says 172.21.15.52:35408) 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 -- 172.21.15.52:0/793814271 learned_addr learned my addr 172.21.15.52:0/793814271 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 -- 172.21.15.52:0/793814271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80d1fb0 msgr2=0x7f8fa80b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 --2- 172.21.15.52:0/793814271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80d1fb0 0x7f8fa80b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 -- 172.21.15.52:0/793814271 >> v1:172.21.15.186:6789/0 conn(0x7f8fa80cd870 legacy=0x7f8fa80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 -- 172.21.15.52:0/793814271 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80b7e10 con 0x7f8fa815ce10 2023-09-30T16:49:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa7fff640 1 --2- 172.21.15.52:0/793814271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa815ce10 0x7f8fa80b8800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009870 tx=0x7f8f9801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3580db146783ce7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa77fe640 1 -- 172.21.15.52:0/793814271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980ab640 con 0x7f8fa815ce10 2023-09-30T16:49:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa77fe640 1 -- 172.21.15.52:0/793814271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980a7070 con 0x7f8fa815ce10 2023-09-30T16:49:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.750+0000 7f8fa77fe640 1 -- 172.21.15.52:0/793814271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980ab9c0 con 0x7f8fa815ce10 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/793814271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa815ce10 msgr2=0x7f8fa80b8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/793814271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa815ce10 0x7f8fa80b8800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009870 tx=0x7f8f9801c420 comp rx=0 tx=0).stop 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/793814271 shutdown_connections 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/793814271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80d1fb0 0x7f8fa80b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/793814271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa815ce10 0x7f8fa80b8800 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/793814271 >> 172.21.15.52:0/793814271 conn(0x7f8fa8071930 msgr2=0x7f8fa8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/793814271 shutdown_connections 2023-09-30T16:49:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/793814271 wait complete. 2023-09-30T16:49:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 Processor -- start 2023-09-30T16:49:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- start start 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80cd870 0x7f8fa8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 0x7f8fa81480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c7b30 0x7f8fa80c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c8e60 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80d2470 con 0x7f8fa80cd870 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c66d0 con 0x7f8fa80c7b30 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 0x7f8fa81480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 0x7f8fa81480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35262/0 (socket says 172.21.15.52:35262) 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 -- 172.21.15.52:0/3201382244 learned_addr learned my addr 172.21.15.52:0/3201382244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8facd8a640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c7b30 0x7f8fa80c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fa7fff640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80cd870 0x7f8fa8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 -- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c7b30 msgr2=0x7f8fa80c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c7b30 0x7f8fa80c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 -- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80cd870 msgr2=0x7f8fa8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80cd870 0x7f8fa8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 -- 172.21.15.52:0/3201382244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f980094d0 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fa7fff640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80cd870 0x7f8fa8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8f9f7fe640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 0x7f8fa81480a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c500 tx=0x7f8f9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90005220 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f90005380 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa80c4c90 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90007270 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.754+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80c9350 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.758+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80d2600 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.758+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8f900073d0 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.758+0000 7f8fa57fa640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f88066160 0x7f8f88068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.758+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f90083340 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.758+0000 7f8fa7fff640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f88066160 0x7f8f88068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.758+0000 7f8fa7fff640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f88066160 0x7f8f88068620 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f980af000 tx=0x7f8f98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.762+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f8f90050970 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fa80740a0 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fa57fa640 1 -- 172.21.15.52:0/3201382244 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f90053f90 con 0x7f8fa80d1fb0 2023-09-30T16:49:31.959 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f88066160 msgr2=0x7f8f88068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f88066160 0x7f8f88068620 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f980af000 tx=0x7f8f98008040 comp rx=0 tx=0).stop 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 msgr2=0x7f8fa81480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 0x7f8fa81480a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c500 tx=0x7f8f9000c9c0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 shutdown_connections 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f88066160 0x7f8f88068620 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c7b30 0x7f8fa80c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa80d1fb0 0x7f8fa81480a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 --2- 172.21.15.52:0/3201382244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80cd870 0x7f8fa8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 >> 172.21.15.52:0/3201382244 conn(0x7f8fa8071930 msgr2=0x7f8fa80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 shutdown_connections 2023-09-30T16:49:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:31.958+0000 7f8fae7ed640 1 -- 172.21.15.52:0/3201382244 wait complete. 2023-09-30T16:49:31.978 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T16:49:31.978 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T16:49:31.979 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-30T16:49:31.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:31.979 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2023-09-30T16:49:31.985 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42431sec preferred_lft 42431sec 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 02:42:57:b4:1e:67 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T16:49:31.987 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:31.988 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-30T16:49:31.988 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:31.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:31.988 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T16:49:32.037 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-09-30T16:49:32.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.038 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-09-30T16:49:32.092 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-09-30T16:49:32.092 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T16:49:32.092 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-09-30T16:49:32.092 INFO:teuthology.orchestra.run.smithi052.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-30T16:49:32.093 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-09-30T16:49:32.093 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T16:49:32.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.093 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:32.093 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:32.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-30T16:49:32.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-30T16:49:32.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-30T16:49:32.093 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:32.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.170 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-09-30T16:49:32.219 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T16:49:32.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.220 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2023-09-30T16:49:32.267 INFO:teuthology.orchestra.run.smithi052.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-30T16:49:32.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.268 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:32.268 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:32.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:32.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-30T16:49:32.268 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:32.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether c6:7c:7c:86:7d:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T16:49:32.392 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T16:49:32.393 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.393 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c47c:7cff:fe86:7d32/64 scope link 2023-09-30T16:49:32.393 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.446 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:49:32.447 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether c6:7c:7c:86:7d:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T16:49:32.447 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T16:49:32.447 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.447 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c47c:7cff:fe86:7d32/64 scope link 2023-09-30T16:49:32.447 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:32.449 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-30T16:49:32.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-30T16:49:32.450 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:32.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.542 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:49:32.542 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:49:32.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.1 up 2023-09-30T16:49:32.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.1 master ceph-brx 2023-09-30T16:49:32.542 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:49:32.561 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-09-30T16:49:32.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:32.561 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:32.606 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-30T16:49:32.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:32.606 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:32.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:49:32.705 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:32.751 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:49:32.752 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:49:32.752 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:49:32.752 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:49:32.752 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:49:32.752 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:49:32.752 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:32.753 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:49:32.754 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:49:32.754 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:49:32.754 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:49:32.754 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:49:32.754 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:49:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:49:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:49:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:49:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:49:32.756 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:49:32.756 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:49:32.756 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:49:32.756 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:49:32.756 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:32.757 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:32.757 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:32.757 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:32.757 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:32.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.758 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:49:32.807 INFO:teuthology.orchestra.run.smithi052.stdout:45 2023-09-30T16:49:32.807 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-09-30T16:49:32.807 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-09-30T16:49:32.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:49:32.866 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:32.919 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:49:32.919 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:49:32.919 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:49:32.919 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:49:32.919 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:49:32.919 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:49:32.920 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:49:32.921 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:32.922 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:32.922 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:32.922 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:32.922 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:32.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:32.923 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:49:32.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi052.stderr:2023-09-30T16:49:32.934+0000 7f02e6cf7580 -1 init, newargv = 0x55ffaedb8a20 newargc=15 2023-09-30T16:49:32.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi052.stderr:ceph-fuse[44268]: starting ceph client 2023-09-30T16:49:32.940 INFO:teuthology.orchestra.run.smithi052.stdout:45 2023-09-30T16:49:32.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi052.stderr:ceph-fuse[44268]: starting fuse 2023-09-30T16:49:34.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:49:34.059 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:34.109 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:49:34.110 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:49:34.111 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:49:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:34.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:34.113 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:49:34.159 INFO:teuthology.orchestra.run.smithi052.stdout:45 2023-09-30T16:49:34.159 INFO:teuthology.orchestra.run.smithi052.stdout:46 2023-09-30T16:49:34.159 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> import re 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> import os 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2023-09-30T16:49:34.160 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> return f 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:49:34.161 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.2")) 2023-09-30T16:49:34.162 DEBUG:teuthology.orchestra.run.smithi052:> ' 2023-09-30T16:49:34.286 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.2.44268.asok 2023-09-30T16:49:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T16:49:34.298 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44268.asok 2023-09-30T16:49:34.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:34.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44268.asok status 2023-09-30T16:49:34.459 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-09-30T16:49:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2023-09-30T16:49:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T16:49:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "2", 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "44268", 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4677, 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2023-09-30T16:49:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 4677 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.2:0", 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3187257884 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.2:0", 2023-09-30T16:49:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3187257884 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.4677 192.168.0.2:0/3187257884", 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.2:0/3187257884", 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 8, 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 21, 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2023-09-30T16:49:34.462 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-09-30T16:49:34.473 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T16:49:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 Processor -- start 2023-09-30T16:49:34.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 -- start start 2023-09-30T16:49:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 0x7feeb00b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feeb00d1fb0 0x7feeb00b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00b7570 con 0x7feeb00cd870 2023-09-30T16:49:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00b7850 con 0x7feeb00d1fb0 2023-09-30T16:49:34.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.598+0000 7feeb5c09640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00b7b30 con 0x7feeb015ce10 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 0x7feeb00b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feeb00d1fb0 0x7feeb00b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 0x7feeb00b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:35430/0 (socket says 172.21.15.52:35430) 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 -- 172.21.15.52:0/1807691303 learned_addr learned my addr 172.21.15.52:0/1807691303 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 -- 172.21.15.52:0/1807691303 >> v2:172.21.15.186:3300/0 conn(0x7feeb00d1fb0 msgr2=0x7feeb00b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 --2- 172.21.15.52:0/1807691303 >> v2:172.21.15.186:3300/0 conn(0x7feeb00d1fb0 0x7feeb00b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 -- 172.21.15.52:0/1807691303 >> v1:172.21.15.186:6789/0 conn(0x7feeb00cd870 legacy=0x7feeb00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:34.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 -- 172.21.15.52:0/1807691303 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00b7e10 con 0x7feeb015ce10 2023-09-30T16:49:34.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeaf7fe640 1 --2- 172.21.15.52:0/1807691303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 0x7feeb00b8800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feea00098a0 tx=0x7feea001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb8c0b33e039a699 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeae7fc640 1 -- 172.21.15.52:0/1807691303 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00ab620 con 0x7feeb015ce10 2023-09-30T16:49:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeae7fc640 1 -- 172.21.15.52:0/1807691303 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00ab780 con 0x7feeb015ce10 2023-09-30T16:49:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.602+0000 7feeae7fc640 1 -- 172.21.15.52:0/1807691303 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00abb10 con 0x7feeb015ce10 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/1807691303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 msgr2=0x7feeb00b8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 --2- 172.21.15.52:0/1807691303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 0x7feeb00b8800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feea00098a0 tx=0x7feea001c400 comp rx=0 tx=0).stop 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/1807691303 shutdown_connections 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 --2- 172.21.15.52:0/1807691303 >> v2:172.21.15.186:3300/0 conn(0x7feeb00d1fb0 0x7feeb00b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 --2- 172.21.15.52:0/1807691303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb015ce10 0x7feeb00b8800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/1807691303 >> 172.21.15.52:0/1807691303 conn(0x7feeb0071930 msgr2=0x7feeb0071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/1807691303 shutdown_connections 2023-09-30T16:49:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/1807691303 wait complete. 2023-09-30T16:49:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 Processor -- start 2023-09-30T16:49:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- start start 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 0x7feeb0146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb00d1fb0 0x7feeb0151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeb015afc0 0x7feeb0151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01499c0 con 0x7feeb00cd870 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0073430 con 0x7feeb015afc0 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c53b0 con 0x7feeb00d1fb0 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 0x7feeb0146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 0x7feeb0146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35270/0 (socket says 172.21.15.52:35270) 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 -- 172.21.15.52:0/4077733235 learned_addr learned my addr 172.21.15.52:0/4077733235 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaeffd640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb00d1fb0 0x7feeb0151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaffff640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeb015afc0 0x7feeb0151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 -- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb00d1fb0 msgr2=0x7feeb0151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb00d1fb0 0x7feeb0151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 -- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeb015afc0 msgr2=0x7feeb0151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeb015afc0 0x7feeb0151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 -- 172.21.15.52:0/4077733235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00094d0 con 0x7feeb00cd870 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeaf7fe640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 0x7feeb0146fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feea001a030 tx=0x7feea00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00b5810 con 0x7feeb00cd870 2023-09-30T16:49:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00b9070 con 0x7feeb00cd870 2023-09-30T16:49:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00b5bb0 con 0x7feeb00cd870 2023-09-30T16:49:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00c4dd0 con 0x7feeb00cd870 2023-09-30T16:49:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.606+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb0149bd0 con 0x7feeb00cd870 2023-09-30T16:49:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.610+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb00c4c30 con 0x7feeb00cd870 2023-09-30T16:49:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.610+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7feea00b5d10 con 0x7feeb00cd870 2023-09-30T16:49:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.610+0000 7fee97fff640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fee9c066190 0x7fee9c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.610+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feea00bb070 con 0x7feeb00cd870 2023-09-30T16:49:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.610+0000 7feeaeffd640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fee9c066190 0x7fee9c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.610+0000 7feeaeffd640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fee9c066190 0x7fee9c068650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feeb0149e30 tx=0x7feea4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.614+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7feeb00c4c30 con 0x7feeb00cd870 2023-09-30T16:49:34.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.806+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feeb00c4c30 con 0x7feeb00cd870 2023-09-30T16:49:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.806+0000 7fee97fff640 1 -- 172.21.15.52:0/4077733235 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7feeb00c4c30 con 0x7feeb00cd870 2023-09-30T16:49:34.809 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T16:49:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fee9c066190 msgr2=0x7fee9c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:34.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fee9c066190 0x7fee9c068650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feeb0149e30 tx=0x7feea4009040 comp rx=0 tx=0).stop 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 msgr2=0x7feeb0146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 0x7feeb0146fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feea001a030 tx=0x7feea00191a0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 shutdown_connections 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fee9c066190 0x7fee9c068650 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeb015afc0 0x7feeb0151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeb00d1fb0 0x7feeb0151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 --2- 172.21.15.52:0/4077733235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feeb00cd870 0x7feeb0146fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 >> 172.21.15.52:0/4077733235 conn(0x7feeb0071930 msgr2=0x7feeb00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 shutdown_connections 2023-09-30T16:49:34.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:34.810+0000 7feeb5c09640 1 -- 172.21.15.52:0/4077733235 wait complete. 2023-09-30T16:49:34.827 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T16:49:34.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T16:49:34.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2023-09-30T16:49:34.828 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T16:49:34.828 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:34.828 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T16:49:34.828 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T16:49:34.828 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T16:49:34.828 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T16:49:34.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:34.828 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2023-09-30T16:49:34.835 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:34.835 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:34.835 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:34.835 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:34.835 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-30T16:49:34.836 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42444sec preferred_lft 42444sec 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::ec4:7aff:fe88:6df5/64 scope link 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run.smithi186.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 02:42:ff:11:7a:73 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:34.837 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T16:49:34.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:34.837 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:34.838 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:34.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add name ceph-brx type bridge 2023-09-30T16:49:34.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr flush dev ceph-brx 2023-09-30T16:49:34.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set ceph-brx up 2023-09-30T16:49:34.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T16:49:34.838 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:34.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:34.921 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T16:49:34.971 INFO:teuthology.orchestra.run.smithi186.stdout:1 2023-09-30T16:49:34.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:34.972 DEBUG:teuthology.orchestra.run.smithi186:> route 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-30T16:49:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-30T16:49:35.045 INFO:teuthology.orchestra.run.smithi186.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-30T16:49:35.045 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T16:49:35.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.045 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:35.045 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:35.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T16:49:35.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T16:49:35.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T16:49:35.046 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:35.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.120 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2023-09-30T16:49:35.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.167 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2023-09-30T16:49:35.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.214 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:35.215 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:35.215 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:35.215 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-30T16:49:35.215 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:35.283 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-30T16:49:35.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.283 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:35.283 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:35.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-30T16:49:35.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T16:49:35.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-30T16:49:35.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-30T16:49:35.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-30T16:49:35.284 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:35.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.404 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:35.404 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:35.404 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.0 up 2023-09-30T16:49:35.404 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T16:49:35.404 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:35.423 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-09-30T16:49:35.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:35.423 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:35.470 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T16:49:35.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:35.470 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:35.517 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2023-09-30T16:49:35.570 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:35.619 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2023-09-30T16:49:35.619 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/run/lock 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2023-09-30T16:49:35.620 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/fs/nfsd 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/run/rpc_pipefs 2023-09-30T16:49:35.621 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:35.622 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:35.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.623 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2023-09-30T16:49:35.670 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T16:49:35.670 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-09-30T16:49:35.715 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2023-09-30T16:49:35.729 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:35.778 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/run/lock 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2023-09-30T16:49:35.779 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/fs/nfsd 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/run/rpc_pipefs 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2023-09-30T16:49:35.780 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:35.781 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:35.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:35.782 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2023-09-30T16:49:35.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:2023-09-30T16:49:35.795+0000 7f0fadd0c580 -1 init, newargv = 0x56332e8a3c00 newargc=15 2023-09-30T16:49:35.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:ceph-fuse[43696]: starting ceph client 2023-09-30T16:49:35.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:ceph-fuse[43696]: starting fuse 2023-09-30T16:49:36.904 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2023-09-30T16:49:36.920 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:36.967 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2023-09-30T16:49:36.967 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/run/lock 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:36.968 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/fs/nfsd 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/run/rpc_pipefs 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T16:49:36.969 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T16:49:36.970 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T16:49:36.970 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T16:49:36.970 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2023-09-30T16:49:36.970 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:36.970 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:36.970 INFO:teuthology.orchestra.run.smithi186.stdout:/home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:36.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:36.971 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2023-09-30T16:49:37.018 INFO:teuthology.orchestra.run.smithi186.stdout:45 2023-09-30T16:49:37.018 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> sudo stdin-killer -- python3 -c ' 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> import glob 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> import re 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> import os 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> import subprocess 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> def _find_admin_socket(client_name): 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> files = glob.glob(asok_path) 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:37.019 DEBUG:teuthology.orchestra.run.smithi186:> # Given a non-glob path, it better be there 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> if "*" not in asok_path: 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> assert(len(files) == 1) 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> return files[0] 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> for f in files: 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> contents = proc_f.read() 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> if mountpoint in contents: 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> return f 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:37.020 DEBUG:teuthology.orchestra.run.smithi186:> print(_find_admin_socket("client.1")) 2023-09-30T16:49:37.021 DEBUG:teuthology.orchestra.run.smithi186:> ' 2023-09-30T16:49:37.141 INFO:teuthology.orchestra.run.smithi186.stdout:/var/run/ceph/ceph-client.1.43696.asok 2023-09-30T16:49:37.145 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:49:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T16:49:37.153 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43696.asok 2023-09-30T16:49:37.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.153 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43696.asok status 2023-09-30T16:49:37.306 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2023-09-30T16:49:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "metadata": { 2023-09-30T16:49:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "entity_id": "1", 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "hostname": "smithi186", 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "pid": "43696", 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "root": "/" 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "dentry_count": 0, 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "dentry_pinned_count": 0, 2023-09-30T16:49:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "id": 4615, 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "inst": { 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "name": { 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "client", 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "num": 4615 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "192.168.0.1:0", 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 2606648064 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2023-09-30T16:49:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "192.168.0.1:0", 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 2606648064 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "inst_str": "client.4615 192.168.0.1:0/2606648064", 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "addr_str": "192.168.0.1:0/2606648064", 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "inode_count": 1, 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_epoch": 8, 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_epoch": 21, 2023-09-30T16:49:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_epoch_barrier": 0, 2023-09-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "blocklisted": false, 2023-09-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "fs_name": "cephfs" 2023-09-30T16:49:37.310 INFO:teuthology.orchestra.run.smithi186.stdout:} 2023-09-30T16:49:37.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T16:49:37.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.454+0000 7fc5e2ac3640 1 Processor -- start 2023-09-30T16:49:37.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.454+0000 7fc5e2ac3640 1 -- start start 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e2ac3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5dc15a9e0 0x7fc5dc070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e2ac3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc5dc0b63e0 0x7fc5dc0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e2ac3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc0b2310 0x7fc5dc0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e2ac3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b2ce0 con 0x7fc5dc15a9e0 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e2ac3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0ce770 con 0x7fc5dc0b63e0 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e2ac3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cea10 con 0x7fc5dc0b2310 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5dc15a9e0 0x7fc5dc070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5dc15a9e0 0x7fc5dc070850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38202/0 (socket says 172.21.15.52:38202) 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 -- 172.21.15.52:0/4278861714 learned_addr learned my addr 172.21.15.52:0/4278861714 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:37.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e1060640 1 --2- 172.21.15.52:0/4278861714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc0b2310 0x7fc5dc0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5dbfff640 1 --2- 172.21.15.52:0/4278861714 >> v2:172.21.15.186:3300/0 conn(0x7fc5dc0b63e0 0x7fc5dc0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 -- 172.21.15.52:0/4278861714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc0b2310 msgr2=0x7fc5dc0b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 --2- 172.21.15.52:0/4278861714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc0b2310 0x7fc5dc0b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 -- 172.21.15.52:0/4278861714 >> v2:172.21.15.186:3300/0 conn(0x7fc5dc0b63e0 msgr2=0x7fc5dc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 --2- 172.21.15.52:0/4278861714 >> v2:172.21.15.186:3300/0 conn(0x7fc5dc0b63e0 0x7fc5dc0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 -- 172.21.15.52:0/4278861714 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0cecf0 con 0x7fc5dc15a9e0 2023-09-30T16:49:37.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.458+0000 7fc5e085f640 1 --2- 172.21.15.52:0/4278861714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc15a9e0 0x7fc5dc070850 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0b6970 tx=0x7fc5cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9aa99567804da0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:37.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5db7fe640 1 -- 172.21.15.52:0/4278861714 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0a5790 con 0x7fc5dc15a9e0 2023-09-30T16:49:37.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5db7fe640 1 -- 172.21.15.52:0/4278861714 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc0a58f0 con 0x7fc5dc15a9e0 2023-09-30T16:49:37.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5db7fe640 1 -- 172.21.15.52:0/4278861714 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0a5c80 con 0x7fc5dc15a9e0 2023-09-30T16:49:37.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/4278861714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc15a9e0 msgr2=0x7fc5dc070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:37.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/4278861714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc15a9e0 0x7fc5dc070850 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0b6970 tx=0x7fc5cc01c910 comp rx=0 tx=0).stop 2023-09-30T16:49:37.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/4278861714 shutdown_connections 2023-09-30T16:49:37.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/4278861714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc0b2310 0x7fc5dc0b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/4278861714 >> v2:172.21.15.186:3300/0 conn(0x7fc5dc0b63e0 0x7fc5dc0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/4278861714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc15a9e0 0x7fc5dc070850 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/4278861714 >> 172.21.15.52:0/4278861714 conn(0x7fc5dc0cd310 msgr2=0x7fc5dc0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/4278861714 shutdown_connections 2023-09-30T16:49:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/4278861714 wait complete. 2023-09-30T16:49:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 Processor -- start 2023-09-30T16:49:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- start start 2023-09-30T16:49:37.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 0x7fc5dc14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5dc0b63e0 0x7fc5dc0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc15a9e0 0x7fc5dc0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c83b0 con 0x7fc5dc0b2310 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c8690 con 0x7fc5dc0b63e0 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e2ac3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c8970 con 0x7fc5dc15a9e0 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 0x7fc5dc14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 0x7fc5dc14dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38206/0 (socket says 172.21.15.52:38206) 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 -- 172.21.15.52:0/3700766244 learned_addr learned my addr 172.21.15.52:0/3700766244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5dbfff640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5dc0b63e0 0x7fc5dc0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e1060640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc15a9e0 0x7fc5dc0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 -- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc15a9e0 msgr2=0x7fc5dc0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc15a9e0 0x7fc5dc0b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 -- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5dc0b63e0 msgr2=0x7fc5dc0c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5dc0b63e0 0x7fc5dc0c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 -- 172.21.15.52:0/3700766244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009b30 con 0x7fc5dc0b2310 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.462+0000 7fc5e085f640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 0x7fc5dc14dac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc01c740 tx=0x7fc5cc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0b8670 con 0x7fc5dc0b2310 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc15af40 con 0x7fc5dc0b2310 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc0c5650 con 0x7fc5dc0b2310 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc0b87d0 con 0x7fc5dc0b2310 2023-09-30T16:49:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0b8b40 con 0x7fc5dc0b2310 2023-09-30T16:49:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc005260 con 0x7fc5dc0b2310 2023-09-30T16:49:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fc5cc0b8ca0 con 0x7fc5dc0b2310 2023-09-30T16:49:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5d97fa640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc5c8066160 0x7fc5c8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5cc11f340 con 0x7fc5dc0b2310 2023-09-30T16:49:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5dbfff640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc5c8066160 0x7fc5c8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:37.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.466+0000 7fc5dbfff640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc5c8066160 0x7fc5c8068620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c3d00 tx=0x7fc5d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:37.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.470+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fc5cc0eca80 con 0x7fc5dc0b2310 2023-09-30T16:49:37.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.662+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5bc0057e0 con 0x7fc5dc0b2310 2023-09-30T16:49:37.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.662+0000 7fc5d97fa640 1 -- 172.21.15.52:0/3700766244 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc5cc0bc060 con 0x7fc5dc0b2310 2023-09-30T16:49:37.665 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc5c8066160 msgr2=0x7fc5c8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc5c8066160 0x7fc5c8068620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c3d00 tx=0x7fc5d0008040 comp rx=0 tx=0).stop 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 msgr2=0x7fc5dc14dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 0x7fc5dc14dac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc01c740 tx=0x7fc5cc0196b0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 shutdown_connections 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc5c8066160 0x7fc5c8068620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5dc15a9e0 0x7fc5dc0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5dc0b63e0 0x7fc5dc0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 --2- 172.21.15.52:0/3700766244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5dc0b2310 0x7fc5dc14dac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 >> 172.21.15.52:0/3700766244 conn(0x7fc5dc0cd310 msgr2=0x7fc5dc15ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 shutdown_connections 2023-09-30T16:49:37.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:37.666+0000 7fc5e2ac3640 1 -- 172.21.15.52:0/3700766244 wait complete. 2023-09-30T16:49:37.684 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T16:49:37.684 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T16:49:37.684 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2023-09-30T16:49:37.685 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-30T16:49:37.685 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:37.685 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T16:49:37.685 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T16:49:37.685 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T16:49:37.685 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-30T16:49:37.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.685 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2023-09-30T16:49:37.692 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:37.692 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:37.692 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:49:37.693 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42441sec preferred_lft 42441sec 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::ec4:7aff:fe88:6df5/64 scope link 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 02:42:ff:11:7a:73 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:49:37.694 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:37.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.695 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T16:49:37.746 INFO:teuthology.orchestra.run.smithi186.stdout:1 2023-09-30T16:49:37.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.748 DEBUG:teuthology.orchestra.run.smithi186:> route 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-30T16:49:37.798 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T16:49:37.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.799 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:37.799 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:37.799 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T16:49:37.799 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T16:49:37.799 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T16:49:37.799 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:37.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.876 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2023-09-30T16:49:37.923 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T16:49:37.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.923 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2023-09-30T16:49:37.970 INFO:teuthology.orchestra.run.smithi186.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-30T16:49:37.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:37.971 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:37.971 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:37.971 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:37.971 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-30T16:49:37.971 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:38.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:38.039 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:49:38.094 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 82:21:95:7b:d8:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T16:49:38.095 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T16:49:38.095 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.095 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::8021:95ff:fe7b:d813/64 scope link 2023-09-30T16:49:38.095 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:38.096 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:49:38.151 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 82:21:95:7b:d8:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T16:49:38.152 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T16:49:38.152 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.152 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::8021:95ff:fe7b:d813/64 scope link 2023-09-30T16:49:38.152 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:49:38.153 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-30T16:49:38.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:38.153 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:38.153 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:38.153 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-30T16:49:38.153 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-30T16:49:38.153 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-30T16:49:38.153 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-30T16:49:38.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-30T16:49:38.154 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:38.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:38.249 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2023-09-30T16:49:38.249 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2023-09-30T16:49:38.249 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.1 up 2023-09-30T16:49:38.249 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.1 master ceph-brx 2023-09-30T16:49:38.249 DEBUG:teuthology.orchestra.run.smithi186:> ') 2023-09-30T16:49:38.267 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-09-30T16:49:38.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:38.268 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:38.313 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-30T16:49:38.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:49:38.314 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:38.361 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2023-09-30T16:49:38.417 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:38.463 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2023-09-30T16:49:38.463 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2023-09-30T16:49:38.463 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2023-09-30T16:49:38.463 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2023-09-30T16:49:38.463 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/run/lock 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2023-09-30T16:49:38.464 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/fs/nfsd 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/run/rpc_pipefs 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T16:49:38.465 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2023-09-30T16:49:38.466 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:38.466 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:38.466 INFO:teuthology.orchestra.run.smithi186.stdout:/home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:38.466 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:38.466 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:38.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:38.467 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2023-09-30T16:49:38.515 INFO:teuthology.orchestra.run.smithi186.stdout:45 2023-09-30T16:49:38.515 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-09-30T16:49:38.515 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-09-30T16:49:38.559 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2023-09-30T16:49:38.575 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:38.626 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2023-09-30T16:49:38.626 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/run/lock 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:38.627 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/fs/nfsd 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/run/rpc_pipefs 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T16:49:38.628 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:38.629 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:38.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:38.630 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2023-09-30T16:49:38.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi186.stderr:2023-09-30T16:49:38.635+0000 7f80d2d3c580 -1 init, newargv = 0x5567d6402e00 newargc=15 2023-09-30T16:49:38.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi186.stderr:ceph-fuse[43810]: starting ceph client 2023-09-30T16:49:38.643 INFO:teuthology.orchestra.run.smithi186.stdout:45 2023-09-30T16:49:38.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi186.stderr:ceph-fuse[43810]: starting fuse 2023-09-30T16:49:39.745 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2023-09-30T16:49:39.760 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:49:39.807 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2023-09-30T16:49:39.807 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/run/lock 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2023-09-30T16:49:39.808 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/fs/nfsd 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2023-09-30T16:49:39.809 INFO:teuthology.orchestra.run.smithi186.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/run/rpc_pipefs 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:39.810 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T16:49:39.811 INFO:teuthology.orchestra.run.smithi186.stdout:/home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:39.811 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:39.811 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T16:49:39.811 INFO:teuthology.orchestra.run.smithi186.stdout:/home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:39.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:39.812 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2023-09-30T16:49:39.858 INFO:teuthology.orchestra.run.smithi186.stdout:45 2023-09-30T16:49:39.859 INFO:teuthology.orchestra.run.smithi186.stdout:46 2023-09-30T16:49:39.859 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-09-30T16:49:39.859 DEBUG:teuthology.orchestra.run.smithi186:> sudo stdin-killer -- python3 -c ' 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> import glob 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> import re 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> import os 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> import subprocess 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> def _find_admin_socket(client_name): 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> files = glob.glob(asok_path) 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> # Given a non-glob path, it better be there 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> if "*" not in asok_path: 2023-09-30T16:49:39.860 DEBUG:teuthology.orchestra.run.smithi186:> assert(len(files) == 1) 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> return files[0] 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> for f in files: 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> contents = proc_f.read() 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> if mountpoint in contents: 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> return f 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> print(_find_admin_socket("client.3")) 2023-09-30T16:49:39.861 DEBUG:teuthology.orchestra.run.smithi186:> ' 2023-09-30T16:49:39.985 INFO:teuthology.orchestra.run.smithi186.stdout:/var/run/ceph/ceph-client.3.43810.asok 2023-09-30T16:49:39.989 INFO:teuthology.orchestra.run.smithi186.stderr:2023-09-30T16:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T16:49:39.996 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43810.asok 2023-09-30T16:49:39.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:39.997 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43810.asok status 2023-09-30T16:49:40.147 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2023-09-30T16:49:40.147 INFO:teuthology.orchestra.run.smithi186.stdout: "metadata": { 2023-09-30T16:49:40.147 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T16:49:40.147 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T16:49:40.147 INFO:teuthology.orchestra.run.smithi186.stdout: "entity_id": "3", 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "hostname": "smithi186", 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "pid": "43810", 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "root": "/" 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "dentry_count": 0, 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "dentry_pinned_count": 0, 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "id": 4517, 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "inst": { 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "name": { 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "client", 2023-09-30T16:49:40.148 INFO:teuthology.orchestra.run.smithi186.stdout: "num": 4517 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "192.168.0.2:0", 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 1251869107 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: } 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "192.168.0.2:0", 2023-09-30T16:49:40.149 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 1251869107 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "inst_str": "client.4517 192.168.0.2:0/1251869107", 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "addr_str": "192.168.0.2:0/1251869107", 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "inode_count": 1, 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_epoch": 8, 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_epoch": 21, 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_epoch_barrier": 0, 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "blocklisted": false, 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout: "fs_name": "cephfs" 2023-09-30T16:49:40.150 INFO:teuthology.orchestra.run.smithi186.stdout:} 2023-09-30T16:49:40.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.162 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2023-09-30T16:49:40.162 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:40.169 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2023-09-30T16:49:40.169 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:40.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.170 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:40.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.226 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2023-09-30T16:49:40.226 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:40.276 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2023-09-30T16:49:40.276 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:40.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:40.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.330 DEBUG:teuthology.orchestra.run.smithi186:> stat --file-system '--printf=%T 2023-09-30T16:49:40.330 DEBUG:teuthology.orchestra.run.smithi186:> ' -- /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:40.337 INFO:teuthology.orchestra.run.smithi186.stdout:fuseblk 2023-09-30T16:49:40.337 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:40.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.338 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:40.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.394 DEBUG:teuthology.orchestra.run.smithi186:> stat --file-system '--printf=%T 2023-09-30T16:49:40.394 DEBUG:teuthology.orchestra.run.smithi186:> ' -- /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:40.447 INFO:teuthology.orchestra.run.smithi186.stdout:fuseblk 2023-09-30T16:49:40.447 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:40.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:40.448 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-30T16:49:40.502 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-30T16:49:40.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 Processor -- start 2023-09-30T16:49:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 -- start start 2023-09-30T16:49:40.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7effac15e4b0 0x7effac0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7effac0b19b0 0x7effac0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac06c240 con 0x7effac15a9d0 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac15adb0 con 0x7effac0b19b0 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effb1187640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac15ea90 con 0x7effac15e4b0 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effab59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7effac0b19b0 0x7effac0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effab59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7effac0b19b0 0x7effac0b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38222/0 (socket says 172.21.15.52:38222) 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effab59e640 1 -- 172.21.15.52:0/1710424766 learned_addr learned my addr 172.21.15.52:0/1710424766 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.654+0000 7effaa59c640 1 --2- 172.21.15.52:0/1710424766 >> v2:172.21.15.186:3300/0 conn(0x7effac15e4b0 0x7effac0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effab59e640 1 -- 172.21.15.52:0/1710424766 >> v2:172.21.15.186:3300/0 conn(0x7effac15e4b0 msgr2=0x7effac0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effab59e640 1 --2- 172.21.15.52:0/1710424766 >> v2:172.21.15.186:3300/0 conn(0x7effac15e4b0 0x7effac0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effab59e640 1 -- 172.21.15.52:0/1710424766 >> v1:172.21.15.186:6789/0 conn(0x7effac15a9d0 legacy=0x7effac06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effab59e640 1 -- 172.21.15.52:0/1710424766 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac15ed70 con 0x7effac0b19b0 2023-09-30T16:49:40.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effab59e640 1 --2- 172.21.15.52:0/1710424766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac0b19b0 0x7effac0b00a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effac06e270 tx=0x7effa401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24f23bb0a2ccfbd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:40.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effa9d9b640 1 -- 172.21.15.52:0/1710424766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40ab600 con 0x7effac0b19b0 2023-09-30T16:49:40.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effa9d9b640 1 -- 172.21.15.52:0/1710424766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa40a7050 con 0x7effac0b19b0 2023-09-30T16:49:40.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effa9d9b640 1 -- 172.21.15.52:0/1710424766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40ab980 con 0x7effac0b19b0 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 -- 172.21.15.52:0/1710424766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac0b19b0 msgr2=0x7effac0b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 --2- 172.21.15.52:0/1710424766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac0b19b0 0x7effac0b00a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7effac06e270 tx=0x7effa401c4c0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 -- 172.21.15.52:0/1710424766 shutdown_connections 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 --2- 172.21.15.52:0/1710424766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac0b19b0 0x7effac0b00a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 --2- 172.21.15.52:0/1710424766 >> v2:172.21.15.186:3300/0 conn(0x7effac15e4b0 0x7effac0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 -- 172.21.15.52:0/1710424766 >> 172.21.15.52:0/1710424766 conn(0x7effac06a5f0 msgr2=0x7effac0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 -- 172.21.15.52:0/1710424766 shutdown_connections 2023-09-30T16:49:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.658+0000 7effb1187640 1 -- 172.21.15.52:0/1710424766 wait complete. 2023-09-30T16:49:40.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 Processor -- start 2023-09-30T16:49:40.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- start start 2023-09-30T16:49:40.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac0b19b0 0x7effac145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effac15a9d0 0x7effac153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 0x7effac147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac146060 con 0x7effac15e4b0 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ac050 con 0x7effac0b19b0 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ac330 con 0x7effac15a9d0 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 0x7effac147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 0x7effac147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38232/0 (socket says 172.21.15.52:38232) 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 -- 172.21.15.52:0/4240320278 learned_addr learned my addr 172.21.15.52:0/4240320278 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effaad9d640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac0b19b0 0x7effac145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effaa59c640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effac15a9d0 0x7effac153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 -- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effac15a9d0 msgr2=0x7effac153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effac15a9d0 0x7effac153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 -- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac0b19b0 msgr2=0x7effac145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac0b19b0 0x7effac145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 -- 172.21.15.52:0/4240320278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40094d0 con 0x7effac15e4b0 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effab59e640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 0x7effac147c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7effa40ae040 tx=0x7effa401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40b6420 con 0x7effac15e4b0 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa40b65a0 con 0x7effac15e4b0 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0ac610 con 0x7effac15e4b0 2023-09-30T16:49:40.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40b6950 con 0x7effac15e4b0 2023-09-30T16:49:40.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac0acbd0 con 0x7effac15e4b0 2023-09-30T16:49:40.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0acdc0 con 0x7effac15e4b0 2023-09-30T16:49:40.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.662+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7effa40b2040 con 0x7effac15e4b0 2023-09-30T16:49:40.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.666+0000 7eff937fe640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7eff98066160 0x7eff98068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.666+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effa411dd20 con 0x7effac15e4b0 2023-09-30T16:49:40.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.666+0000 7effaad9d640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7eff98066160 0x7eff98068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.666+0000 7effaad9d640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7eff98066160 0x7eff98068620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007fd0 tx=0x7eff9c007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:40.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.670+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7effa40eb480 con 0x7effac15e4b0 2023-09-30T16:49:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.822+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effac0740a0 con 0x7effac15e4b0 2023-09-30T16:49:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7eff937fe640 1 -- 172.21.15.52:0/4240320278 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7effa40eeaa0 con 0x7effac15e4b0 2023-09-30T16:49:40.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:40.828 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7eff98066160 msgr2=0x7eff98068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7eff98066160 0x7eff98068620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007fd0 tx=0x7eff9c007e40 comp rx=0 tx=0).stop 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 msgr2=0x7effac147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 0x7effac147c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7effa40ae040 tx=0x7effa401ad00 comp rx=0 tx=0).stop 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 shutdown_connections 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7eff98066160 0x7eff98068620 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac15e4b0 0x7effac147c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effac15a9d0 0x7effac153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 --2- 172.21.15.52:0/4240320278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac0b19b0 0x7effac145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 >> 172.21.15.52:0/4240320278 conn(0x7effac06a5f0 msgr2=0x7effac073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 shutdown_connections 2023-09-30T16:49:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.826+0000 7effb1187640 1 -- 172.21.15.52:0/4240320278 wait complete. 2023-09-30T16:49:40.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:40.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:40.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 Processor -- start 2023-09-30T16:49:40.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 -- start start 2023-09-30T16:49:40.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe694159780 0x7fe69406d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe69406d9b0 0x7fe6940c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69415d3a0 con 0x7fe6940ca260 2023-09-30T16:49:40.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6940cd740 con 0x7fe694159780 2023-09-30T16:49:40.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe69a3b6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940cda20 con 0x7fe69406d9b0 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe694159780 0x7fe69406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe694159780 0x7fe69406d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38242/0 (socket says 172.21.15.52:38242) 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 -- 172.21.15.52:0/3225463666 learned_addr learned my addr 172.21.15.52:0/3225463666 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe6937fe640 1 --2- 172.21.15.52:0/3225463666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe69406d9b0 0x7fe6940c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 -- 172.21.15.52:0/3225463666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe69406d9b0 msgr2=0x7fe6940c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 --2- 172.21.15.52:0/3225463666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe69406d9b0 0x7fe6940c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 -- 172.21.15.52:0/3225463666 >> v1:172.21.15.186:6789/0 conn(0x7fe6940ca260 legacy=0x7fe694070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.978+0000 7fe693fff640 1 -- 172.21.15.52:0/3225463666 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940cdd00 con 0x7fe694159780 2023-09-30T16:49:40.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 --2- 172.21.15.52:0/3225463666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe694159780 0x7fe69406d470 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe684009870 tx=0x7fe68401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483987b751153094 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:40.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe692ffd640 1 -- 172.21.15.52:0/3225463666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840ab670 con 0x7fe694159780 2023-09-30T16:49:40.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe692ffd640 1 -- 172.21.15.52:0/3225463666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840ab7d0 con 0x7fe694159780 2023-09-30T16:49:40.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe692ffd640 1 -- 172.21.15.52:0/3225463666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840abb60 con 0x7fe694159780 2023-09-30T16:49:40.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- 172.21.15.52:0/3225463666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe694159780 msgr2=0x7fe69406d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/3225463666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe694159780 0x7fe69406d470 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe684009870 tx=0x7fe68401e690 comp rx=0 tx=0).stop 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- 172.21.15.52:0/3225463666 shutdown_connections 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/3225463666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe69406d9b0 0x7fe6940c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/3225463666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe694159780 0x7fe69406d470 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- 172.21.15.52:0/3225463666 >> 172.21.15.52:0/3225463666 conn(0x7fe69406a5c0 msgr2=0x7fe6940ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- 172.21.15.52:0/3225463666 shutdown_connections 2023-09-30T16:49:40.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- 172.21.15.52:0/3225463666 wait complete. 2023-09-30T16:49:40.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 Processor -- start 2023-09-30T16:49:40.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- start start 2023-09-30T16:49:40.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 0x7fe6941572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe694159780 0x7fe69414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6940c77d0 0x7fe6940c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694157800 con 0x7fe6940ca260 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694156260 con 0x7fe694159780 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe69a3b6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe694156500 con 0x7fe6940c77d0 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 0x7fe6941572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 0x7fe6941572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38246/0 (socket says 172.21.15.52:38246) 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 -- 172.21.15.52:0/2142820464 learned_addr learned my addr 172.21.15.52:0/2142820464 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe6937fe640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe694159780 0x7fe69414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe698953640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6940c77d0 0x7fe6940c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 -- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6940c77d0 msgr2=0x7fe6940c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6940c77d0 0x7fe6940c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 -- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe694159780 msgr2=0x7fe69414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe694159780 0x7fe69414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.982+0000 7fe693fff640 1 -- 172.21.15.52:0/2142820464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840094d0 con 0x7fe6940ca260 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe693fff640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 0x7fe6941572c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6840ad040 tx=0x7fe68401ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840b3800 con 0x7fe6940ca260 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840b3980 con 0x7fe6940ca260 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6941567e0 con 0x7fe6940ca260 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840b3d30 con 0x7fe6940ca260 2023-09-30T16:49:40.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe694156da0 con 0x7fe6940ca260 2023-09-30T16:49:40.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe694156f90 con 0x7fe6940ca260 2023-09-30T16:49:40.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe6840aa3d0 con 0x7fe6940ca260 2023-09-30T16:49:40.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe690ff9640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe680066160 0x7fe680068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:40.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe68411e420 con 0x7fe6940ca260 2023-09-30T16:49:40.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe6937fe640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe680066160 0x7fe680068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:40.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.986+0000 7fe6937fe640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe680066160 0x7fe680068620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe6940c1ec0 tx=0x7fe688008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:40.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:40.990+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe6840ebb80 con 0x7fe6940ca260 2023-09-30T16:49:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.146+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6940740a0 con 0x7fe6940ca260 2023-09-30T16:49:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.146+0000 7fe690ff9640 1 -- 172.21.15.52:0/2142820464 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6840ef1a0 con 0x7fe6940ca260 2023-09-30T16:49:41.149 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe680066160 msgr2=0x7fe680068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe680066160 0x7fe680068620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe6940c1ec0 tx=0x7fe688008040 comp rx=0 tx=0).stop 2023-09-30T16:49:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 msgr2=0x7fe6941572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 0x7fe6941572c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6840ad040 tx=0x7fe68401ced0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 shutdown_connections 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe680066160 0x7fe680068620 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6940c77d0 0x7fe6940c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe694159780 0x7fe69414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 --2- 172.21.15.52:0/2142820464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6940ca260 0x7fe6941572c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 >> 172.21.15.52:0/2142820464 conn(0x7fe69406a5c0 msgr2=0x7fe69415a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 shutdown_connections 2023-09-30T16:49:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.150+0000 7fe69a3b6640 1 -- 172.21.15.52:0/2142820464 wait complete. 2023-09-30T16:49:41.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:41.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.290+0000 7f600213a640 1 Processor -- start 2023-09-30T16:49:41.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.290+0000 7f600213a640 1 -- start start 2023-09-30T16:49:41.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f600213a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5ffc15cb50 0x7f5ffc070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f600213a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc160d30 0x7f5ffc161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f600213a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc070f10 con 0x7f5ffc06d730 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f600213a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc161680 con 0x7f5ffc15cb50 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f600213a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc070670 con 0x7f5ffc160d30 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc160d30 0x7f5ffc161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffb7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5ffc15cb50 0x7f5ffc070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc160d30 0x7f5ffc161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:37098/0 (socket says 172.21.15.52:37098) 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffbfff640 1 -- 172.21.15.52:0/2429327801 learned_addr learned my addr 172.21.15.52:0/2429327801 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:41.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffaffd640 1 --1- 172.21.15.52:0/2429327801 >> v1:172.21.15.186:6789/0 conn(0x7f5ffc06d730 0x7f5ffc0c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:50332/0 (socket says 172.21.15.52:50332) 2023-09-30T16:49:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc160d30 msgr2=0x7f5ffc161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffb7fe640 1 --2- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc160d30 0x7f5ffc161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/2429327801 >> v1:172.21.15.186:6789/0 conn(0x7f5ffc06d730 legacy=0x7f5ffc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.294+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/2429327801 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc070950 con 0x7f5ffc15cb50 2023-09-30T16:49:41.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 --2- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc15cb50 0x7f5ffc070070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097c0 tx=0x7f5fec01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ecf019655a8e772 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffa7fc640 1 -- 172.21.15.52:0/2429327801 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0a8970 con 0x7f5ffc15cb50 2023-09-30T16:49:41.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffa7fc640 1 -- 172.21.15.52:0/2429327801 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0a8ad0 con 0x7f5ffc15cb50 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffa7fc640 1 -- 172.21.15.52:0/2429327801 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0a8e60 con 0x7f5ffc15cb50 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc15cb50 msgr2=0x7f5ffc070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 --2- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc15cb50 0x7f5ffc070070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097c0 tx=0x7f5fec01ec70 comp rx=0 tx=0).stop 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- 172.21.15.52:0/2429327801 shutdown_connections 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 --2- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc160d30 0x7f5ffc161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 --2- 172.21.15.52:0/2429327801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc15cb50 0x7f5ffc070070 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- 172.21.15.52:0/2429327801 >> 172.21.15.52:0/2429327801 conn(0x7f5ffc06a5c0 msgr2=0x7f5ffc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- 172.21.15.52:0/2429327801 shutdown_connections 2023-09-30T16:49:41.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- 172.21.15.52:0/2429327801 wait complete. 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 Processor -- start 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- start start 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 0x7f5ffc0c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc15cb50 0x7f5ffc1f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc160d30 0x7f5ffc1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b27b0 con 0x7f5ffc06d730 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1f6510 con 0x7f5ffc160d30 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f600213a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1f67f0 con 0x7f5ffc15cb50 2023-09-30T16:49:41.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 0x7f5ffc0c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 0x7f5ffc0c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38258/0 (socket says 172.21.15.52:38258) 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/3227065143 learned_addr learned my addr 172.21.15.52:0/3227065143 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffbfff640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc160d30 0x7f5ffc1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffaffd640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc15cb50 0x7f5ffc1f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc15cb50 msgr2=0x7f5ffc1f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc15cb50 0x7f5ffc1f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc160d30 msgr2=0x7f5ffc1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc160d30 0x7f5ffc1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 -- 172.21.15.52:0/3227065143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009420 con 0x7f5ffc06d730 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.298+0000 7f5ffb7fe640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 0x7f5ffc0c6a80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5fec01d320 tx=0x7f5fec01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0bf070 con 0x7f5ffc06d730 2023-09-30T16:49:41.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0b1c00 con 0x7f5ffc06d730 2023-09-30T16:49:41.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc1f6ad0 con 0x7f5ffc06d730 2023-09-30T16:49:41.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0b9410 con 0x7f5ffc06d730 2023-09-30T16:49:41.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc1f6220 con 0x7f5ffc06d730 2023-09-30T16:49:41.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc0740a0 con 0x7f5ffc06d730 2023-09-30T16:49:41.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f5fec0b7040 con 0x7f5ffc06d730 2023-09-30T16:49:41.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5fe3fff640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5fe8066190 0x7f5fe8068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fec1216e0 con 0x7f5ffc06d730 2023-09-30T16:49:41.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5ffaffd640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5fe8066190 0x7f5fe8068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.302+0000 7f5ffaffd640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5fe8066190 0x7f5fe8068650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc160640 tx=0x7f5ff0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.306+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5fec0eed90 con 0x7f5ffc06d730 2023-09-30T16:49:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.462+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ffc0cf2d0 con 0x7f5ffc06d730 2023-09-30T16:49:41.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.462+0000 7f5fe3fff640 1 -- 172.21.15.52:0/3227065143 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fec0b50a0 con 0x7f5ffc06d730 2023-09-30T16:49:41.464 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:41.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.462+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5fe8066190 msgr2=0x7f5fe8068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.462+0000 7f600213a640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5fe8066190 0x7f5fe8068650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc160640 tx=0x7f5ff0009040 comp rx=0 tx=0).stop 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.462+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 msgr2=0x7f5ffc0c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.462+0000 7f600213a640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 0x7f5ffc0c6a80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5fec01d320 tx=0x7f5fec01ba10 comp rx=0 tx=0).stop 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 shutdown_connections 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5fe8066190 0x7f5fe8068650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ffc160d30 0x7f5ffc1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ffc15cb50 0x7f5ffc1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 --2- 172.21.15.52:0/3227065143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ffc06d730 0x7f5ffc0c6a80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 >> 172.21.15.52:0/3227065143 conn(0x7f5ffc06a5c0 msgr2=0x7f5ffc0cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 shutdown_connections 2023-09-30T16:49:41.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.466+0000 7f600213a640 1 -- 172.21.15.52:0/3227065143 wait complete. 2023-09-30T16:49:41.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:41.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 Processor -- start 2023-09-30T16:49:41.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 -- start start 2023-09-30T16:49:41.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22815cc60 0x7ff2280cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff2280d0040 0x7ff2280d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280d04a0 con 0x7ff2280d25b0 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280d39b0 con 0x7ff2280d0040 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22fd29640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22815d040 con 0x7ff22815cc60 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22d2c4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff2280d0040 0x7ff2280d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22dac5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22815cc60 0x7ff2280cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22e2c6640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7ff2280d25b0 0x7ff2280d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:50344/0 (socket says 172.21.15.52:50344) 2023-09-30T16:49:41.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22e2c6640 1 -- 172.21.15.52:0/1034730819 learned_addr learned my addr 172.21.15.52:0/1034730819 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:41.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22d2c4640 1 -- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22815cc60 msgr2=0x7ff2280cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:41.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22d2c4640 1 --2- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22815cc60 0x7ff2280cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22d2c4640 1 -- 172.21.15.52:0/1034730819 >> v1:172.21.15.186:6789/0 conn(0x7ff2280d25b0 legacy=0x7ff2280d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.606+0000 7ff22d2c4640 1 -- 172.21.15.52:0/1034730819 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280d2da0 con 0x7ff2280d0040 2023-09-30T16:49:41.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22d2c4640 1 --2- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff2280d2070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff2180097c0 tx=0x7ff21801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b895271dafd031 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22cac3640 1 -- 172.21.15.52:0/1034730819 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180ab650 con 0x7ff2280d0040 2023-09-30T16:49:41.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22cac3640 1 -- 172.21.15.52:0/1034730819 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2180ab7b0 con 0x7ff2280d0040 2023-09-30T16:49:41.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22cac3640 1 -- 172.21.15.52:0/1034730819 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180abb40 con 0x7ff2280d0040 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 -- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 msgr2=0x7ff2280d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 --2- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff2280d2070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff2180097c0 tx=0x7ff21801c450 comp rx=0 tx=0).stop 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 -- 172.21.15.52:0/1034730819 shutdown_connections 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 --2- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff2280d2070 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 --2- 172.21.15.52:0/1034730819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22815cc60 0x7ff2280cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 -- 172.21.15.52:0/1034730819 >> 172.21.15.52:0/1034730819 conn(0x7ff228071930 msgr2=0x7ff228071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 -- 172.21.15.52:0/1034730819 shutdown_connections 2023-09-30T16:49:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 -- 172.21.15.52:0/1034730819 wait complete. 2023-09-30T16:49:41.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 Processor -- start 2023-09-30T16:49:41.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.610+0000 7ff22fd29640 1 -- start start 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff228150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2280d25b0 0x7ff22815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 0x7ff2280cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280cba80 con 0x7ff22815cc60 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22815df40 con 0x7ff2280d0040 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2281513e0 con 0x7ff2280d25b0 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 0x7ff2280cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 0x7ff2280cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38266/0 (socket says 172.21.15.52:38266) 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 -- 172.21.15.52:0/2881909479 learned_addr learned my addr 172.21.15.52:0/2881909479 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22dac5640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff228150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22d2c4640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2280d25b0 0x7ff22815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 -- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2280d25b0 msgr2=0x7ff22815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2280d25b0 0x7ff22815d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 -- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 msgr2=0x7ff228150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff228150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 -- 172.21.15.52:0/2881909479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218009420 con 0x7ff22815cc60 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22d2c4640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2280d25b0 0x7ff22815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22e2c6640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 0x7ff2280cbf10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c400 tx=0x7ff22000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220005cf0 con 0x7ff22815cc60 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220005e50 con 0x7ff22815cc60 2023-09-30T16:49:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2200072d0 con 0x7ff22815cc60 2023-09-30T16:49:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2280cb430 con 0x7ff22815cc60 2023-09-30T16:49:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff228153b50 con 0x7ff22815cc60 2023-09-30T16:49:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280cbc30 con 0x7ff22815cc60 2023-09-30T16:49:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff220007430 con 0x7ff22815cc60 2023-09-30T16:49:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff21e7fc640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff20c066160 0x7ff20c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff220082f40 con 0x7ff22815cc60 2023-09-30T16:49:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.614+0000 7ff22dac5640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff20c066160 0x7ff20c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.618+0000 7ff22dac5640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff20c066160 0x7ff20c068620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2280b8760 tx=0x7ff22400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.618+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff2280cbc30 con 0x7ff22815cc60 2023-09-30T16:49:41.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.774+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2280cbc30 con 0x7ff22815cc60 2023-09-30T16:49:41.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.774+0000 7ff21e7fc640 1 -- 172.21.15.52:0/2881909479 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2280cbc30 con 0x7ff22815cc60 2023-09-30T16:49:41.777 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:41.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff20c066160 msgr2=0x7ff20c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff20c066160 0x7ff20c068620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2280b8760 tx=0x7ff22400b040 comp rx=0 tx=0).stop 2023-09-30T16:49:41.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 msgr2=0x7ff2280cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 0x7ff2280cbf10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c400 tx=0x7ff22000c8c0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 shutdown_connections 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff20c066160 0x7ff20c068620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22815cc60 0x7ff2280cbf10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2280d25b0 0x7ff22815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 --2- 172.21.15.52:0/2881909479 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2280d0040 0x7ff228150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 >> 172.21.15.52:0/2881909479 conn(0x7ff228071930 msgr2=0x7ff2281532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 shutdown_connections 2023-09-30T16:49:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.778+0000 7ff22fd29640 1 -- 172.21.15.52:0/2881909479 wait complete. 2023-09-30T16:49:41.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:41.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.914+0000 7f86d0045640 1 Processor -- start 2023-09-30T16:49:41.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.914+0000 7f86d0045640 1 -- start start 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86d0045640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 0x7f86c80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86d0045640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c806c240 con 0x7f86c815a9d0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86d0045640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c815adb0 con 0x7f86c80b19b0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86d0045640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c815ea90 con 0x7f86c815e4b0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cdde1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f86c815a9d0 0x7f86c806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37868/0 (socket says 172.21.15.52:37868) 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cdde1640 1 -- 172.21.15.52:0/116175025 learned_addr learned my addr 172.21.15.52:0/116175025 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 0x7f86c80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258915156 0 0) 0x7f86c806c240 con 0x7f86c815a9d0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b4003530 con 0x7f86c815a9d0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895788785 0 0) 0x7f86b4003530 con 0x7f86c815a9d0 2023-09-30T16:49:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 msgr2=0x7f86c80b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 0x7f86c80b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 >> v1:172.21.15.186:6789/0 conn(0x7f86c80b19b0 legacy=0x7f86c80b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c815ed70 con 0x7f86c815a9d0 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f86c4001680 con 0x7f86c815a9d0 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 >> v1:172.21.15.52:6789/0 conn(0x7f86c815a9d0 legacy=0x7f86c806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b4003a20 0x7f86b4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b40047d0 0x7f86b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 0x7f86b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c815ea90 con 0x7f86b40047d0 2023-09-30T16:49:41.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b400baf0 con 0x7f86b4003a20 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b400bcb0 con 0x7f86c815e4b0 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b40047d0 0x7f86b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cdde1640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b4003a20 0x7f86b4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86ce5e2640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 0x7f86b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 -- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 msgr2=0x7f86b40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86c815e4b0 0x7f86b40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 -- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b4003a20 msgr2=0x7f86b4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b4003a20 0x7f86b4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.918+0000 7f86cd5e0640 1 -- 172.21.15.52:0/116175025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4003530 con 0x7f86b40047d0 2023-09-30T16:49:41.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b40047d0 0x7f86b4004c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ae0 tx=0x7f86b801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfd3488f316bdc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80a5530 con 0x7f86b40047d0 2023-09-30T16:49:41.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b80a5690 con 0x7f86b40047d0 2023-09-30T16:49:41.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86ccddf640 1 -- 172.21.15.52:0/116175025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80a5a40 con 0x7f86b40047d0 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- 172.21.15.52:0/116175025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b40047d0 msgr2=0x7f86b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 --2- 172.21.15.52:0/116175025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b40047d0 0x7f86b4004c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ae0 tx=0x7f86b801ca50 comp rx=0 tx=0).stop 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86ce5e2640 1 -- 172.21.15.52:0/116175025 reap_dead start 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- 172.21.15.52:0/116175025 shutdown_connections 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- 172.21.15.52:0/116175025 >> 172.21.15.52:0/116175025 conn(0x7f86c806a5f0 msgr2=0x7f86c80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- 172.21.15.52:0/116175025 shutdown_connections 2023-09-30T16:49:41.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- 172.21.15.52:0/116175025 wait complete. 2023-09-30T16:49:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 Processor -- start 2023-09-30T16:49:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- start start 2023-09-30T16:49:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b40047d0 0x7f86c8153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 0x7f86c80c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86c8154e10 0x7f86c8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8154710 con 0x7f86c81523a0 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81557d0 con 0x7f86c8154e10 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86d0045640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c5450 con 0x7f86b40047d0 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86cd5e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 0x7f86c80c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86cd5e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 0x7f86c80c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38292/0 (socket says 172.21.15.52:38292) 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86cd5e0640 1 -- 172.21.15.52:0/801595206 learned_addr learned my addr 172.21.15.52:0/801595206 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86ce5e2640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86c8154e10 0x7f86c8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.922+0000 7f86cdde1640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b40047d0 0x7f86c8153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cd5e0640 1 -- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b40047d0 msgr2=0x7f86c8153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b40047d0 0x7f86c8153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cd5e0640 1 -- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86c8154e10 msgr2=0x7f86c8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:41.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86c8154e10 0x7f86c8155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cd5e0640 1 -- 172.21.15.52:0/801595206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c814fc20 con 0x7f86c81523a0 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cdde1640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b40047d0 0x7f86c8153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cd5e0640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 0x7f86c80c4f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ae0 tx=0x7f86b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8004220 con 0x7f86c81523a0 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8004380 con 0x7f86c81523a0 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c8154150 con 0x7f86c81523a0 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8005ba0 con 0x7f86c81523a0 2023-09-30T16:49:41.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c814f8b0 con 0x7f86c81523a0 2023-09-30T16:49:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c814f710 con 0x7f86c81523a0 2023-09-30T16:49:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f86b80b4040 con 0x7f86c81523a0 2023-09-30T16:49:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86be7fc640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f86ac066160 0x7f86ac068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86b811d5e0 con 0x7f86c81523a0 2023-09-30T16:49:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cdde1640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f86ac066160 0x7f86ac068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:41.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.926+0000 7f86cdde1640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f86ac066160 0x7f86ac068620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86c4004880 tx=0x7f86c40047f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:41.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:41.930+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f86c814f710 con 0x7f86c81523a0 2023-09-30T16:49:42.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.086+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86c814f710 con 0x7f86c81523a0 2023-09-30T16:49:42.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.086+0000 7f86be7fc640 1 -- 172.21.15.52:0/801595206 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f86c814f710 con 0x7f86c81523a0 2023-09-30T16:49:42.090 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:42.091 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:42.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f86ac066160 msgr2=0x7f86ac068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f86ac066160 0x7f86ac068620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86c4004880 tx=0x7f86c40047f0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 msgr2=0x7f86c80c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 0x7f86c80c4f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ae0 tx=0x7f86b4005800 comp rx=0 tx=0).stop 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 shutdown_connections 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f86ac066160 0x7f86ac068620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86c8154e10 0x7f86c8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86c81523a0 0x7f86c80c4f10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 --2- 172.21.15.52:0/801595206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b40047d0 0x7f86c8153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 >> 172.21.15.52:0/801595206 conn(0x7f86c806a5f0 msgr2=0x7f86c80af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 shutdown_connections 2023-09-30T16:49:42.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.090+0000 7f86d0045640 1 -- 172.21.15.52:0/801595206 wait complete. 2023-09-30T16:49:42.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:42.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:42.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.226+0000 7fbc87513640 1 Processor -- start 2023-09-30T16:49:42.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.226+0000 7fbc87513640 1 -- start start 2023-09-30T16:49:42.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc87513640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc8015bee0 0x7fbc800ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc87513640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbc8015ee20 0x7fbc800cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc87513640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc80069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc87513640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800ccfe0 con 0x7fbc8015bee0 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc87513640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800cca20 con 0x7fbc8015ee20 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc87513640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800ccd00 con 0x7fbc8015f260 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc8015bee0 0x7fbc800ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc8015bee0 0x7fbc800ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38304/0 (socket says 172.21.15.52:38304) 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 -- 172.21.15.52:0/797392162 learned_addr learned my addr 172.21.15.52:0/797392162 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc85ab0640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc80069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc84aae640 1 --2- 172.21.15.52:0/797392162 >> v2:172.21.15.186:3300/0 conn(0x7fbc8015ee20 0x7fbc800cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 -- 172.21.15.52:0/797392162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 msgr2=0x7fbc80069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc80069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 -- 172.21.15.52:0/797392162 >> v2:172.21.15.186:3300/0 conn(0x7fbc8015ee20 msgr2=0x7fbc800cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:42.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 --2- 172.21.15.52:0/797392162 >> v2:172.21.15.186:3300/0 conn(0x7fbc8015ee20 0x7fbc800cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 -- 172.21.15.52:0/797392162 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8015e620 con 0x7fbc8015bee0 2023-09-30T16:49:42.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc85ab0640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc80069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:42.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc852af640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ca860 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc8006e410 tx=0x7fbc7c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285f8d0610c98272 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc77fff640 1 -- 172.21.15.52:0/797392162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0ab600 con 0x7fbc8015bee0 2023-09-30T16:49:42.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc77fff640 1 -- 172.21.15.52:0/797392162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0a7050 con 0x7fbc8015bee0 2023-09-30T16:49:42.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.230+0000 7fbc77fff640 1 -- 172.21.15.52:0/797392162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0ab980 con 0x7fbc8015bee0 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/797392162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 msgr2=0x7fbc800ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ca860 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc8006e410 tx=0x7fbc7c01c500 comp rx=0 tx=0).stop 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/797392162 shutdown_connections 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc80069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- 172.21.15.52:0/797392162 >> v2:172.21.15.186:3300/0 conn(0x7fbc8015ee20 0x7fbc800cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- 172.21.15.52:0/797392162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ca860 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/797392162 >> 172.21.15.52:0/797392162 conn(0x7fbc8006d320 msgr2=0x7fbc8006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/797392162 shutdown_connections 2023-09-30T16:49:42.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/797392162 wait complete. 2023-09-30T16:49:42.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 Processor -- start 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- start start 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc8015ee20 0x7fbc80164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc801562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80164a70 con 0x7fbc8015bee0 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc80163df0 con 0x7fbc8015ee20 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc801640d0 con 0x7fbc8015f260 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38310/0 (socket says 172.21.15.52:38310) 2023-09-30T16:49:42.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 -- 172.21.15.52:0/4187962911 learned_addr learned my addr 172.21.15.52:0/4187962911 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc85ab0640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc801562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc84aae640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc8015ee20 0x7fbc80164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 -- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 msgr2=0x7fbc801562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc801562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 -- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc8015ee20 msgr2=0x7fbc80164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc8015ee20 0x7fbc80164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 -- 172.21.15.52:0/4187962911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0094d0 con 0x7fbc8015bee0 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc84aae640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc8015ee20 0x7fbc80164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc852af640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ced10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0ae040 tx=0x7fbc7c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0b6620 con 0x7fbc8015bee0 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0b67a0 con 0x7fbc8015bee0 2023-09-30T16:49:42.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc801643b0 con 0x7fbc8015bee0 2023-09-30T16:49:42.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0b6b50 con 0x7fbc8015bee0 2023-09-30T16:49:42.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.234+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc80163a80 con 0x7fbc8015bee0 2023-09-30T16:49:42.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.238+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc800740a0 con 0x7fbc8015bee0 2023-09-30T16:49:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.238+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fbc7c0b2040 con 0x7fbc8015bee0 2023-09-30T16:49:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.238+0000 7fbc75ffb640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc64066160 0x7fbc64068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.238+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc7c11dd20 con 0x7fbc8015bee0 2023-09-30T16:49:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.238+0000 7fbc84aae640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc64066160 0x7fbc64068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.238+0000 7fbc84aae640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc64066160 0x7fbc64068620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc8015b650 tx=0x7fbc70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.242+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fbc7c0eb340 con 0x7fbc8015bee0 2023-09-30T16:49:42.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.394+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc80164ce0 con 0x7fbc8015bee0 2023-09-30T16:49:42.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.394+0000 7fbc75ffb640 1 -- 172.21.15.52:0/4187962911 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc7c0ee960 con 0x7fbc8015bee0 2023-09-30T16:49:42.397 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc64066160 msgr2=0x7fbc64068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc64066160 0x7fbc64068620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc8015b650 tx=0x7fbc70008040 comp rx=0 tx=0).stop 2023-09-30T16:49:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 msgr2=0x7fbc800ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ced10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0ae040 tx=0x7fbc7c01ad40 comp rx=0 tx=0).stop 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 shutdown_connections 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc64066160 0x7fbc64068620 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc8015f260 0x7fbc801562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc8015ee20 0x7fbc80164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 --2- 172.21.15.52:0/4187962911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc8015bee0 0x7fbc800ced10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 >> 172.21.15.52:0/4187962911 conn(0x7fbc8006d320 msgr2=0x7fbc800afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 shutdown_connections 2023-09-30T16:49:42.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.398+0000 7fbc87513640 1 -- 172.21.15.52:0/4187962911 wait complete. 2023-09-30T16:49:42.415 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc2693640 1 Processor -- start 2023-09-30T16:49:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc2693640 1 -- start start 2023-09-30T16:49:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc2693640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdfbc0c2770 0x7fdfbc0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc2693640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc065a90 con 0x7fdfbc15abd0 2023-09-30T16:49:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc2693640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc065d30 con 0x7fdfbc0b16f0 2023-09-30T16:49:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc2693640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc06b7c0 con 0x7fdfbc0c2770 2023-09-30T16:49:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbbfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdfbc15abd0 0x7fdfbc06b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37880/0 (socket says 172.21.15.52:37880) 2023-09-30T16:49:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbbfff640 1 -- 172.21.15.52:0/3158182210 learned_addr learned my addr 172.21.15.52:0/3158182210 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3158182210 >> v2:172.21.15.186:3300/0 conn(0x7fdfbc0c2770 0x7fdfbc0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475427993 0 0) 0x7fdfbc065a90 con 0x7fdfbc15abd0 2023-09-30T16:49:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa8003530 con 0x7fdfbc15abd0 2023-09-30T16:49:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853742197 0 0) 0x7fdfa8003530 con 0x7fdfbc15abd0 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 >> v2:172.21.15.186:3300/0 conn(0x7fdfbc0c2770 msgr2=0x7fdfbc0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 --2- 172.21.15.52:0/3158182210 >> v2:172.21.15.186:3300/0 conn(0x7fdfbc0c2770 0x7fdfbc0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 >> v1:172.21.15.186:6789/0 conn(0x7fdfbc0b16f0 legacy=0x7fdfbc06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc066010 con 0x7fdfbc15abd0 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fdfa4001680 con 0x7fdfbc15abd0 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 >> v1:172.21.15.52:6789/0 conn(0x7fdfbc15abd0 legacy=0x7fdfbc06b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfa8003980 0x7fdfa8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfa80047d0 0x7fdfa8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa8005190 0x7fdfa800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc06b7c0 con 0x7fdfa80047d0 2023-09-30T16:49:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa800c130 con 0x7fdfa8005190 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa800c2f0 con 0x7fdfa8003980 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfa80047d0 0x7fdfa8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbbfff640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfa8003980 0x7fdfa8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc0c30640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa8005190 0x7fdfa800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfa8003980 msgr2=0x7fdfa8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfa8003980 0x7fdfa8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa8005190 msgr2=0x7fdfa800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa8005190 0x7fdfa800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3158182210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8003530 con 0x7fdfa80047d0 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfbbfff640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfa8003980 0x7fdfa8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc0c30640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa8005190 0x7fdfa800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:42.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.542+0000 7fdfc0c30640 1 -- 172.21.15.52:0/3158182210 reap_dead start 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfa80047d0 0x7fdfa8004c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009ab0 tx=0x7fdfac01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba9f61fb8154c58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0a64f0 con 0x7fdfa80047d0 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0a6650 con 0x7fdfa80047d0 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfbaffd640 1 -- 172.21.15.52:0/3158182210 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0a6a00 con 0x7fdfa80047d0 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 -- 172.21.15.52:0/3158182210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfa80047d0 msgr2=0x7fdfa8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfa80047d0 0x7fdfa8004c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009ab0 tx=0x7fdfac01ca00 comp rx=0 tx=0).stop 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 -- 172.21.15.52:0/3158182210 shutdown_connections 2023-09-30T16:49:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3158182210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfa80047d0 0x7fdfa8004c50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 -- 172.21.15.52:0/3158182210 >> 172.21.15.52:0/3158182210 conn(0x7fdfbc0b0bd0 msgr2=0x7fdfbc0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 -- 172.21.15.52:0/3158182210 shutdown_connections 2023-09-30T16:49:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 -- 172.21.15.52:0/3158182210 wait complete. 2023-09-30T16:49:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 Processor -- start 2023-09-30T16:49:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.546+0000 7fdfc2693640 1 -- start start 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa80047d0 0x7fdfbc0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 0x7fdfbc1f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfbc1f8fa0 0x7fdfbc1f9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0c3ca0 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc06e600 con 0x7fdfa80047d0 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc06e040 con 0x7fdfbc1f8fa0 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 0x7fdfbc1f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 0x7fdfbc1f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38318/0 (socket says 172.21.15.52:38318) 2023-09-30T16:49:42.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3874146744 learned_addr learned my addr 172.21.15.52:0/3874146744 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc0c30640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfbc1f8fa0 0x7fdfbc1f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbbfff640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa80047d0 0x7fdfbc0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfbc1f8fa0 msgr2=0x7fdfbc1f9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfbc1f8fa0 0x7fdfbc1f9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa80047d0 msgr2=0x7fdfbc0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa80047d0 0x7fdfbc0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 -- 172.21.15.52:0/3874146744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc06e320 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbbfff640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa80047d0 0x7fdfbc0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbb7fe640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 0x7fdfbc1f8a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0b0040 tx=0x7fdfac0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0a64f0 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0a67c0 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc0c3930 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0a6b30 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc1f8640 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc0740a0 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fdfac0a6c90 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfb8ff9640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf9c066160 0x7fdf9c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfac0aa070 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.550+0000 7fdfbbfff640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf9c066160 0x7fdf9c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.554+0000 7fdfbbfff640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf9c066160 0x7fdf9c068620 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c10 tx=0x7fdfa4001480 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.554+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fdfac0ef500 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.710+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfbc071d80 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.710+0000 7fdfb8ff9640 1 -- 172.21.15.52:0/3874146744 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfac0ef090 con 0x7fdfbc1f60a0 2023-09-30T16:49:42.712 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf9c066160 msgr2=0x7fdf9c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf9c066160 0x7fdf9c068620 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c10 tx=0x7fdfa4001480 comp rx=0 tx=0).stop 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 msgr2=0x7fdfbc1f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 0x7fdfbc1f8a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0b0040 tx=0x7fdfac0197a0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 shutdown_connections 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdf9c066160 0x7fdf9c068620 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdfbc1f8fa0 0x7fdfbc1f9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfbc1f60a0 0x7fdfbc1f8a60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 --2- 172.21.15.52:0/3874146744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfa80047d0 0x7fdfbc0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 >> 172.21.15.52:0/3874146744 conn(0x7fdfbc0b0bd0 msgr2=0x7fdfbc0cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 shutdown_connections 2023-09-30T16:49:42.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.714+0000 7fdfc2693640 1 -- 172.21.15.52:0/3874146744 wait complete. 2023-09-30T16:49:42.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:42.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 Processor -- start 2023-09-30T16:49:42.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 -- start start 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdcf80d0210 0x7fdcf80d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80d25b0 0x7fdcf80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf80d39b0 con 0x7fdcf815cc60 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf815d040 con 0x7fdcf80d0210 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfe925640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80d2da0 con 0x7fdcf80d25b0 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcf7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdcf815cc60 0x7fdcf80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37886/0 (socket says 172.21.15.52:37886) 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcf7fff640 1 -- 172.21.15.52:0/3111885852 learned_addr learned my addr 172.21.15.52:0/3111885852 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:42.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdceffff640 1 --2- 172.21.15.52:0/3111885852 >> v2:172.21.15.52:3300/0 conn(0x7fdcf80d0210 0x7fdcf80d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcfcec2640 1 --2- 172.21.15.52:0/3111885852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80d25b0 0x7fdcf80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdceffff640 1 -- 172.21.15.52:0/3111885852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80d25b0 msgr2=0x7fdcf80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:42.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdceffff640 1 --2- 172.21.15.52:0/3111885852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80d25b0 0x7fdcf80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdceffff640 1 -- 172.21.15.52:0/3111885852 >> v1:172.21.15.52:6789/0 conn(0x7fdcf815cc60 legacy=0x7fdcf80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdceffff640 1 -- 172.21.15.52:0/3111885852 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80d3080 con 0x7fdcf80d0210 2023-09-30T16:49:42.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.854+0000 7fdcf77fe640 1 -- 172.21.15.52:0/3111885852 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803403858 0 0) 0x7fdcf80d39b0 con 0x7fdcf815cc60 2023-09-30T16:49:42.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdceffff640 1 --2- 172.21.15.52:0/3111885852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf80d2070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdce80097c0 tx=0x7fdce801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf8456c814df893 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcf77fe640 1 -- 172.21.15.52:0/3111885852 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80ab650 con 0x7fdcf80d0210 2023-09-30T16:49:42.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcf77fe640 1 -- 172.21.15.52:0/3111885852 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce80ab7b0 con 0x7fdcf80d0210 2023-09-30T16:49:42.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcf77fe640 1 -- 172.21.15.52:0/3111885852 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80abb40 con 0x7fdcf80d0210 2023-09-30T16:49:42.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- 172.21.15.52:0/3111885852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 msgr2=0x7fdcf80d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 --2- 172.21.15.52:0/3111885852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf80d2070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdce80097c0 tx=0x7fdce801c450 comp rx=0 tx=0).stop 2023-09-30T16:49:42.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- 172.21.15.52:0/3111885852 shutdown_connections 2023-09-30T16:49:42.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 --2- 172.21.15.52:0/3111885852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80d25b0 0x7fdcf80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 --2- 172.21.15.52:0/3111885852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf80d2070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- 172.21.15.52:0/3111885852 >> 172.21.15.52:0/3111885852 conn(0x7fdcf8071930 msgr2=0x7fdcf8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:42.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- 172.21.15.52:0/3111885852 shutdown_connections 2023-09-30T16:49:42.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- 172.21.15.52:0/3111885852 wait complete. 2023-09-30T16:49:42.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 Processor -- start 2023-09-30T16:49:42.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- start start 2023-09-30T16:49:42.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf815f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf80d25b0 0x7fdcf814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf815cc60 0x7fdcf80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf814eff0 con 0x7fdcf80d0210 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf814e370 con 0x7fdcf80d25b0 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.858+0000 7fdcfe925640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf814e650 con 0x7fdcf815cc60 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf815f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38328/0 (socket says 172.21.15.52:38328) 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 -- 172.21.15.52:0/646378743 learned_addr learned my addr 172.21.15.52:0/646378743 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcfcec2640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf815cc60 0x7fdcf80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdceffff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf80d25b0 0x7fdcf814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 -- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf815cc60 msgr2=0x7fdcf80c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf815cc60 0x7fdcf80c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 -- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf80d25b0 msgr2=0x7fdcf814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf80d25b0 0x7fdcf814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 -- 172.21.15.52:0/646378743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009420 con 0x7fdcf80d0210 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdceffff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf80d25b0 0x7fdcf814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcfcec2640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf815cc60 0x7fdcf80c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf7fff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf815f890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdce000c480 tx=0x7fdce000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce00074e0 con 0x7fdcf80d0210 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce0007660 con 0x7fdcf80d0210 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf814e930 con 0x7fdcf80d0210 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0004a30 con 0x7fdcf80d0210 2023-09-30T16:49:42.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf815fdd0 con 0x7fdcf80d0210 2023-09-30T16:49:42.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf80740a0 con 0x7fdcf80d0210 2023-09-30T16:49:42.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fdce0004b90 con 0x7fdcf80d0210 2023-09-30T16:49:42.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf57fa640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdcd8066160 0x7fdcd8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:42.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdce0082d20 con 0x7fdcf80d0210 2023-09-30T16:49:42.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.862+0000 7fdceffff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdcd8066160 0x7fdcd8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:42.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.866+0000 7fdceffff640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdcd8066160 0x7fdcd8068620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdce80af000 tx=0x7fdce8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:42.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:42.866+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fdce00502a0 con 0x7fdcf80d0210 2023-09-30T16:49:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcf80b2ad0 con 0x7fdcf80d0210 2023-09-30T16:49:43.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcf57fa640 1 -- 172.21.15.52:0/646378743 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdce0018020 con 0x7fdcf80d0210 2023-09-30T16:49:43.024 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:43.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdcd8066160 msgr2=0x7fdcd8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdcd8066160 0x7fdcd8068620 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdce80af000 tx=0x7fdce8008040 comp rx=0 tx=0).stop 2023-09-30T16:49:43.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 msgr2=0x7fdcf815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf815f890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdce000c480 tx=0x7fdce000c940 comp rx=0 tx=0).stop 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 shutdown_connections 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdcd8066160 0x7fdcd8068620 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf815cc60 0x7fdcf80c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcf80d25b0 0x7fdcf814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 --2- 172.21.15.52:0/646378743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcf80d0210 0x7fdcf815f890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 >> 172.21.15.52:0/646378743 conn(0x7fdcf8071930 msgr2=0x7fdcf80cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 shutdown_connections 2023-09-30T16:49:43.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.022+0000 7fdcfe925640 1 -- 172.21.15.52:0/646378743 wait complete. 2023-09-30T16:49:43.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:43.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 Processor -- start 2023-09-30T16:49:43.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 -- start start 2023-09-30T16:49:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0241574c0 0x7fd0240cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd024159df0 0x7fd02406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd02406c180 0x7fd0240ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02415ae50 con 0x7fd02406c180 2023-09-30T16:49:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0241578a0 con 0x7fd024159df0 2023-09-30T16:49:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02c1a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240ce2f0 con 0x7fd0241574c0 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd02406c180 0x7fd0240ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd02406c180 0x7fd0240ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38342/0 (socket says 172.21.15.52:38342) 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 -- 172.21.15.52:0/3874862212 learned_addr learned my addr 172.21.15.52:0/3874862212 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd029f3d640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0241574c0 0x7fd0240cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 -- 172.21.15.52:0/3874862212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0241574c0 msgr2=0x7fd0240cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02973c640 1 --2- 172.21.15.52:0/3874862212 >> v2:172.21.15.186:3300/0 conn(0x7fd024159df0 0x7fd02406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0241574c0 0x7fd0240cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 -- 172.21.15.52:0/3874862212 >> v2:172.21.15.186:3300/0 conn(0x7fd024159df0 msgr2=0x7fd02406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 --2- 172.21.15.52:0/3874862212 >> v2:172.21.15.186:3300/0 conn(0x7fd024159df0 0x7fd02406bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 -- 172.21.15.52:0/3874862212 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240c9dd0 con 0x7fd02406c180 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02973c640 1 --2- 172.21.15.52:0/3874862212 >> v2:172.21.15.186:3300/0 conn(0x7fd024159df0 0x7fd02406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:43.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd029f3d640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0241574c0 0x7fd0240cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:43.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.158+0000 7fd02a73e640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02406c180 0x7fd0240ca590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd0240cf5c0 tx=0x7fd01c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c823407de4e04d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd028f3b640 1 -- 172.21.15.52:0/3874862212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a5730 con 0x7fd02406c180 2023-09-30T16:49:43.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd028f3b640 1 -- 172.21.15.52:0/3874862212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0a5890 con 0x7fd02406c180 2023-09-30T16:49:43.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd028f3b640 1 -- 172.21.15.52:0/3874862212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a5c20 con 0x7fd02406c180 2023-09-30T16:49:43.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- 172.21.15.52:0/3874862212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02406c180 msgr2=0x7fd0240ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02406c180 0x7fd0240ca590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd0240cf5c0 tx=0x7fd01c01c9a0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- 172.21.15.52:0/3874862212 shutdown_connections 2023-09-30T16:49:43.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02406c180 0x7fd0240ca590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/3874862212 >> v2:172.21.15.186:3300/0 conn(0x7fd024159df0 0x7fd02406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/3874862212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0241574c0 0x7fd0240cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- 172.21.15.52:0/3874862212 >> 172.21.15.52:0/3874862212 conn(0x7fd02406a5f0 msgr2=0x7fd0240ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- 172.21.15.52:0/3874862212 shutdown_connections 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- 172.21.15.52:0/3874862212 wait complete. 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 Processor -- start 2023-09-30T16:49:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- start start 2023-09-30T16:49:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd02406c180 0x7fd0241473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 0x7fd0240c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd024159df0 0x7fd0240b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240c8000 con 0x7fd0241574c0 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024147e50 con 0x7fd024159df0 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02c1a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd024147900 con 0x7fd02406c180 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 0x7fd0240c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 0x7fd0240c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38354/0 (socket says 172.21.15.52:38354) 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 -- 172.21.15.52:0/1869130878 learned_addr learned my addr 172.21.15.52:0/1869130878 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02a73e640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd024159df0 0x7fd0240b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd029f3d640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd02406c180 0x7fd0241473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 -- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd02406c180 msgr2=0x7fd0241473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd02406c180 0x7fd0241473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 -- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd024159df0 msgr2=0x7fd0240b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd024159df0 0x7fd0240b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 -- 172.21.15.52:0/1869130878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c009b30 con 0x7fd0241574c0 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd029f3d640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd02406c180 0x7fd0241473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.162+0000 7fd02973c640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 0x7fd0240c5b70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c7f0 tx=0x7fd01400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0140077c0 con 0x7fd0241574c0 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014007920 con 0x7fd0241574c0 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd024158740 con 0x7fd0241574c0 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014007cd0 con 0x7fd0241574c0 2023-09-30T16:49:43.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0241580f0 con 0x7fd0241574c0 2023-09-30T16:49:43.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0241588d0 con 0x7fd0241574c0 2023-09-30T16:49:43.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd0140113f0 con 0x7fd0241574c0 2023-09-30T16:49:43.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd01a7fc640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd008066160 0x7fd008068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd014083cb0 con 0x7fd0241574c0 2023-09-30T16:49:43.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd029f3d640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd008066160 0x7fd008068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.166+0000 7fd029f3d640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd008066160 0x7fd008068620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd020008890 tx=0x7fd020008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.170+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd0140512d0 con 0x7fd0241574c0 2023-09-30T16:49:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.326+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0240ca040 con 0x7fd0241574c0 2023-09-30T16:49:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.326+0000 7fd01a7fc640 1 -- 172.21.15.52:0/1869130878 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fd0140548f0 con 0x7fd0241574c0 2023-09-30T16:49:43.330 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:43.330 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd008066160 msgr2=0x7fd008068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd008066160 0x7fd008068620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd020008890 tx=0x7fd020008040 comp rx=0 tx=0).stop 2023-09-30T16:49:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 msgr2=0x7fd0240c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 0x7fd0240c5b70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c7f0 tx=0x7fd01400ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 shutdown_connections 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd008066160 0x7fd008068620 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd024159df0 0x7fd0240b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0241574c0 0x7fd0240c5b70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 --2- 172.21.15.52:0/1869130878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd02406c180 0x7fd0241473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 >> 172.21.15.52:0/1869130878 conn(0x7fd02406a5f0 msgr2=0x7fd024155520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 shutdown_connections 2023-09-30T16:49:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.330+0000 7fd02c1a1640 1 -- 172.21.15.52:0/1869130878 wait complete. 2023-09-30T16:49:43.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:43.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73ab82640 1 Processor -- start 2023-09-30T16:49:43.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73ab82640 1 -- start start 2023-09-30T16:49:43.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73ab82640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7340c9d20 0x7fa734070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73ab82640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73415d3a0 con 0x7fa7340ca1a0 2023-09-30T16:49:43.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73ab82640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73406db80 con 0x7fa734159780 2023-09-30T16:49:43.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73ab82640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7340cd740 con 0x7fa7340c9d20 2023-09-30T16:49:43.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa733fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7340c9d20 0x7fa734070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa733fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7340c9d20 0x7fa734070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38368/0 (socket says 172.21.15.52:38368) 2023-09-30T16:49:43.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa73911f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa7340ca1a0 0x7fa73415d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37898/0 (socket says 172.21.15.52:37898) 2023-09-30T16:49:43.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa733fff640 1 -- 172.21.15.52:0/3255490063 learned_addr learned my addr 172.21.15.52:0/3255490063 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:43.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa733fff640 1 -- 172.21.15.52:0/3255490063 >> v1:172.21.15.186:6789/0 conn(0x7fa734159780 legacy=0x7fa73406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:43.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa733fff640 1 -- 172.21.15.52:0/3255490063 >> v1:172.21.15.52:6789/0 conn(0x7fa7340ca1a0 legacy=0x7fa73415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.470+0000 7fa733fff640 1 -- 172.21.15.52:0/3255490063 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7340cda20 con 0x7fa7340c9d20 2023-09-30T16:49:43.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa733fff640 1 --2- 172.21.15.52:0/3255490063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734070070 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa728009870 tx=0x7fa72801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7553dee3d54f9f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa7337fe640 1 -- 172.21.15.52:0/3255490063 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728004230 con 0x7fa7340c9d20 2023-09-30T16:49:43.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa7337fe640 1 -- 172.21.15.52:0/3255490063 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280a7050 con 0x7fa7340c9d20 2023-09-30T16:49:43.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa7337fe640 1 -- 172.21.15.52:0/3255490063 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728003620 con 0x7fa7340c9d20 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- 172.21.15.52:0/3255490063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 msgr2=0x7fa734070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 --2- 172.21.15.52:0/3255490063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734070070 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa728009870 tx=0x7fa72801c440 comp rx=0 tx=0).stop 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- 172.21.15.52:0/3255490063 shutdown_connections 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 --2- 172.21.15.52:0/3255490063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734070070 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- 172.21.15.52:0/3255490063 >> 172.21.15.52:0/3255490063 conn(0x7fa73406a5c0 msgr2=0x7fa7340ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- 172.21.15.52:0/3255490063 shutdown_connections 2023-09-30T16:49:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- 172.21.15.52:0/3255490063 wait complete. 2023-09-30T16:49:43.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 Processor -- start 2023-09-30T16:49:43.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- start start 2023-09-30T16:49:43.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7340ca1a0 0x7fa7340bc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa734159780 0x7fa7340bc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414d980 con 0x7fa7340c9d20 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414dc60 con 0x7fa734159780 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73ab82640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414df40 con 0x7fa7340ca1a0 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38378/0 (socket says 172.21.15.52:38378) 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 -- 172.21.15.52:0/858544208 learned_addr learned my addr 172.21.15.52:0/858544208 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73911f640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa734159780 0x7fa7340bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 -- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7340ca1a0 msgr2=0x7fa7340bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7340ca1a0 0x7fa7340bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 -- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa734159780 msgr2=0x7fa7340bc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa734159780 0x7fa7340bc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.474+0000 7fa73891e640 1 -- 172.21.15.52:0/858544208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280094d0 con 0x7fa7340c9d20 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa73891e640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734148260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b410 tx=0x7fa72400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724004020 con 0x7fa7340c9d20 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724004180 con 0x7fa7340c9d20 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73414e220 con 0x7fa7340c9d20 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724011630 con 0x7fa7340c9d20 2023-09-30T16:49:43.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7341487a0 con 0x7fa7340c9d20 2023-09-30T16:49:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7341489f0 con 0x7fa7340c9d20 2023-09-30T16:49:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa724011790 con 0x7fa7340c9d20 2023-09-30T16:49:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa7317fa640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa720066190 0x7fa720068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa724083800 con 0x7fa7340c9d20 2023-09-30T16:49:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa733fff640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa720066190 0x7fa720068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.478+0000 7fa733fff640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa720066190 0x7fa720068650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7280ad000 tx=0x7fa728004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.482+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fa724050d90 con 0x7fa7340c9d20 2023-09-30T16:49:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.638+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7340740a0 con 0x7fa7340c9d20 2023-09-30T16:49:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.638+0000 7fa7317fa640 1 -- 172.21.15.52:0/858544208 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa724015020 con 0x7fa7340c9d20 2023-09-30T16:49:43.641 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa720066190 msgr2=0x7fa720068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa720066190 0x7fa720068650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7280ad000 tx=0x7fa728004740 comp rx=0 tx=0).stop 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 msgr2=0x7fa734148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734148260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b410 tx=0x7fa72400b8d0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 shutdown_connections 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa720066190 0x7fa720068650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa734159780 0x7fa7340bc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7340ca1a0 0x7fa7340bc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 --2- 172.21.15.52:0/858544208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7340c9d20 0x7fa734148260 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 >> 172.21.15.52:0/858544208 conn(0x7fa73406a5c0 msgr2=0x7fa734155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 shutdown_connections 2023-09-30T16:49:43.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.642+0000 7fa73ab82640 1 -- 172.21.15.52:0/858544208 wait complete. 2023-09-30T16:49:43.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:43.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 Processor -- start 2023-09-30T16:49:43.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 -- start start 2023-09-30T16:49:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7b2806b2d0 0x7f7b280ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b280ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b2806f1b0 0x7f7b2815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280ced70 con 0x7f7b2806f1b0 2023-09-30T16:49:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2815ace0 con 0x7f7b2806b2d0 2023-09-30T16:49:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2f652640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c56a0 con 0x7f7b280cb560 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b2806f1b0 0x7f7b2815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b2806f1b0 0x7f7b2815d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38386/0 (socket says 172.21.15.52:38386) 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 -- 172.21.15.52:0/3992986092 learned_addr learned my addr 172.21.15.52:0/3992986092 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2d3ee640 1 --2- 172.21.15.52:0/3992986092 >> v2:172.21.15.186:3300/0 conn(0x7f7b2806b2d0 0x7f7b280ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2cbed640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b280ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 -- 172.21.15.52:0/3992986092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 msgr2=0x7f7b280ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b280ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 -- 172.21.15.52:0/3992986092 >> v2:172.21.15.186:3300/0 conn(0x7f7b2806b2d0 msgr2=0x7f7b280ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 --2- 172.21.15.52:0/3992986092 >> v2:172.21.15.186:3300/0 conn(0x7f7b2806b2d0 0x7f7b280ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2dbef640 1 -- 172.21.15.52:0/3992986092 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280c5980 con 0x7f7b2806f1b0 2023-09-30T16:49:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.790+0000 7f7b2cbed640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b280ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2dbef640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2815d6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b28073d00 tx=0x7f7b2001c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0033a0a27a53a56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b1ffff640 1 -- 172.21.15.52:0/3992986092 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200073f0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b1ffff640 1 -- 172.21.15.52:0/3992986092 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b20007550 con 0x7f7b2806f1b0 2023-09-30T16:49:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b1ffff640 1 -- 172.21.15.52:0/3992986092 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200078e0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- 172.21.15.52:0/3992986092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 msgr2=0x7f7b2815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2815d6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b28073d00 tx=0x7f7b2001c5f0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- 172.21.15.52:0/3992986092 shutdown_connections 2023-09-30T16:49:43.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2815d6b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3992986092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b280ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3992986092 >> v2:172.21.15.186:3300/0 conn(0x7f7b2806b2d0 0x7f7b280ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- 172.21.15.52:0/3992986092 >> 172.21.15.52:0/3992986092 conn(0x7f7b280b0b80 msgr2=0x7f7b280b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- 172.21.15.52:0/3992986092 shutdown_connections 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- 172.21.15.52:0/3992986092 wait complete. 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 Processor -- start 2023-09-30T16:49:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- start start 2023-09-30T16:49:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b2806b2d0 0x7f7b2814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b2806de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280afb80 con 0x7f7b2806f1b0 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280af6f0 con 0x7f7b2806b2d0 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2f652640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280aeae0 con 0x7f7b280cb560 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2cbed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2cbed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2814ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38390/0 (socket says 172.21.15.52:38390) 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.794+0000 7f7b2cbed640 1 -- 172.21.15.52:0/3615042611 learned_addr learned my addr 172.21.15.52:0/3615042611 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2d3ee640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b2806b2d0 0x7f7b2814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2dbef640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b2806de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2cbed640 1 -- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 msgr2=0x7f7b2806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2cbed640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b2806de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2cbed640 1 -- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b2806b2d0 msgr2=0x7f7b2814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2cbed640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b2806b2d0 0x7f7b2814dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2cbed640 1 -- 172.21.15.52:0/3615042611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009b30 con 0x7f7b2806f1b0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2d3ee640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b2806b2d0 0x7f7b2814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2cbed640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2814ba80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c7f0 tx=0x7f7b1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800cea0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18007a30 con 0x7f7b2806f1b0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280aedc0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18007dc0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b280af380 con 0x7f7b2806f1b0 2023-09-30T16:49:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280740a0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7b180113f0 con 0x7f7b2806f1b0 2023-09-30T16:49:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b1dffb640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b0c066190 0x7f7b0c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b18083b30 con 0x7f7b2806f1b0 2023-09-30T16:49:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2d3ee640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b0c066190 0x7f7b0c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.798+0000 7f7b2d3ee640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b0c066190 0x7f7b0c068650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097a0 tx=0x7f7b24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.802+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7b18051150 con 0x7f7b2806f1b0 2023-09-30T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.958+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b2806ef90 con 0x7f7b2806f1b0 2023-09-30T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.958+0000 7f7b1dffb640 1 -- 172.21.15.52:0/3615042611 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b18054770 con 0x7f7b2806f1b0 2023-09-30T16:49:43.961 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b0c066190 msgr2=0x7f7b0c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b0c066190 0x7f7b0c068650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097a0 tx=0x7f7b24008040 comp rx=0 tx=0).stop 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 msgr2=0x7f7b2814ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2814ba80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c7f0 tx=0x7f7b1800ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 shutdown_connections 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b0c066190 0x7f7b0c068650 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b280cb560 0x7f7b2806de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b2806f1b0 0x7f7b2814ba80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 --2- 172.21.15.52:0/3615042611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b2806b2d0 0x7f7b2814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 >> 172.21.15.52:0/3615042611 conn(0x7f7b280b0b80 msgr2=0x7f7b281518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 shutdown_connections 2023-09-30T16:49:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:43.962+0000 7f7b2f652640 1 -- 172.21.15.52:0/3615042611 wait complete. 2023-09-30T16:49:43.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 Processor -- start 2023-09-30T16:49:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 -- start start 2023-09-30T16:49:44.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc89415cc60 0x7fc8940cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc8940d0040 0x7fc8940d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc8940d25b0 0x7fc8940d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940d04a0 con 0x7fc8940d0040 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940d39b0 con 0x7fc8940d25b0 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc89ac58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89415d040 con 0x7fc89415cc60 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc8940d0040 0x7fc8940d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc8940d0040 0x7fc8940d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38396/0 (socket says 172.21.15.52:38396) 2023-09-30T16:49:44.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 -- 172.21.15.52:0/2526985465 learned_addr learned my addr 172.21.15.52:0/2526985465 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc8989f4640 1 --2- 172.21.15.52:0/2526985465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc89415cc60 0x7fc8940cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc8991f5640 1 --2- 172.21.15.52:0/2526985465 >> v2:172.21.15.186:3300/0 conn(0x7fc8940d25b0 0x7fc8940d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 -- 172.21.15.52:0/2526985465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc89415cc60 msgr2=0x7fc8940cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 --2- 172.21.15.52:0/2526985465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc89415cc60 0x7fc8940cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 -- 172.21.15.52:0/2526985465 >> v2:172.21.15.186:3300/0 conn(0x7fc8940d25b0 msgr2=0x7fc8940d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 --2- 172.21.15.52:0/2526985465 >> v2:172.21.15.186:3300/0 conn(0x7fc8940d25b0 0x7fc8940d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 -- 172.21.15.52:0/2526985465 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940d2da0 con 0x7fc8940d0040 2023-09-30T16:49:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc8991f5640 1 --2- 172.21.15.52:0/2526985465 >> v2:172.21.15.186:3300/0 conn(0x7fc8940d25b0 0x7fc8940d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.110+0000 7fc893fff640 1 --2- 172.21.15.52:0/2526985465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8940d0040 0x7fc8940d2070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc8940b2550 tx=0x7fc87c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8c50dc03f0b3f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8937fe640 1 -- 172.21.15.52:0/2526985465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0ab600 con 0x7fc8940d0040 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8937fe640 1 -- 172.21.15.52:0/2526985465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c0a7050 con 0x7fc8940d0040 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8937fe640 1 -- 172.21.15.52:0/2526985465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0ab980 con 0x7fc8940d0040 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2526985465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8940d0040 msgr2=0x7fc8940d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2526985465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8940d0040 0x7fc8940d2070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc8940b2550 tx=0x7fc87c01c210 comp rx=0 tx=0).stop 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2526985465 shutdown_connections 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2526985465 >> v2:172.21.15.186:3300/0 conn(0x7fc8940d25b0 0x7fc8940d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2526985465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8940d0040 0x7fc8940d2070 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2526985465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc89415cc60 0x7fc8940cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2526985465 >> 172.21.15.52:0/2526985465 conn(0x7fc894071930 msgr2=0x7fc894071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2526985465 shutdown_connections 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2526985465 wait complete. 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 Processor -- start 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- start start 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8940d0040 0x7fc894151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8940d25b0 0x7fc894152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 0x7fc8941534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940c72f0 con 0x7fc89415cc60 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89414fda0 con 0x7fc8940d25b0 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894155c20 con 0x7fc8940d0040 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 0x7fc8941534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 0x7fc8941534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38406/0 (socket says 172.21.15.52:38406) 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 -- 172.21.15.52:0/2045006201 learned_addr learned my addr 172.21.15.52:0/2045006201 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc893fff640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8940d25b0 0x7fc894152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8989f4640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8940d0040 0x7fc894151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 -- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8940d0040 msgr2=0x7fc894151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8940d0040 0x7fc894151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 -- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8940d25b0 msgr2=0x7fc894152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8940d25b0 0x7fc894152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 -- 172.21.15.52:0/2045006201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0094d0 con 0x7fc89415cc60 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8991f5640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 0x7fc8941534a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c7f0 tx=0x7fc88400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884007820 con 0x7fc89415cc60 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840079c0 con 0x7fc89415cc60 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc894155f00 con 0x7fc89415cc60 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884007d70 con 0x7fc89415cc60 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.114+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89414fa40 con 0x7fc89415cc60 2023-09-30T16:49:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.118+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8940c7430 con 0x7fc89415cc60 2023-09-30T16:49:44.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.118+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fc884024480 con 0x7fc89415cc60 2023-09-30T16:49:44.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.118+0000 7fc8917fa640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc874066160 0x7fc874068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.118+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc884084120 con 0x7fc89415cc60 2023-09-30T16:49:44.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.118+0000 7fc8989f4640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc874066160 0x7fc874068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.118+0000 7fc8989f4640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc874066160 0x7fc874068620 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc88c003fd0 tx=0x7fc88c003ce0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.122+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fc884051720 con 0x7fc89415cc60 2023-09-30T16:49:44.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.274+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8940c7430 con 0x7fc89415cc60 2023-09-30T16:49:44.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.274+0000 7fc8917fa640 1 -- 172.21.15.52:0/2045006201 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8940c7430 con 0x7fc89415cc60 2023-09-30T16:49:44.278 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc874066160 msgr2=0x7fc874068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc874066160 0x7fc874068620 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc88c003fd0 tx=0x7fc88c003ce0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 msgr2=0x7fc8941534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 0x7fc8941534a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c7f0 tx=0x7fc88400ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 shutdown_connections 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fc874066160 0x7fc874068620 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc89415cc60 0x7fc8941534a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8940d25b0 0x7fc894152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 --2- 172.21.15.52:0/2045006201 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8940d0040 0x7fc894151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 >> 172.21.15.52:0/2045006201 conn(0x7fc894071930 msgr2=0x7fc89415be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 shutdown_connections 2023-09-30T16:49:44.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.278+0000 7fc89ac58640 1 -- 172.21.15.52:0/2045006201 wait complete. 2023-09-30T16:49:44.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 Processor -- start 2023-09-30T16:49:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 -- start start 2023-09-30T16:49:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f43dc06b920 0x7f43dc161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0cd140 0x7f43dc06bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43dc0b0ab0 0x7f43dc0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc161780 con 0x7f43dc0b0ab0 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc06b430 con 0x7f43dc06b920 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43e0e7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc06c240 con 0x7f43dc0cd140 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43dc0b0ab0 0x7f43dc0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43dc0b0ab0 0x7f43dc0b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38414/0 (socket says 172.21.15.52:38414) 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 -- 172.21.15.52:0/3520699342 learned_addr learned my addr 172.21.15.52:0/3520699342 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43d9d9b640 1 --2- 172.21.15.52:0/3520699342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0cd140 0x7f43dc06bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43da59c640 1 --2- 172.21.15.52:0/3520699342 >> v2:172.21.15.186:3300/0 conn(0x7f43dc06b920 0x7f43dc161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 -- 172.21.15.52:0/3520699342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0cd140 msgr2=0x7f43dc06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 --2- 172.21.15.52:0/3520699342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0cd140 0x7f43dc06bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 -- 172.21.15.52:0/3520699342 >> v2:172.21.15.186:3300/0 conn(0x7f43dc06b920 msgr2=0x7f43dc161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 --2- 172.21.15.52:0/3520699342 >> v2:172.21.15.186:3300/0 conn(0x7f43dc06b920 0x7f43dc161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.422+0000 7f43dad9d640 1 -- 172.21.15.52:0/3520699342 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0d1500 con 0x7f43dc0b0ab0 2023-09-30T16:49:44.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43dad9d640 1 --2- 172.21.15.52:0/3520699342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc0b0ab0 0x7f43dc0b0f00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43dc08a580 tx=0x7f43d401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c1d06e5fb09094 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43d959a640 1 -- 172.21.15.52:0/3520699342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40a57c0 con 0x7f43dc0b0ab0 2023-09-30T16:49:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43d959a640 1 -- 172.21.15.52:0/3520699342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40a5920 con 0x7f43dc0b0ab0 2023-09-30T16:49:44.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43d959a640 1 -- 172.21.15.52:0/3520699342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40a5cb0 con 0x7f43dc0b0ab0 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- 172.21.15.52:0/3520699342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc0b0ab0 msgr2=0x7f43dc0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/3520699342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc0b0ab0 0x7f43dc0b0f00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43dc08a580 tx=0x7f43d401c940 comp rx=0 tx=0).stop 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- 172.21.15.52:0/3520699342 shutdown_connections 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/3520699342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc0b0ab0 0x7f43dc0b0f00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/3520699342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0cd140 0x7f43dc06bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/3520699342 >> v2:172.21.15.186:3300/0 conn(0x7f43dc06b920 0x7f43dc161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- 172.21.15.52:0/3520699342 >> 172.21.15.52:0/3520699342 conn(0x7f43dc089ff0 msgr2=0x7f43dc099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- 172.21.15.52:0/3520699342 shutdown_connections 2023-09-30T16:49:44.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- 172.21.15.52:0/3520699342 wait complete. 2023-09-30T16:49:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 Processor -- start 2023-09-30T16:49:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- start start 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 0x7f43dc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0b0ab0 0x7f43dc155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43dc0b56b0 0x7f43dc15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0b6370 con 0x7f43dc06b920 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc15b6b0 con 0x7f43dc0b56b0 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43e0e7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0b6090 con 0x7f43dc0b0ab0 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43da59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 0x7f43dc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43da59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 0x7f43dc15bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38424/0 (socket says 172.21.15.52:38424) 2023-09-30T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43da59c640 1 -- 172.21.15.52:0/721001203 learned_addr learned my addr 172.21.15.52:0/721001203 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43d9d9b640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0b0ab0 0x7f43dc155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.426+0000 7f43dad9d640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43dc0b56b0 0x7f43dc15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43da59c640 1 -- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0b0ab0 msgr2=0x7f43dc155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43da59c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0b0ab0 0x7f43dc155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43da59c640 1 -- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43dc0b56b0 msgr2=0x7f43dc15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43da59c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43dc0b56b0 0x7f43dc15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43da59c640 1 -- 172.21.15.52:0/721001203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009b30 con 0x7f43dc06b920 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43da59c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 0x7f43dc15bb40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43d000d800 tx=0x7f43d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00096a0 con 0x7f43dc06b920 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d0009800 con 0x7f43dc06b920 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0009bb0 con 0x7f43dc06b920 2023-09-30T16:49:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc15b060 con 0x7f43dc06b920 2023-09-30T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc15c080 con 0x7f43dc06b920 2023-09-30T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc0740a0 con 0x7f43dc06b920 2023-09-30T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f43d0009d10 con 0x7f43dc06b920 2023-09-30T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43caffd640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f43bc066190 0x7f43bc068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43d0083db0 con 0x7f43dc06b920 2023-09-30T16:49:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43d9d9b640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f43bc066190 0x7f43bc068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.430+0000 7f43d9d9b640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f43bc066190 0x7f43bc068650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f43dc15def0 tx=0x7f43cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.434+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f43d0051460 con 0x7f43dc06b920 2023-09-30T16:49:44.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.590+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43dc0affe0 con 0x7f43dc06b920 2023-09-30T16:49:44.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.590+0000 7f43caffd640 1 -- 172.21.15.52:0/721001203 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f43d0054a80 con 0x7f43dc06b920 2023-09-30T16:49:44.594 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:44.594 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f43bc066190 msgr2=0x7f43bc068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f43bc066190 0x7f43bc068650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f43dc15def0 tx=0x7f43cc008040 comp rx=0 tx=0).stop 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 msgr2=0x7f43dc15bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 0x7f43dc15bb40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43d000d800 tx=0x7f43d000dcc0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 shutdown_connections 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f43bc066190 0x7f43bc068650 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43dc0b56b0 0x7f43dc15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43dc0b0ab0 0x7f43dc155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 --2- 172.21.15.52:0/721001203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43dc06b920 0x7f43dc15bb40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 >> 172.21.15.52:0/721001203 conn(0x7f43dc089ff0 msgr2=0x7f43dc0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:44.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 shutdown_connections 2023-09-30T16:49:44.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.594+0000 7f43e0e7c640 1 -- 172.21.15.52:0/721001203 wait complete. 2023-09-30T16:49:44.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:44.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:44.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 Processor -- start 2023-09-30T16:49:44.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 -- start start 2023-09-30T16:49:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51a4159b70 0x7f51a40cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f51a40b4f50 0x7f51a40ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40ceb30 0x7f51a406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40ce290 con 0x7f51a4159b70 2023-09-30T16:49:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40cefc0 con 0x7f51a40b4f50 2023-09-30T16:49:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a9f4d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40cb700 con 0x7f51a40ceb30 2023-09-30T16:49:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51a4159b70 0x7f51a40cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51a4159b70 0x7f51a40cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38436/0 (socket says 172.21.15.52:38436) 2023-09-30T16:49:44.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 -- 172.21.15.52:0/3775138112 learned_addr learned my addr 172.21.15.52:0/3775138112 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 -- 172.21.15.52:0/3775138112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40ceb30 msgr2=0x7f51a406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 --2- 172.21.15.52:0/3775138112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40ceb30 0x7f51a406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a2ffd640 1 --2- 172.21.15.52:0/3775138112 >> v2:172.21.15.186:3300/0 conn(0x7f51a40b4f50 0x7f51a40ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 -- 172.21.15.52:0/3775138112 >> v2:172.21.15.186:3300/0 conn(0x7f51a40b4f50 msgr2=0x7f51a40ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 --2- 172.21.15.52:0/3775138112 >> v2:172.21.15.186:3300/0 conn(0x7f51a40b4f50 0x7f51a40ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a37fe640 1 -- 172.21.15.52:0/3775138112 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4159f50 con 0x7f51a4159b70 2023-09-30T16:49:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.730+0000 7f51a2ffd640 1 --2- 172.21.15.52:0/3775138112 >> v2:172.21.15.186:3300/0 conn(0x7f51a40b4f50 0x7f51a40ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a37fe640 1 --2- 172.21.15.52:0/3775138112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a4159b70 0x7f51a40cdd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f51a415d5b0 tx=0x7f519401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6c3b53a3a8f85e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a27fc640 1 -- 172.21.15.52:0/3775138112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940a89b0 con 0x7f51a4159b70 2023-09-30T16:49:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a27fc640 1 -- 172.21.15.52:0/3775138112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51940a8b10 con 0x7f51a4159b70 2023-09-30T16:49:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a27fc640 1 -- 172.21.15.52:0/3775138112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940a8ea0 con 0x7f51a4159b70 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- 172.21.15.52:0/3775138112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a4159b70 msgr2=0x7f51a40cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/3775138112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a4159b70 0x7f51a40cdd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f51a415d5b0 tx=0x7f519401ecf0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- 172.21.15.52:0/3775138112 shutdown_connections 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/3775138112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40ceb30 0x7f51a406ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/3775138112 >> v2:172.21.15.186:3300/0 conn(0x7f51a40b4f50 0x7f51a40ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/3775138112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a4159b70 0x7f51a40cdd50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- 172.21.15.52:0/3775138112 >> 172.21.15.52:0/3775138112 conn(0x7f51a406d320 msgr2=0x7f51a406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:44.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- 172.21.15.52:0/3775138112 shutdown_connections 2023-09-30T16:49:44.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- 172.21.15.52:0/3775138112 wait complete. 2023-09-30T16:49:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 Processor -- start 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- start start 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40b4f50 0x7f51a4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 0x7f51a40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4159b70 0x7f51a40acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40ad8c0 con 0x7f51a40ceb30 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40b2530 con 0x7f51a4159b70 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a9f4d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40ad5e0 con 0x7f51a40b4f50 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 0x7f51a40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 0x7f51a40b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38444/0 (socket says 172.21.15.52:38444) 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 -- 172.21.15.52:0/2966202283 learned_addr learned my addr 172.21.15.52:0/2966202283 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a3fff640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4159b70 0x7f51a40acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a37fe640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40b4f50 0x7f51a4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 -- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40b4f50 msgr2=0x7f51a4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40b4f50 0x7f51a4151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 -- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4159b70 msgr2=0x7f51a40acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4159b70 0x7f51a40acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a2ffd640 1 -- 172.21.15.52:0/2966202283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51940094d0 con 0x7f51a40ceb30 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.734+0000 7f51a3fff640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4159b70 0x7f51a40acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f51a2ffd640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 0x7f51a40b2fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f519800c7f0 tx=0x7f519800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198007820 con 0x7f51a40ceb30 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198007980 con 0x7f51a40ceb30 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a40b27d0 con 0x7f51a40ceb30 2023-09-30T16:49:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198007d30 con 0x7f51a40ceb30 2023-09-30T16:49:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a4152030 con 0x7f51a40ceb30 2023-09-30T16:49:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a406fbf0 con 0x7f51a40ceb30 2023-09-30T16:49:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f51980113f0 con 0x7f51a40ceb30 2023-09-30T16:49:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f518bfff640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5190066190 0x7f5190068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5198083d40 con 0x7f51a40ceb30 2023-09-30T16:49:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f51a37fe640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5190066190 0x7f5190068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.738+0000 7f51a37fe640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5190066190 0x7f5190068650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51940b2000 tx=0x7f51940aa070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.742+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5198051360 con 0x7f51a40ceb30 2023-09-30T16:49:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.890+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51a40b2390 con 0x7f51a40ceb30 2023-09-30T16:49:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.890+0000 7f518bfff640 1 -- 172.21.15.52:0/2966202283 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51a40b2390 con 0x7f51a40ceb30 2023-09-30T16:49:44.892 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5190066190 msgr2=0x7f5190068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5190066190 0x7f5190068650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51940b2000 tx=0x7f51940aa070 comp rx=0 tx=0).stop 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 msgr2=0x7f51a40b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 0x7f51a40b2fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f519800c7f0 tx=0x7f519800ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 shutdown_connections 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5190066190 0x7f5190068650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4159b70 0x7f51a40acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51a40ceb30 0x7f51a40b2fd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 --2- 172.21.15.52:0/2966202283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a40b4f50 0x7f51a4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 >> 172.21.15.52:0/2966202283 conn(0x7f51a406d320 msgr2=0x7f51a40b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 shutdown_connections 2023-09-30T16:49:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:44.894+0000 7f51a9f4d640 1 -- 172.21.15.52:0/2966202283 wait complete. 2023-09-30T16:49:44.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:45.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9295e9e640 1 Processor -- start 2023-09-30T16:49:45.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9295e9e640 1 -- start start 2023-09-30T16:49:45.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9295e9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f929006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9295e9e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929015d3a0 con 0x7f9290070070 2023-09-30T16:49:45.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9295e9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92900cd740 con 0x7f929006d9b0 2023-09-30T16:49:45.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9295e9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900cda20 con 0x7f9290159780 2023-09-30T16:49:45.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9290070070 0x7f929015d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37908/0 (socket says 172.21.15.52:37908) 2023-09-30T16:49:45.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928ffff640 1 -- 172.21.15.52:0/445566415 learned_addr learned my addr 172.21.15.52:0/445566415 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928f7fe640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f929006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743077622 0 0) 0x7f929015d3a0 con 0x7f9290070070 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f927c003530 con 0x7f9290070070 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 591625834 0 0) 0x7f927c003530 con 0x7f9290070070 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 msgr2=0x7f929006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f929006d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 >> v1:172.21.15.186:6789/0 conn(0x7f929006d9b0 legacy=0x7f92900c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900cdd00 con 0x7f9290070070 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f9288001a00 con 0x7f9290070070 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 >> v1:172.21.15.52:6789/0 conn(0x7f9290070070 legacy=0x7f929015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c0039b0 0x7f927c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f927c0047d0 0x7f927c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f927c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900cda20 con 0x7f927c0047d0 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c00bac0 con 0x7f927c0039b0 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c00de90 con 0x7f9290159780 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9287fff640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f927c0047d0 0x7f927c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928ffff640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f927c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928f7fe640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c0039b0 0x7f927c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9287fff640 1 -- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 msgr2=0x7f927c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9287fff640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f927c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9287fff640 1 -- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c0039b0 msgr2=0x7f927c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9287fff640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c0039b0 0x7f927c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f9287fff640 1 -- 172.21.15.52:0/445566415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c003530 con 0x7f927c0047d0 2023-09-30T16:49:45.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.034+0000 7f928ffff640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290159780 0x7f927c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9287fff640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f927c0047d0 0x7f927c004c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9278001780 tx=0x7f927801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee7af4cfdad749c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780052d0 con 0x7f927c0047d0 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780a7050 con 0x7f927c0047d0 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f928effd640 1 -- 172.21.15.52:0/445566415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278003600 con 0x7f927c0047d0 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 -- 172.21.15.52:0/445566415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f927c0047d0 msgr2=0x7f927c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 --2- 172.21.15.52:0/445566415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f927c0047d0 0x7f927c004c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9278001780 tx=0x7f927801c3d0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f928ffff640 1 -- 172.21.15.52:0/445566415 reap_dead start 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 -- 172.21.15.52:0/445566415 shutdown_connections 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 -- 172.21.15.52:0/445566415 >> 172.21.15.52:0/445566415 conn(0x7f929006a5c0 msgr2=0x7f92900ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 -- 172.21.15.52:0/445566415 shutdown_connections 2023-09-30T16:49:45.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 -- 172.21.15.52:0/445566415 wait complete. 2023-09-30T16:49:45.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 Processor -- start 2023-09-30T16:49:45.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.038+0000 7f9295e9e640 1 -- start start 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9290154f30 0x7f92900ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 0x7f929015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92900b4060 0x7f929015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b2480 con 0x7f92900b3240 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b2760 con 0x7f9290154f30 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900b2a40 con 0x7f92900b4060 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 0x7f929015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 0x7f929015c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38466/0 (socket says 172.21.15.52:38466) 2023-09-30T16:49:45.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 -- 172.21.15.52:0/3157717693 learned_addr learned my addr 172.21.15.52:0/3157717693 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928ffff640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92900b4060 0x7f929015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928f7fe640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9290154f30 0x7f92900ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 -- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92900b4060 msgr2=0x7f929015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92900b4060 0x7f929015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 -- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9290154f30 msgr2=0x7f92900ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9290154f30 0x7f92900ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 -- 172.21.15.52:0/3157717693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900b2d20 con 0x7f92900b3240 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928ffff640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92900b4060 0x7f929015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928f7fe640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9290154f30 0x7f92900ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9287fff640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 0x7f929015c050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f927801cc70 tx=0x7f927c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278007230 con 0x7f92900b3240 2023-09-30T16:49:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278007390 con 0x7f92900b3240 2023-09-30T16:49:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92900adce0 con 0x7f92900b3240 2023-09-30T16:49:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780067e0 con 0x7f92900b3240 2023-09-30T16:49:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9290155310 con 0x7f92900b3240 2023-09-30T16:49:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900b2eb0 con 0x7f92900b3240 2023-09-30T16:49:45.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f9278006940 con 0x7f92900b3240 2023-09-30T16:49:45.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928cff9640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9270066160 0x7f9270068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f927811da70 con 0x7f92900b3240 2023-09-30T16:49:45.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.042+0000 7f928f7fe640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9270066160 0x7f9270068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.046+0000 7f928f7fe640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9270066160 0x7f9270068620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9280009a20 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.046+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f92780eb120 con 0x7f92900b3240 2023-09-30T16:49:45.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.198+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92900b25c0 con 0x7f92900b3240 2023-09-30T16:49:45.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f928cff9640 1 -- 172.21.15.52:0/3157717693 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92900b25c0 con 0x7f92900b3240 2023-09-30T16:49:45.202 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9270066160 msgr2=0x7f9270068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9270066160 0x7f9270068620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9280009a20 tx=0x7f9280008040 comp rx=0 tx=0).stop 2023-09-30T16:49:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 msgr2=0x7f929015c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 0x7f929015c050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f927801cc70 tx=0x7f927c005800 comp rx=0 tx=0).stop 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 shutdown_connections 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9270066160 0x7f9270068620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92900b4060 0x7f929015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92900b3240 0x7f929015c050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 --2- 172.21.15.52:0/3157717693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9290154f30 0x7f92900ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 >> 172.21.15.52:0/3157717693 conn(0x7f929006a5c0 msgr2=0x7f92900c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 shutdown_connections 2023-09-30T16:49:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.202+0000 7f9295e9e640 1 -- 172.21.15.52:0/3157717693 wait complete. 2023-09-30T16:49:45.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:45.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95aff46640 1 Processor -- start 2023-09-30T16:49:45.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95aff46640 1 -- start start 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95aff46640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f95a815c9a0 0x7f95a8160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95aff46640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a8161530 con 0x7f95a80b1b50 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95aff46640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80d1700 con 0x7f95a80cda60 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95aff46640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80b2430 con 0x7f95a815c9a0 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95ad4e1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f95a80b1b50 0x7f95a80cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39346/0 (socket says 172.21.15.52:39346) 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95ad4e1640 1 -- 172.21.15.52:0/722338693 learned_addr learned my addr 172.21.15.52:0/722338693 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 --2- 172.21.15.52:0/722338693 >> v2:172.21.15.186:3300/0 conn(0x7f95a815c9a0 0x7f95a8160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669822248 0 0) 0x7f959c001120 con 0x7f95a80b1b50 2023-09-30T16:49:45.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9590003530 con 0x7f95a80b1b50 2023-09-30T16:49:45.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149837341 0 0) 0x7f95a80d1700 con 0x7f95a80cda60 2023-09-30T16:49:45.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c001120 con 0x7f95a80cda60 2023-09-30T16:49:45.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45559950 0 0) 0x7f9590003530 con 0x7f95a80b1b50 2023-09-30T16:49:45.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 >> v2:172.21.15.186:3300/0 conn(0x7f95a815c9a0 msgr2=0x7f95a8160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 --2- 172.21.15.52:0/722338693 >> v2:172.21.15.186:3300/0 conn(0x7f95a815c9a0 0x7f95a8160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 >> v1:172.21.15.186:6789/0 conn(0x7f95a80cda60 legacy=0x7f95a80d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80d0af0 con 0x7f95a80b1b50 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f959c001810 con 0x7f95a80b1b50 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 >> v1:172.21.15.52:6789/0 conn(0x7f95a80b1b50 legacy=0x7f95a80cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9590003b10 0x7f9590003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95900047d0 0x7f9590004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590005190 0x7f959000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80b2430 con 0x7f9590003b10 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959000c010 con 0x7f95900047d0 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959000c1d0 con 0x7f9590005190 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9590003b10 0x7f9590003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95ad4e1640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95900047d0 0x7f9590004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95ae4e3640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590005190 0x7f959000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 -- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590005190 msgr2=0x7f959000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590005190 0x7f959000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 -- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95900047d0 msgr2=0x7f9590004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95900047d0 0x7f9590004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95adce2640 1 -- 172.21.15.52:0/722338693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590003530 con 0x7f9590003b10 2023-09-30T16:49:45.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.350+0000 7f95ae4e3640 1 -- 172.21.15.52:0/722338693 reap_dead start 2023-09-30T16:49:45.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95adce2640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9590003b10 0x7f9590003f10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009fc0 tx=0x7f95a001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dfc4679432842a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a00a58e0 con 0x7f9590003b10 2023-09-30T16:49:45.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000f040 con 0x7f9590003b10 2023-09-30T16:49:45.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95acce0640 1 -- 172.21.15.52:0/722338693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a00a5c80 con 0x7f9590003b10 2023-09-30T16:49:45.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 -- 172.21.15.52:0/722338693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9590003b10 msgr2=0x7f9590003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9590003b10 0x7f9590003f10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009fc0 tx=0x7f95a001cc20 comp rx=0 tx=0).stop 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 -- 172.21.15.52:0/722338693 shutdown_connections 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 --2- 172.21.15.52:0/722338693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9590003b10 0x7f9590003f10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 -- 172.21.15.52:0/722338693 >> 172.21.15.52:0/722338693 conn(0x7f95a8071930 msgr2=0x7f95a8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 -- 172.21.15.52:0/722338693 shutdown_connections 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.354+0000 7f95aff46640 1 -- 172.21.15.52:0/722338693 wait complete. 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 Processor -- start 2023-09-30T16:49:45.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- start start 2023-09-30T16:49:45.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590003b10 0x7f95a81f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a8148d80 0x7f95a80c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 0x7f95a80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a81f8d60 con 0x7f95a80cc8e0 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80ca410 con 0x7f95a8148d80 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cbb20 con 0x7f9590003b10 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 0x7f95a80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 0x7f95a80b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58618/0 (socket says 172.21.15.52:58618) 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 -- 172.21.15.52:0/220329405 learned_addr learned my addr 172.21.15.52:0/220329405 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95adce2640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590003b10 0x7f95a81f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ad4e1640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a8148d80 0x7f95a80c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 -- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590003b10 msgr2=0x7f95a81f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590003b10 0x7f95a81f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 -- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a8148d80 msgr2=0x7f95a80c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a8148d80 0x7f95a80c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 -- 172.21.15.52:0/220329405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80cbe00 con 0x7f95a80cc8e0 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95adce2640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590003b10 0x7f95a81f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95ae4e3640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 0x7f95a80b6cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9590004750 tx=0x7f959800d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800b070 con 0x7f95a80cc8e0 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598003600 con 0x7f95a80cc8e0 2023-09-30T16:49:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598005500 con 0x7f95a80cc8e0 2023-09-30T16:49:45.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80cc0e0 con 0x7f95a80cc8e0 2023-09-30T16:49:45.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80ca100 con 0x7f95a80cc8e0 2023-09-30T16:49:45.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.358+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a80740a0 con 0x7f95a80cc8e0 2023-09-30T16:49:45.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.362+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f95980039b0 con 0x7f95a80cc8e0 2023-09-30T16:49:45.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.362+0000 7f95a67fc640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9594066190 0x7f9594068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.362+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9598083090 con 0x7f95a80cc8e0 2023-09-30T16:49:45.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.362+0000 7f95adce2640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9594066190 0x7f9594068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.362+0000 7f95adce2640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9594066190 0x7f9594068650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95a00af000 tx=0x7f95a00a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.366+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f9598050610 con 0x7f95a80cc8e0 2023-09-30T16:49:45.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95a80b2210 con 0x7f95a80cc8e0 2023-09-30T16:49:45.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95a67fc640 1 -- 172.21.15.52:0/220329405 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9598053c30 con 0x7f95a80cc8e0 2023-09-30T16:49:45.523 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:45.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9594066190 msgr2=0x7f9594068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9594066190 0x7f9594068650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95a00af000 tx=0x7f95a00a7040 comp rx=0 tx=0).stop 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 msgr2=0x7f95a80b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 0x7f95a80b6cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9590004750 tx=0x7f959800d7c0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 shutdown_connections 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9594066190 0x7f9594068650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a80cc8e0 0x7f95a80b6cd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95a8148d80 0x7f95a80c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 --2- 172.21.15.52:0/220329405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9590003b10 0x7f95a81f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 >> 172.21.15.52:0/220329405 conn(0x7f95a8071930 msgr2=0x7f95a80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 shutdown_connections 2023-09-30T16:49:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.522+0000 7f95aff46640 1 -- 172.21.15.52:0/220329405 wait complete. 2023-09-30T16:49:45.571 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-30T16:49:45.571 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:45.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.690+0000 7f773a33f640 1 Processor -- start 2023-09-30T16:49:45.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.690+0000 7f773a33f640 1 -- start start 2023-09-30T16:49:45.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f773a33f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f773415a9d0 0x7f773415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f773a33f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f773406d650 0x7f77340b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f773a33f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f773a33f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773406c240 con 0x7f773406d650 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f773a33f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773415adb0 con 0x7f773415a9d0 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f773a33f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773415ea90 con 0x7f77340b19b0 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f773406d650 0x7f77340b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f773406d650 0x7f77340b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58628/0 (socket says 172.21.15.52:58628) 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 -- 172.21.15.52:0/1396569715 learned_addr learned my addr 172.21.15.52:0/1396569715 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f7733fff640 1 --2- 172.21.15.52:0/1396569715 >> v2:172.21.15.186:3300/0 conn(0x7f773415a9d0 0x7f773415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77388dc640 1 --2- 172.21.15.52:0/1396569715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 -- 172.21.15.52:0/1396569715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 msgr2=0x7f77340b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 --2- 172.21.15.52:0/1396569715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 -- 172.21.15.52:0/1396569715 >> v2:172.21.15.186:3300/0 conn(0x7f773415a9d0 msgr2=0x7f773415e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 --2- 172.21.15.52:0/1396569715 >> v2:172.21.15.186:3300/0 conn(0x7f773415a9d0 0x7f773415e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f77337fe640 1 -- 172.21.15.52:0/1396569715 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773415ed70 con 0x7f773406d650 2023-09-30T16:49:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.694+0000 7f7733fff640 1 --2- 172.21.15.52:0/1396569715 >> v2:172.21.15.186:3300/0 conn(0x7f773415a9d0 0x7f773415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:45.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f77337fe640 1 --2- 172.21.15.52:0/1396569715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f77340b1470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77340715f0 tx=0x7f772801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b006830c370f794 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f7732ffd640 1 -- 172.21.15.52:0/1396569715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280ab600 con 0x7f773406d650 2023-09-30T16:49:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f7732ffd640 1 -- 172.21.15.52:0/1396569715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77280a7050 con 0x7f773406d650 2023-09-30T16:49:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f7732ffd640 1 -- 172.21.15.52:0/1396569715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280ab980 con 0x7f773406d650 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 -- 172.21.15.52:0/1396569715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 msgr2=0x7f77340b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 --2- 172.21.15.52:0/1396569715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f77340b1470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77340715f0 tx=0x7f772801c500 comp rx=0 tx=0).stop 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 -- 172.21.15.52:0/1396569715 shutdown_connections 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 --2- 172.21.15.52:0/1396569715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 --2- 172.21.15.52:0/1396569715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f77340b1470 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 --2- 172.21.15.52:0/1396569715 >> v2:172.21.15.186:3300/0 conn(0x7f773415a9d0 0x7f773415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 -- 172.21.15.52:0/1396569715 >> 172.21.15.52:0/1396569715 conn(0x7f773406a5f0 msgr2=0x7f77340ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 -- 172.21.15.52:0/1396569715 shutdown_connections 2023-09-30T16:49:45.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 -- 172.21.15.52:0/1396569715 wait complete. 2023-09-30T16:49:45.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 Processor -- start 2023-09-30T16:49:45.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.698+0000 7f773a33f640 1 -- start start 2023-09-30T16:49:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f7734156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f773415a9d0 0x7f773415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734156740 con 0x7f773406d650 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340c81a0 con 0x7f773415a9d0 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7734154b40 con 0x7f77340b19b0 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f7734156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f7734156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58644/0 (socket says 172.21.15.52:58644) 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 -- 172.21.15.52:0/537331171 learned_addr learned my addr 172.21.15.52:0/537331171 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f77388dc640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f773415a9d0 0x7f773415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f77337fe640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 -- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 msgr2=0x7f77340c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 -- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f773415a9d0 msgr2=0x7f773415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f773415a9d0 0x7f773415d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 -- 172.21.15.52:0/537331171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280094d0 con 0x7f773406d650 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f77388dc640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f773415a9d0 0x7f773415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7733fff640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f7734156200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f772400d800 tx=0x7f772400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77240096c0 con 0x7f773406d650 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724009820 con 0x7f773406d650 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77341f4060 con 0x7f773406d650 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724009bd0 con 0x7f773406d650 2023-09-30T16:49:45.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77341f4620 con 0x7f773406d650 2023-09-30T16:49:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77340740a0 con 0x7f773406d650 2023-09-30T16:49:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7724009d30 con 0x7f773406d650 2023-09-30T16:49:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7730ff9640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7720066160 0x7f7720068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7724084180 con 0x7f773406d650 2023-09-30T16:49:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.702+0000 7f77337fe640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7720066160 0x7f7720068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:45.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.706+0000 7f77337fe640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7720066160 0x7f7720068620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77280ad000 tx=0x7f7728008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:45.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.706+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f77240517a0 con 0x7f773406d650 2023-09-30T16:49:45.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.858+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77340cf0e0 con 0x7f773406d650 2023-09-30T16:49:45.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.858+0000 7f7730ff9640 1 -- 172.21.15.52:0/537331171 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f7724054dc0 con 0x7f773406d650 2023-09-30T16:49:45.862 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:45.862 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7720066160 msgr2=0x7f7720068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7720066160 0x7f7720068620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77280ad000 tx=0x7f7728008040 comp rx=0 tx=0).stop 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 msgr2=0x7f7734156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f7734156200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f772400d800 tx=0x7f772400dcc0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 shutdown_connections 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7720066160 0x7f7720068620 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f773415a9d0 0x7f773415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340b19b0 0x7f77340c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 --2- 172.21.15.52:0/537331171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f773406d650 0x7f7734156200 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 >> 172.21.15.52:0/537331171 conn(0x7f773406a5f0 msgr2=0x7f77340afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 shutdown_connections 2023-09-30T16:49:45.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:45.862+0000 7f773a33f640 1 -- 172.21.15.52:0/537331171 wait complete. 2023-09-30T16:49:45.880 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:45.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:46.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.002+0000 7f7c70e98640 1 Processor -- start 2023-09-30T16:49:46.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c70e98640 1 -- start start 2023-09-30T16:49:46.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c70e98640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c6c06c010 0x7f7c6c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c70e98640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7c6c0b0920 0x7f7c6c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c70e98640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c0b1930 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c70e98640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0b31f0 con 0x7f7c6c06c010 2023-09-30T16:49:46.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c70e98640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0b2210 con 0x7f7c6c0b0920 2023-09-30T16:49:46.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c69d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c6c06c010 0x7f7c6c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c6a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7c6c15cbd0 0x7f7c6c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39352/0 (socket says 172.21.15.52:39352) 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c6a59c640 1 -- 172.21.15.52:0/154759200 learned_addr learned my addr 172.21.15.52:0/154759200 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c6ad9d640 1 --2- 172.21.15.52:0/154759200 >> v2:172.21.15.186:3300/0 conn(0x7f7c6c0b0920 0x7f7c6c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c6959a640 1 -- 172.21.15.52:0/154759200 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554711144 0 0) 0x7f7c6c0b1930 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c6959a640 1 -- 172.21.15.52:0/154759200 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c54003530 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c69d9b640 1 -- 172.21.15.52:0/154759200 >> v2:172.21.15.186:3300/0 conn(0x7f7c6c0b0920 msgr2=0x7f7c6c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c69d9b640 1 --2- 172.21.15.52:0/154759200 >> v2:172.21.15.186:3300/0 conn(0x7f7c6c0b0920 0x7f7c6c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c69d9b640 1 -- 172.21.15.52:0/154759200 >> v1:172.21.15.52:6789/0 conn(0x7f7c6c15cbd0 legacy=0x7f7c6c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c69d9b640 1 -- 172.21.15.52:0/154759200 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0b1650 con 0x7f7c6c06c010 2023-09-30T16:49:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.006+0000 7f7c6ad9d640 1 --2- 172.21.15.52:0/154759200 >> v2:172.21.15.186:3300/0 conn(0x7f7c6c0b0920 0x7f7c6c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:46.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c69d9b640 1 --2- 172.21.15.52:0/154759200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c06c010 0x7f7c6c0b2cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c08af90 tx=0x7f7c6001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fc97d1fcb5a717 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6959a640 1 -- 172.21.15.52:0/154759200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600ac600 con 0x7f7c6c06c010 2023-09-30T16:49:46.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6959a640 1 -- 172.21.15.52:0/154759200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600a8050 con 0x7f7c6c06c010 2023-09-30T16:49:46.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6959a640 1 -- 172.21.15.52:0/154759200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600ac980 con 0x7f7c6c06c010 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/154759200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c06c010 msgr2=0x7f7c6c0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 --2- 172.21.15.52:0/154759200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c06c010 0x7f7c6c0b2cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c08af90 tx=0x7f7c6001c3a0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/154759200 shutdown_connections 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 --2- 172.21.15.52:0/154759200 >> v2:172.21.15.186:3300/0 conn(0x7f7c6c0b0920 0x7f7c6c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 --2- 172.21.15.52:0/154759200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c06c010 0x7f7c6c0b2cb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/154759200 >> 172.21.15.52:0/154759200 conn(0x7f7c6c089ff0 msgr2=0x7f7c6c099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/154759200 shutdown_connections 2023-09-30T16:49:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/154759200 wait complete. 2023-09-30T16:49:46.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 Processor -- start 2023-09-30T16:49:46.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- start start 2023-09-30T16:49:46.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c6c06c010 0x7f7c6c0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c6c0b0920 0x7f7c6c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 0x7f7c6c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c15c400 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c1560c0 con 0x7f7c6c0b0920 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c15c120 con 0x7f7c6c06c010 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 0x7f7c6c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 0x7f7c6c151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58652/0 (socket says 172.21.15.52:58652) 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 -- 172.21.15.52:0/1433305634 learned_addr learned my addr 172.21.15.52:0/1433305634 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6a59c640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c6c06c010 0x7f7c6c0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c69d9b640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c6c0b0920 0x7f7c6c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 -- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c6c06c010 msgr2=0x7f7c6c0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c6c06c010 0x7f7c6c0c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 -- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c6c0b0920 msgr2=0x7f7c6c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c6c0b0920 0x7f7c6c0cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 -- 172.21.15.52:0/1433305634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009420 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c6ad9d640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 0x7f7c6c151d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009fa0 tx=0x7f7c6400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003ba0 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6400f040 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c0c9fb0 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64004030 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.010+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0ca570 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.014+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c0ca760 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.014+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7c64004190 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.014+0000 7f7c5affd640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7c4c066160 0x7f7c4c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.014+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c64083e20 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.014+0000 7f7c6a59c640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7c4c066160 0x7f7c4c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.014+0000 7f7c6a59c640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7c4c066160 0x7f7c4c068620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0011f0 tx=0x7f7c5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.018+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7c64051440 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.186+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c6c0740a0 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.186+0000 7f7c5affd640 1 -- 172.21.15.52:0/1433305634 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c6401a020 con 0x7f7c6c15cbd0 2023-09-30T16:49:46.188 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7c4c066160 msgr2=0x7f7c4c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7c4c066160 0x7f7c4c068620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0011f0 tx=0x7f7c5c009040 comp rx=0 tx=0).stop 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 msgr2=0x7f7c6c151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 0x7f7c6c151d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009fa0 tx=0x7f7c6400d560 comp rx=0 tx=0).stop 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 shutdown_connections 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7c4c066160 0x7f7c4c068620 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c15cbd0 0x7f7c6c151d30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c6c0b0920 0x7f7c6c0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 --2- 172.21.15.52:0/1433305634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c6c06c010 0x7f7c6c0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 >> 172.21.15.52:0/1433305634 conn(0x7f7c6c089ff0 msgr2=0x7f7c6c099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 shutdown_connections 2023-09-30T16:49:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.190+0000 7f7c70e98640 1 -- 172.21.15.52:0/1433305634 wait complete. 2023-09-30T16:49:46.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:46.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 Processor -- start 2023-09-30T16:49:46.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 -- start start 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b4006a510 0x7f7b4006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7b4006f750 0x7f7b400cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4015d0b0 con 0x7f7b4015ccd0 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400cbbc0 con 0x7f7b4006a510 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.330+0000 7f7b44ca0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b40071450 con 0x7f7b4006f750 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b4006a510 0x7f7b4006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b4006a510 0x7f7b4006ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58658/0 (socket says 172.21.15.52:58658) 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 -- 172.21.15.52:0/1016668287 learned_addr learned my addr 172.21.15.52:0/1016668287 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 -- 172.21.15.52:0/1016668287 >> v2:172.21.15.186:3300/0 conn(0x7f7b4006f750 msgr2=0x7f7b400cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:46.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3ed9d640 1 --2- 172.21.15.52:0/1016668287 >> v2:172.21.15.186:3300/0 conn(0x7f7b4006f750 0x7f7b400cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 --2- 172.21.15.52:0/1016668287 >> v2:172.21.15.186:3300/0 conn(0x7f7b4006f750 0x7f7b400cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 -- 172.21.15.52:0/1016668287 >> v1:172.21.15.52:6789/0 conn(0x7f7b4015ccd0 legacy=0x7f7b40069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 -- 172.21.15.52:0/1016668287 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40071730 con 0x7f7b4006a510 2023-09-30T16:49:46.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3ed9d640 1 --2- 172.21.15.52:0/1016668287 >> v2:172.21.15.186:3300/0 conn(0x7f7b4006f750 0x7f7b400cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3dd9b640 1 --2- 172.21.15.52:0/1016668287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b4006ef90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7b400cf330 tx=0x7f7b3001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1f7399634259c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3d59a640 1 -- 172.21.15.52:0/1016668287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300ad680 con 0x7f7b4006a510 2023-09-30T16:49:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3d59a640 1 -- 172.21.15.52:0/1016668287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300ad7e0 con 0x7f7b4006a510 2023-09-30T16:49:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b3d59a640 1 -- 172.21.15.52:0/1016668287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300adb70 con 0x7f7b4006a510 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 -- 172.21.15.52:0/1016668287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 msgr2=0x7f7b4006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/1016668287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b4006ef90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7b400cf330 tx=0x7f7b3001c470 comp rx=0 tx=0).stop 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 -- 172.21.15.52:0/1016668287 shutdown_connections 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/1016668287 >> v2:172.21.15.186:3300/0 conn(0x7f7b4006f750 0x7f7b400cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/1016668287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b4006ef90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 -- 172.21.15.52:0/1016668287 >> 172.21.15.52:0/1016668287 conn(0x7f7b4006d320 msgr2=0x7f7b4006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 -- 172.21.15.52:0/1016668287 shutdown_connections 2023-09-30T16:49:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.334+0000 7f7b44ca0640 1 -- 172.21.15.52:0/1016668287 wait complete. 2023-09-30T16:49:46.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 Processor -- start 2023-09-30T16:49:46.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- start start 2023-09-30T16:49:46.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b40153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b4006f750 0x7f7b40156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b4015ccd0 0x7f7b4015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401568b0 con 0x7f7b4006a510 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40155c00 con 0x7f7b4006f750 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401550a0 con 0x7f7b4015ccd0 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b40153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b40153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58660/0 (socket says 172.21.15.52:58660) 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 -- 172.21.15.52:0/590279381 learned_addr learned my addr 172.21.15.52:0/590279381 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3dd9b640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b4006f750 0x7f7b40156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3ed9d640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b4015ccd0 0x7f7b4015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 -- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b4015ccd0 msgr2=0x7f7b4015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b4015ccd0 0x7f7b4015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 -- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b4006f750 msgr2=0x7f7b40156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b4006f750 0x7f7b40156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 -- 172.21.15.52:0/590279381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300094d0 con 0x7f7b4006a510 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3dd9b640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b4006f750 0x7f7b40156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b3e59c640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b40153b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c3c0 tx=0x7f7b3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340052d0 con 0x7f7b4006a510 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34005430 con 0x7f7b4006a510 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b40155360 con 0x7f7b4006a510 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34003840 con 0x7f7b4006a510 2023-09-30T16:49:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40155920 con 0x7f7b4006a510 2023-09-30T16:49:46.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4015d2f0 con 0x7f7b4006a510 2023-09-30T16:49:46.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.338+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7b340039a0 con 0x7f7b4006a510 2023-09-30T16:49:46.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.342+0000 7f7b2effd640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b20066160 0x7f7b20068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.342+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b34082f40 con 0x7f7b4006a510 2023-09-30T16:49:46.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.342+0000 7f7b3dd9b640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b20066160 0x7f7b20068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.342+0000 7f7b3dd9b640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b20066160 0x7f7b20068620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b300af000 tx=0x7f7b30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.346+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7b4015d2f0 con 0x7f7b4006a510 2023-09-30T16:49:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.498+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b400740a0 con 0x7f7b4006a510 2023-09-30T16:49:46.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.498+0000 7f7b2effd640 1 -- 172.21.15.52:0/590279381 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b34017020 con 0x7f7b4006a510 2023-09-30T16:49:46.501 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b20066160 msgr2=0x7f7b20068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b20066160 0x7f7b20068620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b300af000 tx=0x7f7b30008040 comp rx=0 tx=0).stop 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 msgr2=0x7f7b40153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b40153b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c3c0 tx=0x7f7b3400c880 comp rx=0 tx=0).stop 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 shutdown_connections 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7b20066160 0x7f7b20068620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b4015ccd0 0x7f7b4015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b4006f750 0x7f7b40156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 --2- 172.21.15.52:0/590279381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b4006a510 0x7f7b40153b90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 >> 172.21.15.52:0/590279381 conn(0x7f7b4006d320 msgr2=0x7f7b400ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 shutdown_connections 2023-09-30T16:49:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.502+0000 7f7b44ca0640 1 -- 172.21.15.52:0/590279381 wait complete. 2023-09-30T16:49:46.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:46.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 Processor -- start 2023-09-30T16:49:46.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 -- start start 2023-09-30T16:49:46.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdaf815aa40 0x7fdaf80c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf80b07b0 0x7fdaf806c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80b4610 con 0x7fdaf80b1470 2023-09-30T16:49:46.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf815e750 con 0x7fdaf815aa40 2023-09-30T16:49:46.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafed7b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf815ea30 con 0x7fdaf80b07b0 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdaf815aa40 0x7fdaf80c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdaf815aa40 0x7fdaf80c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58676/0 (socket says 172.21.15.52:58676) 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdaf7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdaf80b1470 0x7fdaf80b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39366/0 (socket says 172.21.15.52:39366) 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 -- 172.21.15.52:0/69705700 learned_addr learned my addr 172.21.15.52:0/69705700 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafd318640 1 --2- 172.21.15.52:0/69705700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf80b07b0 0x7fdaf806c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 -- 172.21.15.52:0/69705700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf80b07b0 msgr2=0x7fdaf806c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 --2- 172.21.15.52:0/69705700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf80b07b0 0x7fdaf806c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 -- 172.21.15.52:0/69705700 >> v1:172.21.15.52:6789/0 conn(0x7fdaf80b1470 legacy=0x7fdaf80b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 -- 172.21.15.52:0/69705700 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf815ed10 con 0x7fdaf815aa40 2023-09-30T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.650+0000 7fdafcb17640 1 --2- 172.21.15.52:0/69705700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf815aa40 0x7fdaf80c95f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009870 tx=0x7fdaec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8d27e8da3a265e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf77fe640 1 -- 172.21.15.52:0/69705700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0aa670 con 0x7fdaf815aa40 2023-09-30T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf77fe640 1 -- 172.21.15.52:0/69705700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec0aa7d0 con 0x7fdaf815aa40 2023-09-30T16:49:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf77fe640 1 -- 172.21.15.52:0/69705700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0aab60 con 0x7fdaf815aa40 2023-09-30T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/69705700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf815aa40 msgr2=0x7fdaf80c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 --2- 172.21.15.52:0/69705700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf815aa40 0x7fdaf80c95f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009870 tx=0x7fdaec01c510 comp rx=0 tx=0).stop 2023-09-30T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/69705700 shutdown_connections 2023-09-30T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 --2- 172.21.15.52:0/69705700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf80b07b0 0x7fdaf806c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 --2- 172.21.15.52:0/69705700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf815aa40 0x7fdaf80c95f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/69705700 >> 172.21.15.52:0/69705700 conn(0x7fdaf806a5c0 msgr2=0x7fdaf80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/69705700 shutdown_connections 2023-09-30T16:49:46.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/69705700 wait complete. 2023-09-30T16:49:46.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 Processor -- start 2023-09-30T16:49:46.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- start start 2023-09-30T16:49:46.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdaf80b07b0 0x7fdaf8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 0x7fdaf80cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf815aa40 0x7fdaf80cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf81538a0 con 0x7fdaf80b1470 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80ac520 con 0x7fdaf80b07b0 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80ac800 con 0x7fdaf815aa40 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 0x7fdaf80cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 0x7fdaf80cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58684/0 (socket says 172.21.15.52:58684) 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 -- 172.21.15.52:0/3483635972 learned_addr learned my addr 172.21.15.52:0/3483635972 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafd318640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf815aa40 0x7fdaf80cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafcb17640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdaf80b07b0 0x7fdaf8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 -- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf815aa40 msgr2=0x7fdaf80cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf815aa40 0x7fdaf80cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 -- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdaf80b07b0 msgr2=0x7fdaf8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdaf80b07b0 0x7fdaf8152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 -- 172.21.15.52:0/3483635972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec0094d0 con 0x7fdaf80b1470 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafd318640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf815aa40 0x7fdaf80cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafcb17640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdaf80b07b0 0x7fdaf8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf7fff640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 0x7fdaf80cd7e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c490 tx=0x7fdae400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4007480 con 0x7fdaf80b1470 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae40075e0 con 0x7fdaf80b1470 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf80acae0 con 0x7fdaf80b1470 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4004a10 con 0x7fdaf80b1470 2023-09-30T16:49:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.654+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf80ad0a0 con 0x7fdaf80b1470 2023-09-30T16:49:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.658+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf80740a0 con 0x7fdaf80b1470 2023-09-30T16:49:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.658+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fdae4004b70 con 0x7fdaf80b1470 2023-09-30T16:49:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.658+0000 7fdaf57fa640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdadc066160 0x7fdadc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.658+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdae4082ed0 con 0x7fdaf80b1470 2023-09-30T16:49:46.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.658+0000 7fdafcb17640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdadc066160 0x7fdadc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.658+0000 7fdafcb17640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdadc066160 0x7fdadc068620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0ae000 tx=0x7fdaec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.662+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fdae40504f0 con 0x7fdaf80b1470 2023-09-30T16:49:46.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.810+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdaf80b3d40 con 0x7fdaf80b1470 2023-09-30T16:49:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdaf57fa640 1 -- 172.21.15.52:0/3483635972 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdae40180a0 con 0x7fdaf80b1470 2023-09-30T16:49:46.815 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdadc066160 msgr2=0x7fdadc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdadc066160 0x7fdadc068620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0ae000 tx=0x7fdaec008040 comp rx=0 tx=0).stop 2023-09-30T16:49:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 msgr2=0x7fdaf80cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 0x7fdaf80cd7e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c490 tx=0x7fdae400c950 comp rx=0 tx=0).stop 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 shutdown_connections 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdadc066160 0x7fdadc068620 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdaf815aa40 0x7fdaf80cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdaf80b1470 0x7fdaf80cd7e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 --2- 172.21.15.52:0/3483635972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdaf80b07b0 0x7fdaf8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 >> 172.21.15.52:0/3483635972 conn(0x7fdaf806a5c0 msgr2=0x7fdaf8159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 shutdown_connections 2023-09-30T16:49:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.814+0000 7fdafed7b640 1 -- 172.21.15.52:0/3483635972 wait complete. 2023-09-30T16:49:46.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-09-30T16:49:46.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 Processor -- start 2023-09-30T16:49:46.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 -- start start 2023-09-30T16:49:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f236015ca60 0x7f2360070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23600c8c90 0x7f23600b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f23600b05e0 0x7f23600cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2360161720 con 0x7f23600c8c90 2023-09-30T16:49:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600b0a70 con 0x7f23600b05e0 2023-09-30T16:49:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2367184640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2360070fc0 con 0x7f236015ca60 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23600c8c90 0x7f23600b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23600c8c90 0x7f23600b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58700/0 (socket says 172.21.15.52:58700) 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 -- 172.21.15.52:0/2095710816 learned_addr learned my addr 172.21.15.52:0/2095710816 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2364f20640 1 --2- 172.21.15.52:0/2095710816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f236015ca60 0x7f2360070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 -- 172.21.15.52:0/2095710816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f236015ca60 msgr2=0x7f2360070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 --2- 172.21.15.52:0/2095710816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f236015ca60 0x7f2360070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 -- 172.21.15.52:0/2095710816 >> v2:172.21.15.186:3300/0 conn(0x7f23600b05e0 msgr2=0x7f23600cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2365721640 1 --2- 172.21.15.52:0/2095710816 >> v2:172.21.15.186:3300/0 conn(0x7f23600b05e0 0x7f23600cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 --2- 172.21.15.52:0/2095710816 >> v2:172.21.15.186:3300/0 conn(0x7f23600b05e0 0x7f23600cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f235ffff640 1 -- 172.21.15.52:0/2095710816 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360160b10 con 0x7f23600c8c90 2023-09-30T16:49:46.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.942+0000 7f2365721640 1 --2- 172.21.15.52:0/2095710816 >> v2:172.21.15.186:3300/0 conn(0x7f23600b05e0 0x7f23600cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 --2- 172.21.15.52:0/2095710816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f23600b00a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23600adc20 tx=0x7f234801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9b9e3406f20eae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235f7fe640 1 -- 172.21.15.52:0/2095710816 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480a5820 con 0x7f23600c8c90 2023-09-30T16:49:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235f7fe640 1 -- 172.21.15.52:0/2095710816 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23480a5980 con 0x7f23600c8c90 2023-09-30T16:49:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235f7fe640 1 -- 172.21.15.52:0/2095710816 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480a5d10 con 0x7f23600c8c90 2023-09-30T16:49:46.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- 172.21.15.52:0/2095710816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 msgr2=0x7f23600b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- 172.21.15.52:0/2095710816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f23600b00a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23600adc20 tx=0x7f234801c9a0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- 172.21.15.52:0/2095710816 shutdown_connections 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- 172.21.15.52:0/2095710816 >> v2:172.21.15.186:3300/0 conn(0x7f23600b05e0 0x7f23600cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- 172.21.15.52:0/2095710816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f23600b00a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- 172.21.15.52:0/2095710816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f236015ca60 0x7f2360070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- 172.21.15.52:0/2095710816 >> 172.21.15.52:0/2095710816 conn(0x7f236006a5f0 msgr2=0x7f23600ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- 172.21.15.52:0/2095710816 shutdown_connections 2023-09-30T16:49:46.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- 172.21.15.52:0/2095710816 wait complete. 2023-09-30T16:49:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 Processor -- start 2023-09-30T16:49:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- start start 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23600b05e0 0x7f236015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f236014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f236015ca60 0x7f23600c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236015db20 con 0x7f23600c8c90 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236014c6b0 con 0x7f236015ca60 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600c5700 con 0x7f23600b05e0 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f236014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f236014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58702/0 (socket says 172.21.15.52:58702) 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 -- 172.21.15.52:0/3903403854 learned_addr learned my addr 172.21.15.52:0/3903403854 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2365721640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f236015ca60 0x7f23600c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 -- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23600b05e0 msgr2=0x7f236015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23600b05e0 0x7f236015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 -- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f236015ca60 msgr2=0x7f23600c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f236015ca60 0x7f23600c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 -- 172.21.15.52:0/3903403854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348009b30 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235ffff640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f236014c170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23480af040 tx=0x7f2348019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480b8670 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23480b87f0 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23600c59e0 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.946+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480b8ba0 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236015d7b0 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23600740a0 con 0x7f23600c8c90 2023-09-30T16:49:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f23480b8d00 con 0x7f23600c8c90 2023-09-30T16:49:46.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f235d7fa640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066160 0x7f2340068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f234811f190 con 0x7f23600c8c90 2023-09-30T16:49:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f2364f20640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066160 0x7f2340068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.950+0000 7f2364f20640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066160 0x7f2340068620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f236015ff20 tx=0x7f2350008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:46.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:46.954+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f23480ec830 con 0x7f23600c8c90 2023-09-30T16:49:47.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.162+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f236015dc60 con 0x7f23600c8c90 2023-09-30T16:49:47.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.558+0000 7f235d7fa640 1 -- 172.21.15.52:0/3903403854 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v52) v1 ==== 147+0+0 (secure 0 0 0) 0x7f23480efe50 con 0x7f23600c8c90 2023-09-30T16:49:47.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066160 msgr2=0x7f2340068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066160 0x7f2340068620 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f236015ff20 tx=0x7f2350008040 comp rx=0 tx=0).stop 2023-09-30T16:49:47.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 msgr2=0x7f236014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f236014c170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23480af040 tx=0x7f2348019740 comp rx=0 tx=0).stop 2023-09-30T16:49:47.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 shutdown_connections 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066160 0x7f2340068620 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f236015ca60 0x7f23600c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23600c8c90 0x7f236014c170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 --2- 172.21.15.52:0/3903403854 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23600b05e0 0x7f236015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 >> 172.21.15.52:0/3903403854 conn(0x7f236006a5f0 msgr2=0x7f23600ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 shutdown_connections 2023-09-30T16:49:47.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.562+0000 7f2367184640 1 -- 172.21.15.52:0/3903403854 wait complete. 2023-09-30T16:49:47.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T16:49:47.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07f58d2640 1 Processor -- start 2023-09-30T16:49:47.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07f58d2640 1 -- start start 2023-09-30T16:49:47.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07f58d2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07f006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07f58d2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f015d0b0 con 0x7f07f006f750 2023-09-30T16:49:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07f58d2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f0071450 con 0x7f07f015ccd0 2023-09-30T16:49:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07f58d2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f006fbd0 con 0x7f07f006a510 2023-09-30T16:49:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07ef7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f07f006f750 0x7f07f00cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39368/0 (socket says 172.21.15.52:39368) 2023-09-30T16:49:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07ef7fe640 1 -- 172.21.15.52:0/62899538 learned_addr learned my addr 172.21.15.52:0/62899538 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07f006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141168344 0 0) 0x7f07f015d0b0 con 0x7f07f006f750 2023-09-30T16:49:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d8003530 con 0x7f07f006f750 2023-09-30T16:49:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3191350437 0 0) 0x7f07d8003530 con 0x7f07f006f750 2023-09-30T16:49:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 msgr2=0x7f07f006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07f006ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 >> v1:172.21.15.186:6789/0 conn(0x7f07f015ccd0 legacy=0x7f07f0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0071730 con 0x7f07f006f750 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f07e0001680 con 0x7f07f006f750 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 >> v1:172.21.15.52:6789/0 conn(0x7f07f006f750 legacy=0x7f07f00cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07d8004d10 0x7f07d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f006fbd0 con 0x7f07d80039b0 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d800ba70 con 0x7f07d8004d10 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d800bc30 con 0x7f07f006a510 2023-09-30T16:49:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07eeffd640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07eeffd640 1 -- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 msgr2=0x7f07d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07ef7fe640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07d8004d10 0x7f07d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07eeffd640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07eeffd640 1 -- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07d8004d10 msgr2=0x7f07d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07eeffd640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07d8004d10 0x7f07d8005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07eeffd640 1 -- 172.21.15.52:0/62899538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8003530 con 0x7f07d80039b0 2023-09-30T16:49:47.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.714+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f006a510 0x7f07d80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07eeffd640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07d8003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f07e8001860 tx=0x7f07e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c195d84022fc998f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80ab600 con 0x7f07d80039b0 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e80a7050 con 0x7f07d80039b0 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07edffb640 1 -- 172.21.15.52:0/62899538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80ab9a0 con 0x7f07d80039b0 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 -- 172.21.15.52:0/62899538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 msgr2=0x7f07d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 --2- 172.21.15.52:0/62899538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07d8003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f07e8001860 tx=0x7f07e801c500 comp rx=0 tx=0).stop 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07ef7fe640 1 -- 172.21.15.52:0/62899538 reap_dead start 2023-09-30T16:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 -- 172.21.15.52:0/62899538 shutdown_connections 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 -- 172.21.15.52:0/62899538 >> 172.21.15.52:0/62899538 conn(0x7f07f006d320 msgr2=0x7f07f006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 -- 172.21.15.52:0/62899538 shutdown_connections 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 -- 172.21.15.52:0/62899538 wait complete. 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 Processor -- start 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.718+0000 7f07f58d2640 1 -- start start 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07f01510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07f0151db0 0x7f07f00c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f01517d0 0x7f07f00c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0151610 con 0x7f07d80039b0 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01623c0 con 0x7f07f0151db0 2023-09-30T16:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01626a0 con 0x7f07f01517d0 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07f01510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07f01510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58718/0 (socket says 172.21.15.52:58718) 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 -- 172.21.15.52:0/2357795802 learned_addr learned my addr 172.21.15.52:0/2357795802 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07f0151db0 0x7f07f00c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07ef7fe640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f01517d0 0x7f07f00c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 -- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f01517d0 msgr2=0x7f07f00c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f01517d0 0x7f07f00c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 -- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07f0151db0 msgr2=0x7f07f00c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07f0151db0 0x7f07f00c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 -- 172.21.15.52:0/2357795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0162980 con 0x7f07d80039b0 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07f0151db0 0x7f07f00c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07eeffd640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07f01510d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f07e801c330 tx=0x7f07d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8005390 con 0x7f07d80039b0 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e80aba80 con 0x7f07d80039b0 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80abdf0 con 0x7f07d80039b0 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0162c60 con 0x7f07d80039b0 2023-09-30T16:49:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f0163460 con 0x7f07d80039b0 2023-09-30T16:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f00740a0 con 0x7f07d80039b0 2023-09-30T16:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f07e80b2050 con 0x7f07d80039b0 2023-09-30T16:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07d7fff640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f07dc066190 0x7f07dc068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07e811d610 con 0x7f07d80039b0 2023-09-30T16:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.722+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f07dc066190 0x7f07dc068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.726+0000 7f07ee7fc640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f07dc066190 0x7f07dc068650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07f00c82a0 tx=0x7f07e400d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:47.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.726+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f07e80ead70 con 0x7f07d80039b0 2023-09-30T16:49:47.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:49:47.777 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:49:47.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.882+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f07f006ed70 con 0x7f07d80039b0 2023-09-30T16:49:47.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.886+0000 7f07d7fff640 1 -- 172.21.15.52:0/2357795802 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f07e80ee390 con 0x7f07d80039b0 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f07dc066190 msgr2=0x7f07dc068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f07dc066190 0x7f07dc068650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07f00c82a0 tx=0x7f07e400d040 comp rx=0 tx=0).stop 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 msgr2=0x7f07f01510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07f01510d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f07e801c330 tx=0x7f07d8005800 comp rx=0 tx=0).stop 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 shutdown_connections 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f07dc066190 0x7f07dc068650 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07f01517d0 0x7f07f00c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07f0151db0 0x7f07f00c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 --2- 172.21.15.52:0/2357795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07d80039b0 0x7f07f01510d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:47.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 >> 172.21.15.52:0/2357795802 conn(0x7f07f006d320 msgr2=0x7f07f00ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:47.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 shutdown_connections 2023-09-30T16:49:47.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:47.890+0000 7f07f58d2640 1 -- 172.21.15.52:0/2357795802 wait complete. 2023-09-30T16:49:47.907 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T16:49:47.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T16:49:47.955 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T16:49:47.992 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T16:49:47.992 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:49:47.992 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:47.997 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:49:47.997 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:48.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:48.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.202+0000 7f1b33f6d640 1 Processor -- start 2023-09-30T16:49:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.202+0000 7f1b33f6d640 1 -- start start 2023-09-30T16:49:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b33f6d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 0x7f1b2c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b33f6d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c06c240 con 0x7f1b2c0b19b0 2023-09-30T16:49:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b33f6d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c15adb0 con 0x7f1b2c15a9d0 2023-09-30T16:49:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b33f6d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c15ea90 con 0x7f1b2c15e4b0 2023-09-30T16:49:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b3250a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1b2c0b19b0 0x7f1b2c0b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39382/0 (socket says 172.21.15.52:39382) 2023-09-30T16:49:48.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b3250a640 1 -- 172.21.15.52:0/801403682 learned_addr learned my addr 172.21.15.52:0/801403682 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 0x7f1b2c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819661749 0 0) 0x7f1b2c06c240 con 0x7f1b2c0b19b0 2023-09-30T16:49:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b18003530 con 0x7f1b2c0b19b0 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544756209 0 0) 0x7f1b18003530 con 0x7f1b2c0b19b0 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 msgr2=0x7f1b2c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 0x7f1b2c0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 >> v1:172.21.15.186:6789/0 conn(0x7f1b2c15a9d0 legacy=0x7f1b2c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c15ed70 con 0x7f1b2c0b19b0 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f1b24001a00 con 0x7f1b2c0b19b0 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 >> v1:172.21.15.52:6789/0 conn(0x7f1b2c0b19b0 legacy=0x7f1b2c0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b18003a20 0x7f1b18003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 0x7f1b180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c15ea90 con 0x7f1b180047d0 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1800baf0 con 0x7f1b18003a20 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1800bcb0 con 0x7f1b2c15e4b0 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31d09640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b18003a20 0x7f1b18003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b3250a640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 0x7f1b180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 -- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 msgr2=0x7f1b180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c15e4b0 0x7f1b180051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 -- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b18003a20 msgr2=0x7f1b18003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b18003a20 0x7f1b18003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31508640 1 -- 172.21.15.52:0/801403682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18003530 con 0x7f1b180047d0 2023-09-30T16:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.206+0000 7f1b31d09640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b18003a20 0x7f1b18003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b31508640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b18004c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009ae0 tx=0x7f1b1c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d79c401d4800e77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0a5640 con 0x7f1b180047d0 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0a57a0 con 0x7f1b180047d0 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b30d07640 1 -- 172.21.15.52:0/801403682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0a5b50 con 0x7f1b180047d0 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- 172.21.15.52:0/801403682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 msgr2=0x7f1b18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/801403682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b18004c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009ae0 tx=0x7f1b1c01ca50 comp rx=0 tx=0).stop 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b3250a640 1 -- 172.21.15.52:0/801403682 reap_dead start 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- 172.21.15.52:0/801403682 shutdown_connections 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- 172.21.15.52:0/801403682 >> 172.21.15.52:0/801403682 conn(0x7f1b2c06a5f0 msgr2=0x7f1b2c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- 172.21.15.52:0/801403682 shutdown_connections 2023-09-30T16:49:48.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- 172.21.15.52:0/801403682 wait complete. 2023-09-30T16:49:48.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 Processor -- start 2023-09-30T16:49:48.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- start start 2023-09-30T16:49:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b2c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c0c6c50 0x7f1b2c1f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2c0c70d0 0x7f1b2c1f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c76a0 con 0x7f1b180047d0 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c7980 con 0x7f1b2c0c70d0 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b33f6d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c7c60 con 0x7f1b2c0c6c50 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b31d09640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b2c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b31d09640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b2c0c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58736/0 (socket says 172.21.15.52:58736) 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b31d09640 1 -- 172.21.15.52:0/823362823 learned_addr learned my addr 172.21.15.52:0/823362823 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b3250a640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2c0c70d0 0x7f1b2c1f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.210+0000 7f1b31508640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c0c6c50 0x7f1b2c1f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31d09640 1 -- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c0c6c50 msgr2=0x7f1b2c1f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31d09640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c0c6c50 0x7f1b2c1f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31d09640 1 -- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2c0c70d0 msgr2=0x7f1b2c1f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31d09640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2c0c70d0 0x7f1b2c1f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31d09640 1 -- 172.21.15.52:0/823362823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0c7f40 con 0x7f1b180047d0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31d09640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b2c0c8740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800d770 tx=0x7f1b2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28005270 con 0x7f1b180047d0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b280053d0 con 0x7f1b180047d0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c0c8220 con 0x7f1b180047d0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800b8d0 con 0x7f1b180047d0 2023-09-30T16:49:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c0cd050 con 0x7f1b180047d0 2023-09-30T16:49:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c0740a0 con 0x7f1b180047d0 2023-09-30T16:49:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1b2800ba30 con 0x7f1b180047d0 2023-09-30T16:49:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b227fc640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1b10066160 0x7f1b10068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b28083a80 con 0x7f1b180047d0 2023-09-30T16:49:48.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31508640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1b10066160 0x7f1b10068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.214+0000 7f1b31508640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1b10066160 0x7f1b10068620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0af000 tx=0x7f1b1c0046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.218+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1b28051000 con 0x7f1b180047d0 2023-09-30T16:49:48.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.374+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b2c0cf0e0 con 0x7f1b180047d0 2023-09-30T16:49:48.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.378+0000 7f1b227fc640 1 -- 172.21.15.52:0/823362823 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f1b28054620 con 0x7f1b180047d0 2023-09-30T16:49:48.380 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:48.380 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1b10066160 msgr2=0x7f1b10068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1b10066160 0x7f1b10068620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0af000 tx=0x7f1b1c0046d0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 msgr2=0x7f1b2c0c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b2c0c8740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800d770 tx=0x7f1b2800dc30 comp rx=0 tx=0).stop 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 shutdown_connections 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1b10066160 0x7f1b10068620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2c0c70d0 0x7f1b2c1f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b2c0c6c50 0x7f1b2c1f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 --2- 172.21.15.52:0/823362823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b180047d0 0x7f1b2c0c8740 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 >> 172.21.15.52:0/823362823 conn(0x7f1b2c06a5f0 msgr2=0x7f1b2c070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 shutdown_connections 2023-09-30T16:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.382+0000 7f1b33f6d640 1 -- 172.21.15.52:0/823362823 wait complete. 2023-09-30T16:49:48.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:48.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 Processor -- start 2023-09-30T16:49:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 -- start start 2023-09-30T16:49:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f25dc15a8b0 0x7f25dc06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0b0a10 con 0x7f25dc15e4b0 2023-09-30T16:49:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0b1b80 con 0x7f25dc15a8b0 2023-09-30T16:49:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e2c16640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc06db90 con 0x7f25dc0b00a0 2023-09-30T16:49:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e11b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e11b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc0b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:50664/0 (socket says 172.21.15.52:50664) 2023-09-30T16:49:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25dbfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f25dc15e4b0 0x7f25dc0b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:56828/0 (socket says 172.21.15.52:56828) 2023-09-30T16:49:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e09b2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f25dc15a8b0 0x7f25dc06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e11b3640 1 -- 172.21.15.52:0/2345939558 learned_addr learned my addr 172.21.15.52:0/2345939558 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e09b2640 1 -- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 msgr2=0x7f25dc0b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e09b2640 1 --2- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc0b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e09b2640 1 -- 172.21.15.52:0/2345939558 >> v1:172.21.15.186:6789/0 conn(0x7f25dc15e4b0 legacy=0x7f25dc0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.522+0000 7f25e09b2640 1 -- 172.21.15.52:0/2345939558 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc15ea50 con 0x7f25dc15a8b0 2023-09-30T16:49:48.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e09b2640 1 --2- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15a8b0 0x7f25dc06d650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0097c0 tx=0x7f25cc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d071b1bc6ed43c4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25db7fe640 1 -- 172.21.15.52:0/2345939558 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0ab650 con 0x7f25dc15a8b0 2023-09-30T16:49:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25db7fe640 1 -- 172.21.15.52:0/2345939558 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc0ab7b0 con 0x7f25dc15a8b0 2023-09-30T16:49:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25db7fe640 1 -- 172.21.15.52:0/2345939558 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0abb40 con 0x7f25dc15a8b0 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 -- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15a8b0 msgr2=0x7f25dc06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15a8b0 0x7f25dc06d650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0097c0 tx=0x7f25cc01c450 comp rx=0 tx=0).stop 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 -- 172.21.15.52:0/2345939558 shutdown_connections 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2345939558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15a8b0 0x7f25dc06d650 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 -- 172.21.15.52:0/2345939558 >> 172.21.15.52:0/2345939558 conn(0x7f25dc06a5c0 msgr2=0x7f25dc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 -- 172.21.15.52:0/2345939558 shutdown_connections 2023-09-30T16:49:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 -- 172.21.15.52:0/2345939558 wait complete. 2023-09-30T16:49:48.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 Processor -- start 2023-09-30T16:49:48.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.526+0000 7f25e2c16640 1 -- start start 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15e4b0 0x7f25dc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 0x7f25dc156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc14a0a0 con 0x7f25dc154ed0 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc155420 con 0x7f25dc15e4b0 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0cd0b0 con 0x7f25dc0b00a0 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 0x7f25dc156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 0x7f25dc156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58752/0 (socket says 172.21.15.52:58752) 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 -- 172.21.15.52:0/2804286958 learned_addr learned my addr 172.21.15.52:0/2804286958 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e09b2640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25dbfff640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15e4b0 0x7f25dc155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 -- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 msgr2=0x7f25dc149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 -- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15e4b0 msgr2=0x7f25dc155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15e4b0 0x7f25dc155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 -- 172.21.15.52:0/2804286958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc009420 con 0x7f25dc154ed0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e11b3640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 0x7f25dc156070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25d400efc0 tx=0x7f25d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4009b60 con 0x7f25dc154ed0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d400f040 con 0x7f25dc154ed0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc0cd390 con 0x7f25dc154ed0 2023-09-30T16:49:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40039a0 con 0x7f25dc154ed0 2023-09-30T16:49:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc0c8f40 con 0x7f25dc154ed0 2023-09-30T16:49:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc06c090 con 0x7f25dc154ed0 2023-09-30T16:49:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f25d4003b00 con 0x7f25dc154ed0 2023-09-30T16:49:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25d97fa640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f25bc066190 0x7f25bc068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25d4083fb0 con 0x7f25dc154ed0 2023-09-30T16:49:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.530+0000 7f25e09b2640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f25bc066190 0x7f25bc068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.534+0000 7f25e09b2640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f25bc066190 0x7f25bc068650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0af000 tx=0x7f25cc0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.534+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f25d40b4ed0 con 0x7f25dc154ed0 2023-09-30T16:49:48.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.690+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25dc0740a0 con 0x7f25dc154ed0 2023-09-30T16:49:48.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.690+0000 7f25d97fa640 1 -- 172.21.15.52:0/2804286958 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25d4051710 con 0x7f25dc154ed0 2023-09-30T16:49:48.693 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:48.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f25bc066190 msgr2=0x7f25bc068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f25bc066190 0x7f25bc068650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0af000 tx=0x7f25cc0a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:48.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 msgr2=0x7f25dc156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 0x7f25dc156070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25d400efc0 tx=0x7f25d400c490 comp rx=0 tx=0).stop 2023-09-30T16:49:48.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 shutdown_connections 2023-09-30T16:49:48.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f25bc066190 0x7f25bc068650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25dc154ed0 0x7f25dc156070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25dc15e4b0 0x7f25dc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 --2- 172.21.15.52:0/2804286958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25dc0b00a0 0x7f25dc149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 >> 172.21.15.52:0/2804286958 conn(0x7f25dc06a5c0 msgr2=0x7f25dc15d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:48.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 shutdown_connections 2023-09-30T16:49:48.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.694+0000 7f25e2c16640 1 -- 172.21.15.52:0/2804286958 wait complete. 2023-09-30T16:49:48.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:48.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 Processor -- start 2023-09-30T16:49:48.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 -- start start 2023-09-30T16:49:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d00c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52d006f150 0x7f52d006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d006dec0 con 0x7f52d00c4600 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d00c4330 con 0x7f52d006f150 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52d607f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0161590 con 0x7f52d015ce40 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52ceffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52d006f150 0x7f52d006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52cffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f52d00c4600 0x7f52d00cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39398/0 (socket says 172.21.15.52:39398) 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52cffff640 1 -- 172.21.15.52:0/3531927532 learned_addr learned my addr 172.21.15.52:0/3531927532 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52cf7fe640 1 --2- 172.21.15.52:0/3531927532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d00c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52ceffd640 1 -- 172.21.15.52:0/3531927532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 msgr2=0x7f52d00c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52ceffd640 1 --2- 172.21.15.52:0/3531927532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d00c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52ceffd640 1 -- 172.21.15.52:0/3531927532 >> v1:172.21.15.52:6789/0 conn(0x7f52d00c4600 legacy=0x7f52d00cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.822+0000 7f52ceffd640 1 -- 172.21.15.52:0/3531927532 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d006e160 con 0x7f52d006f150 2023-09-30T16:49:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ceffd640 1 --2- 172.21.15.52:0/3531927532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d006f150 0x7f52d006e960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52b80097c0 tx=0x7f52b801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49babfcf6023f2b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ce7fc640 1 -- 172.21.15.52:0/3531927532 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80ab670 con 0x7f52d006f150 2023-09-30T16:49:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ce7fc640 1 -- 172.21.15.52:0/3531927532 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b80ab7d0 con 0x7f52d006f150 2023-09-30T16:49:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ce7fc640 1 -- 172.21.15.52:0/3531927532 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80abb60 con 0x7f52d006f150 2023-09-30T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- 172.21.15.52:0/3531927532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d006f150 msgr2=0x7f52d006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 --2- 172.21.15.52:0/3531927532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d006f150 0x7f52d006e960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52b80097c0 tx=0x7f52b801c450 comp rx=0 tx=0).stop 2023-09-30T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- 172.21.15.52:0/3531927532 shutdown_connections 2023-09-30T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 --2- 172.21.15.52:0/3531927532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d006f150 0x7f52d006e960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 --2- 172.21.15.52:0/3531927532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d00c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- 172.21.15.52:0/3531927532 >> 172.21.15.52:0/3531927532 conn(0x7f52d00b0b80 msgr2=0x7f52d00b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- 172.21.15.52:0/3531927532 shutdown_connections 2023-09-30T16:49:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- 172.21.15.52:0/3531927532 wait complete. 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 Processor -- start 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- start start 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52d006f150 0x7f52d01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 0x7f52d01489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d01492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0154ad0 con 0x7f52d00c4600 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0150b20 con 0x7f52d006f150 2023-09-30T16:49:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52d607f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0154480 con 0x7f52d015ce40 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 0x7f52d01489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 0x7f52d01489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58778/0 (socket says 172.21.15.52:58778) 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52ceffd640 1 -- 172.21.15.52:0/446449014 learned_addr learned my addr 172.21.15.52:0/446449014 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52cffff640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d01492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.826+0000 7f52cf7fe640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52d006f150 0x7f52d01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52ceffd640 1 -- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 msgr2=0x7f52d01492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52ceffd640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d01492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52ceffd640 1 -- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52d006f150 msgr2=0x7f52d01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52ceffd640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52d006f150 0x7f52d01500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52ceffd640 1 -- 172.21.15.52:0/446449014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009420 con 0x7f52d00c4600 2023-09-30T16:49:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52ceffd640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 0x7f52d01489e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f52b80ad040 tx=0x7f52b801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80b5810 con 0x7f52d00c4600 2023-09-30T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b80b59b0 con 0x7f52d00c4600 2023-09-30T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80b5d60 con 0x7f52d00c4600 2023-09-30T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d0154760 con 0x7f52d00c4600 2023-09-30T16:49:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0148f20 con 0x7f52d00c4600 2023-09-30T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0156710 con 0x7f52d00c4600 2023-09-30T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f52b80b4390 con 0x7f52d00c4600 2023-09-30T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52c7fff640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f52b0066160 0x7f52b0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52b811e3f0 con 0x7f52d00c4600 2023-09-30T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52cf7fe640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f52b0066160 0x7f52b0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.830+0000 7f52cf7fe640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f52b0066160 0x7f52b0068620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52c8003fd0 tx=0x7f52c80039a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.834+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f52d0156710 con 0x7f52d00c4600 2023-09-30T16:49:48.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52d0156710 con 0x7f52d00c4600 2023-09-30T16:49:48.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52c7fff640 1 -- 172.21.15.52:0/446449014 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52d0156710 con 0x7f52d00c4600 2023-09-30T16:49:48.992 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f52b0066160 msgr2=0x7f52b0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f52b0066160 0x7f52b0068620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52c8003fd0 tx=0x7f52c80039a0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 msgr2=0x7f52d01489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 0x7f52d01489e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f52b80ad040 tx=0x7f52b801ac90 comp rx=0 tx=0).stop 2023-09-30T16:49:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 shutdown_connections 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f52b0066160 0x7f52b0068620 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52d015ce40 0x7f52d01492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52d00c4600 0x7f52d01489e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 --2- 172.21.15.52:0/446449014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52d006f150 0x7f52d01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 >> 172.21.15.52:0/446449014 conn(0x7f52d00b0b80 msgr2=0x7f52d006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 shutdown_connections 2023-09-30T16:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:48.990+0000 7f52d607f640 1 -- 172.21.15.52:0/446449014 wait complete. 2023-09-30T16:49:49.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:49.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 Processor -- start 2023-09-30T16:49:49.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 -- start start 2023-09-30T16:49:49.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9b301600a0 0x7f9b3006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b3006b660 0x7f9b300b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b300b2ca0 con 0x7f9b300b2850 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3006c440 con 0x7f9b3006b660 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b36e9b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300caf90 con 0x7f9b301600a0 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b3006b660 0x7f9b300b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b3006b660 0x7f9b300b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58784/0 (socket says 172.21.15.52:58784) 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 -- 172.21.15.52:0/1264654769 learned_addr learned my addr 172.21.15.52:0/1264654769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b34c37640 1 --2- 172.21.15.52:0/1264654769 >> v2:172.21.15.186:3300/0 conn(0x7f9b301600a0 0x7f9b3006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 -- 172.21.15.52:0/1264654769 >> v2:172.21.15.186:3300/0 conn(0x7f9b301600a0 msgr2=0x7f9b3006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 --2- 172.21.15.52:0/1264654769 >> v2:172.21.15.186:3300/0 conn(0x7f9b301600a0 0x7f9b3006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 -- 172.21.15.52:0/1264654769 >> v1:172.21.15.186:6789/0 conn(0x7f9b300b2850 legacy=0x7f9b3006fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.122+0000 7f9b2ffff640 1 -- 172.21.15.52:0/1264654769 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300cb230 con 0x7f9b3006b660 2023-09-30T16:49:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b2ffff640 1 --2- 172.21.15.52:0/1264654769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b3006b660 0x7f9b300b2310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9b30073bf0 tx=0x7f9b2001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220e95e0cee9daa0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b2f7fe640 1 -- 172.21.15.52:0/1264654769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200a89b0 con 0x7f9b3006b660 2023-09-30T16:49:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b2f7fe640 1 -- 172.21.15.52:0/1264654769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b200a8b10 con 0x7f9b3006b660 2023-09-30T16:49:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b2f7fe640 1 -- 172.21.15.52:0/1264654769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200a8ea0 con 0x7f9b3006b660 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1264654769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b3006b660 msgr2=0x7f9b300b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1264654769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b3006b660 0x7f9b300b2310 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9b30073bf0 tx=0x7f9b2001ecb0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1264654769 shutdown_connections 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1264654769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b3006b660 0x7f9b300b2310 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1264654769 >> v2:172.21.15.186:3300/0 conn(0x7f9b301600a0 0x7f9b3006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1264654769 >> 172.21.15.52:0/1264654769 conn(0x7f9b300cd310 msgr2=0x7f9b300cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1264654769 shutdown_connections 2023-09-30T16:49:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1264654769 wait complete. 2023-09-30T16:49:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 Processor -- start 2023-09-30T16:49:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- start start 2023-09-30T16:49:49.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3006b660 0x7f9b300b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b300b2850 0x7f9b300c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 0x7f9b300c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300c89b0 con 0x7f9b301600a0 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300b6140 con 0x7f9b3006b660 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.126+0000 7f9b36e9b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300c8c00 con 0x7f9b300b2850 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 0x7f9b300c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 0x7f9b300c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58794/0 (socket says 172.21.15.52:58794) 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 -- 172.21.15.52:0/1325546769 learned_addr learned my addr 172.21.15.52:0/1325546769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b34c37640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3006b660 0x7f9b300b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2ffff640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b300b2850 0x7f9b300c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 -- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b300b2850 msgr2=0x7f9b300c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b300b2850 0x7f9b300c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 -- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3006b660 msgr2=0x7f9b300b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3006b660 0x7f9b300b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 -- 172.21.15.52:0/1325546769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200094d0 con 0x7f9b301600a0 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b35438640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 0x7f9b300c43a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800c780 tx=0x7f9b2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28004b20 con 0x7f9b301600a0 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b28004c80 con 0x7f9b301600a0 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800aa90 con 0x7f9b301600a0 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b300c8ee0 con 0x7f9b301600a0 2023-09-30T16:49:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b300c94a0 con 0x7f9b301600a0 2023-09-30T16:49:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b30066750 con 0x7f9b301600a0 2023-09-30T16:49:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f9b2800abf0 con 0x7f9b301600a0 2023-09-30T16:49:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2d7fa640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b1c066160 0x7f9b1c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b28084360 con 0x7f9b301600a0 2023-09-30T16:49:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b34c37640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b1c066160 0x7f9b1c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.130+0000 7f9b34c37640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b1c066160 0x7f9b1c068620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400b930 tx=0x7f9b24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.134+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f9b280519f0 con 0x7f9b301600a0 2023-09-30T16:49:49.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.282+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b300740a0 con 0x7f9b301600a0 2023-09-30T16:49:49.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.282+0000 7f9b2d7fa640 1 -- 172.21.15.52:0/1325546769 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b28055010 con 0x7f9b301600a0 2023-09-30T16:49:49.286 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b1c066160 msgr2=0x7f9b1c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b1c066160 0x7f9b1c068620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400b930 tx=0x7f9b24008040 comp rx=0 tx=0).stop 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 msgr2=0x7f9b300c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 0x7f9b300c43a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800c780 tx=0x7f9b2800cc40 comp rx=0 tx=0).stop 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 shutdown_connections 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b1c066160 0x7f9b1c068620 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b301600a0 0x7f9b300c43a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b300b2850 0x7f9b300c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 --2- 172.21.15.52:0/1325546769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3006b660 0x7f9b300b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 >> 172.21.15.52:0/1325546769 conn(0x7f9b300cd310 msgr2=0x7f9b300cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 shutdown_connections 2023-09-30T16:49:49.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.286+0000 7f9b36e9b640 1 -- 172.21.15.52:0/1325546769 wait complete. 2023-09-30T16:49:49.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:49.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 Processor -- start 2023-09-30T16:49:49.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 -- start start 2023-09-30T16:49:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa815aa40 0x7faaa80c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faaa80b1470 0x7faaa80b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faaa806d500 0x7faaa80b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa80b4610 con 0x7faaa80b1470 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa815e750 con 0x7faaa806d500 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaaf7db640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa815ea30 con 0x7faaa815aa40 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faaa80b1470 0x7faaa80b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faaa80b1470 0x7faaa80b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58798/0 (socket says 172.21.15.52:58798) 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 -- 172.21.15.52:0/617361416 learned_addr learned my addr 172.21.15.52:0/617361416 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaadd78640 1 --2- 172.21.15.52:0/617361416 >> v2:172.21.15.186:3300/0 conn(0x7faaa806d500 0x7faaa80b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaad577640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa815aa40 0x7faaa80c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 -- 172.21.15.52:0/617361416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa815aa40 msgr2=0x7faaa80c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa815aa40 0x7faaa80c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 -- 172.21.15.52:0/617361416 >> v2:172.21.15.186:3300/0 conn(0x7faaa806d500 msgr2=0x7faaa80b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 --2- 172.21.15.52:0/617361416 >> v2:172.21.15.186:3300/0 conn(0x7faaa806d500 0x7faaa80b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaacd76640 1 -- 172.21.15.52:0/617361416 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa815ed10 con 0x7faaa80b1470 2023-09-30T16:49:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.426+0000 7faaad577640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa815aa40 0x7faaa80c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaacd76640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa80b1470 0x7faaa80b00a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faaa806d990 tx=0x7faa9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01eb0e29d668fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faa9ffff640 1 -- 172.21.15.52:0/617361416 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa980aa5f0 con 0x7faaa80b1470 2023-09-30T16:49:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faa9ffff640 1 -- 172.21.15.52:0/617361416 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa980aa750 con 0x7faaa80b1470 2023-09-30T16:49:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faa9ffff640 1 -- 172.21.15.52:0/617361416 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa980aaae0 con 0x7faaa80b1470 2023-09-30T16:49:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 -- 172.21.15.52:0/617361416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa80b1470 msgr2=0x7faaa80b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa80b1470 0x7faaa80b00a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faaa806d990 tx=0x7faa9801c4d0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 -- 172.21.15.52:0/617361416 shutdown_connections 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- 172.21.15.52:0/617361416 >> v2:172.21.15.186:3300/0 conn(0x7faaa806d500 0x7faaa80b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa80b1470 0x7faaa80b00a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- 172.21.15.52:0/617361416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa815aa40 0x7faaa80c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 -- 172.21.15.52:0/617361416 >> 172.21.15.52:0/617361416 conn(0x7faaa806a5c0 msgr2=0x7faaa80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 -- 172.21.15.52:0/617361416 shutdown_connections 2023-09-30T16:49:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 -- 172.21.15.52:0/617361416 wait complete. 2023-09-30T16:49:49.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 Processor -- start 2023-09-30T16:49:49.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 -- start start 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 0x7faaa81503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa80b1470 0x7faaa80ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.430+0000 7faaaf7db640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaa815aa40 0x7faaa80acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaaf7db640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8150900 con 0x7faaa806d500 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaaf7db640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa80b1850 con 0x7faaa815aa40 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaaf7db640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81527f0 con 0x7faaa80b1470 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 0x7faaa81503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 0x7faaa81503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58812/0 (socket says 172.21.15.52:58812) 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 -- 172.21.15.52:0/2295633032 learned_addr learned my addr 172.21.15.52:0/2295633032 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaacd76640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa80b1470 0x7faaa80ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaadd78640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaa815aa40 0x7faaa80acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 -- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa80b1470 msgr2=0x7faaa80ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa80b1470 0x7faaa80ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 -- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaa815aa40 msgr2=0x7faaa80acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaa815aa40 0x7faaa80acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 -- 172.21.15.52:0/2295633032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa980094d0 con 0x7faaa806d500 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaad577640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 0x7faaa81503c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c7f0 tx=0x7faaa400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4007820 con 0x7faaa806d500 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4007980 con 0x7faaa806d500 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa8152ad0 con 0x7faaa806d500 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4007d30 con 0x7faaa806d500 2023-09-30T16:49:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa8153090 con 0x7faaa806d500 2023-09-30T16:49:49.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa80740a0 con 0x7faaa806d500 2023-09-30T16:49:49.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7faaa40113f0 con 0x7faaa806d500 2023-09-30T16:49:49.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faa9dffb640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa8c066160 0x7faa8c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaa4083e40 con 0x7faaa806d500 2023-09-30T16:49:49.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.434+0000 7faaacd76640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa8c066160 0x7faa8c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.438+0000 7faaacd76640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa8c066160 0x7faa8c068620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa980ae000 tx=0x7faa980a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.438+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7faaa40513c0 con 0x7faaa806d500 2023-09-30T16:49:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.602+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faaa80cf0b0 con 0x7faaa806d500 2023-09-30T16:49:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.602+0000 7faa9dffb640 1 -- 172.21.15.52:0/2295633032 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7faaa40549e0 con 0x7faaa806d500 2023-09-30T16:49:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa8c066160 msgr2=0x7faa8c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa8c066160 0x7faa8c068620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa980ae000 tx=0x7faa980a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 msgr2=0x7faaa81503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 0x7faaa81503c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c7f0 tx=0x7faaa400ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 shutdown_connections 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa8c066160 0x7faa8c068620 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaa815aa40 0x7faaa80acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaa80b1470 0x7faaa80ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 --2- 172.21.15.52:0/2295633032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaa806d500 0x7faaa81503c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 >> 172.21.15.52:0/2295633032 conn(0x7faaa806a5c0 msgr2=0x7faaa8156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 shutdown_connections 2023-09-30T16:49:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.606+0000 7faaaf7db640 1 -- 172.21.15.52:0/2295633032 wait complete. 2023-09-30T16:49:49.624 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:49:49.625 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:49.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.794+0000 7ff3ed4e7640 1 Processor -- start 2023-09-30T16:49:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3ed4e7640 1 -- start start 2023-09-30T16:49:49.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3ed4e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3e815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3ed4e7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff3e806d650 0x7ff3e80b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3ed4e7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e806c240 con 0x7ff3e80b19b0 2023-09-30T16:49:49.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3ed4e7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e815adb0 con 0x7ff3e806d650 2023-09-30T16:49:49.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3ed4e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e815ea90 con 0x7ff3e815a9d0 2023-09-30T16:49:49.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e77fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff3e80b19b0 0x7ff3e80b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39404/0 (socket says 172.21.15.52:39404) 2023-09-30T16:49:49.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e77fe640 1 -- 172.21.15.52:0/2941906170 learned_addr learned my addr 172.21.15.52:0/2941906170 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e67fc640 1 --2- 172.21.15.52:0/2941906170 >> v2:172.21.15.186:3300/0 conn(0x7ff3e806d650 0x7ff3e80b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3e815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062565137 0 0) 0x7ff3e806c240 con 0x7ff3e80b19b0 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d0003530 con 0x7ff3e80b19b0 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2293777188 0 0) 0x7ff3d0003530 con 0x7ff3e80b19b0 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 msgr2=0x7ff3e815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3e815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 >> v2:172.21.15.186:3300/0 conn(0x7ff3e806d650 msgr2=0x7ff3e80b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 --2- 172.21.15.52:0/2941906170 >> v2:172.21.15.186:3300/0 conn(0x7ff3e806d650 0x7ff3e80b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e815ed70 con 0x7ff3e80b19b0 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7ff3e0001a00 con 0x7ff3e80b19b0 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3e815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 >> v1:172.21.15.52:6789/0 conn(0x7ff3e80b19b0 legacy=0x7ff3e80b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d00039f0 0x7ff3d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00047d0 0x7ff3d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e815adb0 con 0x7ff3d00039f0 2023-09-30T16:49:49.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e815ea90 con 0x7ff3d00047d0 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d000b9c0 con 0x7ff3e815a9d0 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d00039f0 0x7ff3d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e77fe640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e67fc640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00047d0 0x7ff3d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 -- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 msgr2=0x7ff3d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e815a9d0 0x7ff3d0005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 -- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00047d0 msgr2=0x7ff3d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00047d0 0x7ff3d0004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.798+0000 7ff3e6ffd640 1 -- 172.21.15.52:0/2941906170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d0003530 con 0x7ff3d00039f0 2023-09-30T16:49:49.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d00039f0 0x7ff3d0003e10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80098d0 tx=0x7ff3d801c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343d07a8d4906abc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80ab5f0 con 0x7ff3d00039f0 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d80ab750 con 0x7ff3d00039f0 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e5ffb640 1 -- 172.21.15.52:0/2941906170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80abac0 con 0x7ff3d00039f0 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2941906170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d00039f0 msgr2=0x7ff3d0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2941906170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d00039f0 0x7ff3d0003e10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80098d0 tx=0x7ff3d801c5b0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 -- 172.21.15.52:0/2941906170 reap_dead start 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2941906170 shutdown_connections 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2941906170 >> 172.21.15.52:0/2941906170 conn(0x7ff3e806a5f0 msgr2=0x7ff3e80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2941906170 shutdown_connections 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2941906170 wait complete. 2023-09-30T16:49:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 Processor -- start 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- start start 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00039f0 0x7ff3e80c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e80aff70 0x7ff3e80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 0x7ff3e81e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80b0930 con 0x7ff3e81e78d0 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81e8290 con 0x7ff3d00039f0 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3ed4e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8155860 con 0x7ff3e80aff70 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 0x7ff3e81e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 0x7ff3e81e7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58832/0 (socket says 172.21.15.52:58832) 2023-09-30T16:49:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 -- 172.21.15.52:0/2016907100 learned_addr learned my addr 172.21.15.52:0/2016907100 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e67fc640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e80aff70 0x7ff3e80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00039f0 0x7ff3e80c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 -- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e80aff70 msgr2=0x7ff3e80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e80aff70 0x7ff3e80b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 -- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00039f0 msgr2=0x7ff3e80c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00039f0 0x7ff3e80c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 -- 172.21.15.52:0/2016907100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80b2de0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e67fc640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e80aff70 0x7ff3e80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.802+0000 7ff3e77fe640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 0x7ff3e81e7d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80cf040 tx=0x7ff3e000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000de70 con 0x7ff3e81e78d0 2023-09-30T16:49:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e000bb80 con 0x7ff3e81e78d0 2023-09-30T16:49:49.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e80b30c0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0007070 con 0x7ff3e81e78d0 2023-09-30T16:49:49.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e80b3680 con 0x7ff3e81e78d0 2023-09-30T16:49:49.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e80740a0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff3e00071d0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3cf7fe640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff3d4066160 0x7ff3d4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3e0083df0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff3d4066160 0x7ff3d4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.806+0000 7ff3e6ffd640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff3d4066160 0x7ff3d4068620 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80af000 tx=0x7ff3d80b6040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.810+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff3e00514a0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.958+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3e80cf090 con 0x7ff3e81e78d0 2023-09-30T16:49:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.962+0000 7ff3cf7fe640 1 -- 172.21.15.52:0/2016907100 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7ff3e0054ac0 con 0x7ff3e81e78d0 2023-09-30T16:49:49.964 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:49.965 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.962+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff3d4066160 msgr2=0x7ff3d4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.962+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff3d4066160 0x7ff3d4068620 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80af000 tx=0x7ff3d80b6040 comp rx=0 tx=0).stop 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.962+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 msgr2=0x7ff3e81e7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.962+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 0x7ff3e81e7d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80cf040 tx=0x7ff3e000b4a0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 shutdown_connections 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff3d4066160 0x7ff3d4068620 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e81e78d0 0x7ff3e81e7d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3e80aff70 0x7ff3e80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 --2- 172.21.15.52:0/2016907100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3d00039f0 0x7ff3e80c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 >> 172.21.15.52:0/2016907100 conn(0x7ff3e806a5f0 msgr2=0x7ff3e80aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 shutdown_connections 2023-09-30T16:49:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:49.966+0000 7ff3ed4e7640 1 -- 172.21.15.52:0/2016907100 wait complete. 2023-09-30T16:49:49.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:49.982 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 Processor -- start 2023-09-30T16:49:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 -- start start 2023-09-30T16:49:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91c406f750 0x7f91c4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c406a780 con 0x7f91c406a340 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40cbbc0 con 0x7f91c406f750 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c9bf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c406fbb0 con 0x7f91c415ccd0 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91c406f750 0x7f91c4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91c406f750 0x7f91c4069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58840/0 (socket says 172.21.15.52:58840) 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 -- 172.21.15.52:0/2476558479 learned_addr learned my addr 172.21.15.52:0/2476558479 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c37fe640 1 --2- 172.21.15.52:0/2476558479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 -- 172.21.15.52:0/2476558479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 msgr2=0x7f91c406ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 --2- 172.21.15.52:0/2476558479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c406ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 -- 172.21.15.52:0/2476558479 >> v1:172.21.15.186:6789/0 conn(0x7f91c406a340 legacy=0x7f91c41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.094+0000 7f91c2ffd640 1 -- 172.21.15.52:0/2476558479 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c415d0b0 con 0x7f91c406f750 2023-09-30T16:49:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c2ffd640 1 --2- 172.21.15.52:0/2476558479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406f750 0x7f91c4069e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009870 tx=0x7f91b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34df808627607244 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c27fc640 1 -- 172.21.15.52:0/2476558479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a7070 con 0x7f91c406f750 2023-09-30T16:49:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c27fc640 1 -- 172.21.15.52:0/2476558479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80ab430 con 0x7f91c406f750 2023-09-30T16:49:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c27fc640 1 -- 172.21.15.52:0/2476558479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80ab7c0 con 0x7f91c406f750 2023-09-30T16:49:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/2476558479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406f750 msgr2=0x7f91c4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/2476558479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406f750 0x7f91c4069e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009870 tx=0x7f91b801c470 comp rx=0 tx=0).stop 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/2476558479 shutdown_connections 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/2476558479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406f750 0x7f91c4069e00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/2476558479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c406ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/2476558479 >> 172.21.15.52:0/2476558479 conn(0x7f91c406d320 msgr2=0x7f91c406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/2476558479 shutdown_connections 2023-09-30T16:49:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/2476558479 wait complete. 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 Processor -- start 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- start start 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 0x7f91c40c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c406f750 0x7f91c40cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40c32a0 con 0x7f91c406a340 2023-09-30T16:49:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4155b90 con 0x7f91c406f750 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4154ca0 con 0x7f91c415ccd0 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 0x7f91c40c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 0x7f91c40c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58852/0 (socket says 172.21.15.52:58852) 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 -- 172.21.15.52:0/317780105 learned_addr learned my addr 172.21.15.52:0/317780105 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c2ffd640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c406f750 0x7f91c40cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c3fff640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 -- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 msgr2=0x7f91c4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c4157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 -- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c406f750 msgr2=0x7f91c40cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c406f750 0x7f91c40cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 -- 172.21.15.52:0/317780105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80094d0 con 0x7f91c406a340 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c37fe640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 0x7f91c40c6840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f91b400d5f0 tx=0x7f91b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40125f0 con 0x7f91c406a340 2023-09-30T16:49:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4012750 con 0x7f91c406a340 2023-09-30T16:49:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4154f80 con 0x7f91c406a340 2023-09-30T16:49:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4012ae0 con 0x7f91c406a340 2023-09-30T16:49:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.098+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4155540 con 0x7f91c406a340 2023-09-30T16:49:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.102+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c40740a0 con 0x7f91c406a340 2023-09-30T16:49:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.102+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f91b4012c40 con 0x7f91c406a340 2023-09-30T16:49:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.102+0000 7f91abfff640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f91b0066160 0x7f91b0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.102+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91b4083f80 con 0x7f91c406a340 2023-09-30T16:49:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.102+0000 7f91c2ffd640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f91b0066160 0x7f91b0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.102+0000 7f91c2ffd640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f91b0066160 0x7f91b0068620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91b80af000 tx=0x7f91b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.106+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f91b40b4ed0 con 0x7f91c406a340 2023-09-30T16:49:50.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.254+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91c40719e0 con 0x7f91c406a340 2023-09-30T16:49:50.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.254+0000 7f91abfff640 1 -- 172.21.15.52:0/317780105 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91b40515a0 con 0x7f91c406a340 2023-09-30T16:49:50.258 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:50.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f91b0066160 msgr2=0x7f91b0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f91b0066160 0x7f91b0068620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91b80af000 tx=0x7f91b8008040 comp rx=0 tx=0).stop 2023-09-30T16:49:50.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 msgr2=0x7f91c40c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 0x7f91c40c6840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f91b400d5f0 tx=0x7f91b400dab0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 shutdown_connections 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f91b0066160 0x7f91b0068620 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91c415ccd0 0x7f91c4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c406f750 0x7f91c40cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 --2- 172.21.15.52:0/317780105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c406a340 0x7f91c40c6840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 >> 172.21.15.52:0/317780105 conn(0x7f91c406d320 msgr2=0x7f91c40b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 shutdown_connections 2023-09-30T16:49:50.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.258+0000 7f91c9bf5640 1 -- 172.21.15.52:0/317780105 wait complete. 2023-09-30T16:49:50.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 Processor -- start 2023-09-30T16:49:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 -- start start 2023-09-30T16:49:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff144159780 0x7ff14406d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff14406d9b0 0x7ff1440c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14415d3a0 con 0x7ff1440ca260 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1440cd740 con 0x7ff144159780 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14c53f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1440cda20 con 0x7ff14406d9b0 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff144159780 0x7ff14406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff144159780 0x7ff14406d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58858/0 (socket says 172.21.15.52:58858) 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 -- 172.21.15.52:0/3236933878 learned_addr learned my addr 172.21.15.52:0/3236933878 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff149ada640 1 --2- 172.21.15.52:0/3236933878 >> v2:172.21.15.186:3300/0 conn(0x7ff14406d9b0 0x7ff1440c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 -- 172.21.15.52:0/3236933878 >> v2:172.21.15.186:3300/0 conn(0x7ff14406d9b0 msgr2=0x7ff1440c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 --2- 172.21.15.52:0/3236933878 >> v2:172.21.15.186:3300/0 conn(0x7ff14406d9b0 0x7ff1440c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 -- 172.21.15.52:0/3236933878 >> v1:172.21.15.186:6789/0 conn(0x7ff1440ca260 legacy=0x7ff144070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.398+0000 7ff14a2db640 1 -- 172.21.15.52:0/3236933878 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440cdd00 con 0x7ff144159780 2023-09-30T16:49:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 --2- 172.21.15.52:0/3236933878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff144159780 0x7ff14406d470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff14406e3d0 tx=0x7ff14001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f8a58dd6983fb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff1492d9640 1 -- 172.21.15.52:0/3236933878 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140004230 con 0x7ff144159780 2023-09-30T16:49:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff1492d9640 1 -- 172.21.15.52:0/3236933878 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1400a7050 con 0x7ff144159780 2023-09-30T16:49:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff1492d9640 1 -- 172.21.15.52:0/3236933878 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140003620 con 0x7ff144159780 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- 172.21.15.52:0/3236933878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff144159780 msgr2=0x7ff14406d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 --2- 172.21.15.52:0/3236933878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff144159780 0x7ff14406d470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff14406e3d0 tx=0x7ff14001c440 comp rx=0 tx=0).stop 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- 172.21.15.52:0/3236933878 shutdown_connections 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 --2- 172.21.15.52:0/3236933878 >> v2:172.21.15.186:3300/0 conn(0x7ff14406d9b0 0x7ff1440c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 --2- 172.21.15.52:0/3236933878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff144159780 0x7ff14406d470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- 172.21.15.52:0/3236933878 >> 172.21.15.52:0/3236933878 conn(0x7ff14406a5c0 msgr2=0x7ff1440ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- 172.21.15.52:0/3236933878 shutdown_connections 2023-09-30T16:49:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- 172.21.15.52:0/3236933878 wait complete. 2023-09-30T16:49:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 Processor -- start 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- start start 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 0x7ff14414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff144159780 0x7ff144150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff144154620 0x7ff14415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff144150e00 con 0x7ff1440ca260 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1441510e0 con 0x7ff144154620 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14c53f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1441513c0 con 0x7ff144159780 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 0x7ff14414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 0x7ff14414ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58870/0 (socket says 172.21.15.52:58870) 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 -- 172.21.15.52:0/2645128341 learned_addr learned my addr 172.21.15.52:0/2645128341 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff149ada640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff144159780 0x7ff144150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 -- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff144159780 msgr2=0x7ff144150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff144159780 0x7ff144150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 -- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff144154620 msgr2=0x7ff14415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff144154620 0x7ff14415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 -- 172.21.15.52:0/2645128341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400094d0 con 0x7ff1440ca260 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.402+0000 7ff14a2db640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 0x7ff14414ee40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff1400ae040 tx=0x7ff1400191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140003bf0 con 0x7ff1440ca260 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140003d50 con 0x7ff1440ca260 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1441516a0 con 0x7ff1440ca260 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1400ab660 con 0x7ff1440ca260 2023-09-30T16:49:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14414f380 con 0x7ff1440ca260 2023-09-30T16:49:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1440740a0 con 0x7ff1440ca260 2023-09-30T16:49:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff1400ab7c0 con 0x7ff1440ca260 2023-09-30T16:49:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff13affd640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff128066190 0x7ff128068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff14011de80 con 0x7ff1440ca260 2023-09-30T16:49:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff149ada640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff128066190 0x7ff128068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.406+0000 7ff149ada640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff128066190 0x7ff128068650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff144157590 tx=0x7ff134008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.410+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff1400eb410 con 0x7ff1440ca260 2023-09-30T16:49:50.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.562+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1440713d0 con 0x7ff1440ca260 2023-09-30T16:49:50.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.562+0000 7ff13affd640 1 -- 172.21.15.52:0/2645128341 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1400eea30 con 0x7ff1440ca260 2023-09-30T16:49:50.565 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff128066190 msgr2=0x7ff128068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff128066190 0x7ff128068650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff144157590 tx=0x7ff134008040 comp rx=0 tx=0).stop 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 msgr2=0x7ff14414ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 0x7ff14414ee40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff1400ae040 tx=0x7ff1400191e0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 shutdown_connections 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff128066190 0x7ff128068650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff144154620 0x7ff14415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff144159780 0x7ff144150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 --2- 172.21.15.52:0/2645128341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1440ca260 0x7ff14414ee40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 >> 172.21.15.52:0/2645128341 conn(0x7ff14406a5c0 msgr2=0x7ff14406ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:50.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 shutdown_connections 2023-09-30T16:49:50.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.566+0000 7ff14c53f640 1 -- 172.21.15.52:0/2645128341 wait complete. 2023-09-30T16:49:50.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:50.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.710+0000 7efc41363640 1 Processor -- start 2023-09-30T16:49:50.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.710+0000 7efc41363640 1 -- start start 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc41363640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc3c06d060 0x7efc3c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc41363640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efc3c0c9460 0x7efc3c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc41363640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c0aded0 con 0x7efc3c159080 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc41363640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c159460 con 0x7efc3c06d060 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc41363640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c06d510 con 0x7efc3c0c9460 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efc3c159080 0x7efc3c06c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39416/0 (socket says 172.21.15.52:39416) 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3affd640 1 -- 172.21.15.52:0/3550299469 learned_addr learned my addr 172.21.15.52:0/3550299469 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3a7fc640 1 --2- 172.21.15.52:0/3550299469 >> v2:172.21.15.52:3300/0 conn(0x7efc3c06d060 0x7efc3c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc39ffb640 1 -- 172.21.15.52:0/3550299469 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475869902 0 0) 0x7efc3c0aded0 con 0x7efc3c159080 2023-09-30T16:49:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc39ffb640 1 -- 172.21.15.52:0/3550299469 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc28003530 con 0x7efc3c159080 2023-09-30T16:49:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3b7fe640 1 --2- 172.21.15.52:0/3550299469 >> v2:172.21.15.186:3300/0 conn(0x7efc3c0c9460 0x7efc3c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3a7fc640 1 -- 172.21.15.52:0/3550299469 >> v2:172.21.15.186:3300/0 conn(0x7efc3c0c9460 msgr2=0x7efc3c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3a7fc640 1 --2- 172.21.15.52:0/3550299469 >> v2:172.21.15.186:3300/0 conn(0x7efc3c0c9460 0x7efc3c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3a7fc640 1 -- 172.21.15.52:0/3550299469 >> v1:172.21.15.52:6789/0 conn(0x7efc3c159080 legacy=0x7efc3c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc39ffb640 1 -- 172.21.15.52:0/3550299469 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203397387 0 0) 0x7efc28003530 con 0x7efc3c159080 2023-09-30T16:49:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3a7fc640 1 -- 172.21.15.52:0/3550299469 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c06d7f0 con 0x7efc3c06d060 2023-09-30T16:49:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc3a7fc640 1 --2- 172.21.15.52:0/3550299469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c06d060 0x7efc3c0b00a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0b10f0 tx=0x7efc2401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5120d5054080bde8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc39ffb640 1 -- 172.21.15.52:0/3550299469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34001a00 con 0x7efc3c06d060 2023-09-30T16:49:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc39ffb640 1 -- 172.21.15.52:0/3550299469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc240a7050 con 0x7efc3c06d060 2023-09-30T16:49:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.714+0000 7efc39ffb640 1 -- 172.21.15.52:0/3550299469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc240ab620 con 0x7efc3c06d060 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/3550299469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c06d060 msgr2=0x7efc3c0b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 --2- 172.21.15.52:0/3550299469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c06d060 0x7efc3c0b00a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0b10f0 tx=0x7efc2401c350 comp rx=0 tx=0).stop 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/3550299469 shutdown_connections 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 --2- 172.21.15.52:0/3550299469 >> v2:172.21.15.186:3300/0 conn(0x7efc3c0c9460 0x7efc3c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 --2- 172.21.15.52:0/3550299469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c06d060 0x7efc3c0b00a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/3550299469 >> 172.21.15.52:0/3550299469 conn(0x7efc3c06a5c0 msgr2=0x7efc3c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/3550299469 shutdown_connections 2023-09-30T16:49:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/3550299469 wait complete. 2023-09-30T16:49:50.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 Processor -- start 2023-09-30T16:49:50.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- start start 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc3c06d060 0x7efc3c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 0x7efc3c0ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc3c159080 0x7efc3c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c15ba20 con 0x7efc3c0c9460 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0c8bd0 con 0x7efc3c159080 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c15ae10 con 0x7efc3c06d060 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 0x7efc3c0ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 0x7efc3c0ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58882/0 (socket says 172.21.15.52:58882) 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 -- 172.21.15.52:0/763753983 learned_addr learned my addr 172.21.15.52:0/763753983 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3b7fe640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc3c159080 0x7efc3c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 -- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc3c06d060 msgr2=0x7efc3c14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3affd640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc3c06d060 0x7efc3c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc3c06d060 0x7efc3c14aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 -- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc3c159080 msgr2=0x7efc3c1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc3c159080 0x7efc3c1546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 -- 172.21.15.52:0/763753983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24009420 con 0x7efc3c0c9460 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3b7fe640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc3c159080 0x7efc3c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc3a7fc640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 0x7efc3c0ac500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc240ae040 tx=0x7efc2401ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc240b7450 con 0x7efc3c0c9460 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc240b75b0 con 0x7efc3c0c9460 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c15b0f0 con 0x7efc3c0c9460 2023-09-30T16:49:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc240b7960 con 0x7efc3c0c9460 2023-09-30T16:49:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.718+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c15b6b0 con 0x7efc3c0c9460 2023-09-30T16:49:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.722+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c0740a0 con 0x7efc3c0c9460 2023-09-30T16:49:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.722+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7efc240b7ac0 con 0x7efc3c0c9460 2023-09-30T16:49:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.722+0000 7efc337fe640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc1c066160 0x7efc1c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:50.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.722+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc2411e320 con 0x7efc3c0c9460 2023-09-30T16:49:50.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.722+0000 7efc3affd640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc1c066160 0x7efc1c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:50.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.722+0000 7efc3affd640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc1c066160 0x7efc1c068620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc34002240 tx=0x7efc34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:50.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.726+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7efc240eba60 con 0x7efc3c0c9460 2023-09-30T16:49:50.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc3c06c1e0 con 0x7efc3c0c9460 2023-09-30T16:49:50.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc337fe640 1 -- 172.21.15.52:0/763753983 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc240ef080 con 0x7efc3c0c9460 2023-09-30T16:49:50.876 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:50.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc1c066160 msgr2=0x7efc1c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc1c066160 0x7efc1c068620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc34002240 tx=0x7efc34009040 comp rx=0 tx=0).stop 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 msgr2=0x7efc3c0ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 0x7efc3c0ac500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc240ae040 tx=0x7efc2401ab90 comp rx=0 tx=0).stop 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 shutdown_connections 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc1c066160 0x7efc1c068620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc3c159080 0x7efc3c1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc3c0c9460 0x7efc3c0ac500 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 --2- 172.21.15.52:0/763753983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc3c06d060 0x7efc3c14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.874+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 >> 172.21.15.52:0/763753983 conn(0x7efc3c06a5c0 msgr2=0x7efc3c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:50.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.878+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 shutdown_connections 2023-09-30T16:49:50.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:50.878+0000 7efc41363640 1 -- 172.21.15.52:0/763753983 wait complete. 2023-09-30T16:49:50.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 Processor -- start 2023-09-30T16:49:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 -- start start 2023-09-30T16:49:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e940b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e940b00a0 0x7f5e940b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9415ea50 con 0x7f5e9415a8b0 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e940b0a70 con 0x7f5e940b00a0 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9bc58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9415ed30 con 0x7f5e9415e4b0 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9a1f5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e940b00a0 0x7f5e940b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9a1f5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e940b00a0 0x7f5e940b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58896/0 (socket says 172.21.15.52:58896) 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9a1f5640 1 -- 172.21.15.52:0/541772243 learned_addr learned my addr 172.21.15.52:0/541772243 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e991f3640 1 --2- 172.21.15.52:0/541772243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e940b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9a1f5640 1 -- 172.21.15.52:0/541772243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 msgr2=0x7f5e940b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.006+0000 7f5e9a1f5640 1 --2- 172.21.15.52:0/541772243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e940b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9a1f5640 1 -- 172.21.15.52:0/541772243 >> v1:172.21.15.186:6789/0 conn(0x7f5e9415a8b0 legacy=0x7f5e9406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9a1f5640 1 -- 172.21.15.52:0/541772243 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9415f010 con 0x7f5e940b00a0 2023-09-30T16:49:51.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9a1f5640 1 --2- 172.21.15.52:0/541772243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e940b00a0 0x7f5e940b0530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009870 tx=0x7f5e8c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97158b1f326dbc20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e989f2640 1 -- 172.21.15.52:0/541772243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0aa670 con 0x7f5e940b00a0 2023-09-30T16:49:51.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e989f2640 1 -- 172.21.15.52:0/541772243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c0aa7d0 con 0x7f5e940b00a0 2023-09-30T16:49:51.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e989f2640 1 -- 172.21.15.52:0/541772243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0aab60 con 0x7f5e940b00a0 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 -- 172.21.15.52:0/541772243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e940b00a0 msgr2=0x7f5e940b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/541772243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e940b00a0 0x7f5e940b0530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009870 tx=0x7f5e8c01c510 comp rx=0 tx=0).stop 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 -- 172.21.15.52:0/541772243 shutdown_connections 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/541772243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e940b00a0 0x7f5e940b0530 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/541772243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e940b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 -- 172.21.15.52:0/541772243 >> 172.21.15.52:0/541772243 conn(0x7f5e9406a5c0 msgr2=0x7f5e940ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:51.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 -- 172.21.15.52:0/541772243 shutdown_connections 2023-09-30T16:49:51.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.010+0000 7f5e9bc58640 1 -- 172.21.15.52:0/541772243 wait complete. 2023-09-30T16:49:51.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 Processor -- start 2023-09-30T16:49:51.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- start start 2023-09-30T16:49:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e940b00a0 0x7f5e940c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 0x7f5e940c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e94155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c2140 con 0x7f5e9415a8b0 2023-09-30T16:49:51.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c2420 con 0x7f5e940b00a0 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c2700 con 0x7f5e9415e4b0 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 0x7f5e940c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 0x7f5e940c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58906/0 (socket says 172.21.15.52:58906) 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 -- 172.21.15.52:0/3639359667 learned_addr learned my addr 172.21.15.52:0/3639359667 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9a1f5640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e94155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e999f4640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e940b00a0 0x7f5e940c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 -- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 msgr2=0x7f5e94155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e94155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 -- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e940b00a0 msgr2=0x7f5e940c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e940b00a0 0x7f5e940c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 -- 172.21.15.52:0/3639359667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0094d0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e999f4640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e940b00a0 0x7f5e940c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e991f3640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 0x7f5e940c82f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d5f0 tx=0x7f5e8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e880125f0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88012750 con 0x7f5e9415a8b0 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e940c29e0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88012ae0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e940c72c0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e940740a0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.014+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f5e88012c40 con 0x7f5e9415a8b0 2023-09-30T16:49:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.018+0000 7f5e927fc640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5e80066190 0x7f5e80068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.018+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e88083e40 con 0x7f5e9415a8b0 2023-09-30T16:49:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.018+0000 7f5e999f4640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5e80066190 0x7f5e80068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.018+0000 7f5e999f4640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5e80066190 0x7f5e80068650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5e840012f0 tx=0x7f5e84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.022+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5e880514f0 con 0x7f5e9415a8b0 2023-09-30T16:49:51.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e940c2280 con 0x7f5e9415a8b0 2023-09-30T16:49:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e927fc640 1 -- 172.21.15.52:0/3639359667 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e940c2280 con 0x7f5e9415a8b0 2023-09-30T16:49:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5e80066190 msgr2=0x7f5e80068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5e80066190 0x7f5e80068650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5e840012f0 tx=0x7f5e84009040 comp rx=0 tx=0).stop 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 msgr2=0x7f5e940c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 0x7f5e940c82f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d5f0 tx=0x7f5e8800dab0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 shutdown_connections 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5e80066190 0x7f5e80068650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e9415e4b0 0x7f5e94155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e9415a8b0 0x7f5e940c82f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 --2- 172.21.15.52:0/3639359667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e940b00a0 0x7f5e940c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 >> 172.21.15.52:0/3639359667 conn(0x7f5e9406a5c0 msgr2=0x7f5e940b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:51.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 shutdown_connections 2023-09-30T16:49:51.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.190+0000 7f5e9bc58640 1 -- 172.21.15.52:0/3639359667 wait complete. 2023-09-30T16:49:51.211 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2023-09-30T16:49:51.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:51.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T16:49:51.235 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:49:51.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:49:51.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:51.235 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T16:49:51.287 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:49:51.287 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:51.294 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:49:51.294 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:51.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 Processor -- start 2023-09-30T16:49:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 -- start start 2023-09-30T16:49:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2264158ff0 0x7f22640b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22640b05e0 0x7f226406c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22640b0a40 con 0x7f226406cb40 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22640cc320 con 0x7f22640b05e0 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2269991640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226406cfd0 con 0x7f2264158ff0 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22640b05e0 0x7f226406c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f22640b05e0 0x7f226406c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58914/0 (socket says 172.21.15.52:58914) 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 -- 172.21.15.52:0/2766108975 learned_addr learned my addr 172.21.15.52:0/2766108975 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2262ffd640 1 --2- 172.21.15.52:0/2766108975 >> v2:172.21.15.186:3300/0 conn(0x7f2264158ff0 0x7f22640b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 -- 172.21.15.52:0/2766108975 >> v2:172.21.15.186:3300/0 conn(0x7f2264158ff0 msgr2=0x7f22640b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 --2- 172.21.15.52:0/2766108975 >> v2:172.21.15.186:3300/0 conn(0x7f2264158ff0 0x7f22640b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 -- 172.21.15.52:0/2766108975 >> v1:172.21.15.186:6789/0 conn(0x7f226406cb40 legacy=0x7f226415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f225a7fc640 1 -- 172.21.15.52:0/2766108975 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226406d2a0 con 0x7f22640b05e0 2023-09-30T16:49:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.470+0000 7f2262ffd640 1 --2- 172.21.15.52:0/2766108975 >> v2:172.21.15.186:3300/0 conn(0x7f2264158ff0 0x7f22640b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:51.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f225a7fc640 1 --2- 172.21.15.52:0/2766108975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22640b05e0 0x7f226406c600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2264071270 tx=0x7f224c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d310da29228573d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f22627fc640 1 -- 172.21.15.52:0/2766108975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c0ab600 con 0x7f22640b05e0 2023-09-30T16:49:51.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f22627fc640 1 -- 172.21.15.52:0/2766108975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c0a7050 con 0x7f22640b05e0 2023-09-30T16:49:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f22627fc640 1 -- 172.21.15.52:0/2766108975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c0ab980 con 0x7f22640b05e0 2023-09-30T16:49:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 -- 172.21.15.52:0/2766108975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22640b05e0 msgr2=0x7f226406c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 --2- 172.21.15.52:0/2766108975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22640b05e0 0x7f226406c600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2264071270 tx=0x7f224c01c400 comp rx=0 tx=0).stop 2023-09-30T16:49:51.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 -- 172.21.15.52:0/2766108975 shutdown_connections 2023-09-30T16:49:51.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 --2- 172.21.15.52:0/2766108975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22640b05e0 0x7f226406c600 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 --2- 172.21.15.52:0/2766108975 >> v2:172.21.15.186:3300/0 conn(0x7f2264158ff0 0x7f22640b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 -- 172.21.15.52:0/2766108975 >> 172.21.15.52:0/2766108975 conn(0x7f226406a5f0 msgr2=0x7f22640ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:51.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 -- 172.21.15.52:0/2766108975 shutdown_connections 2023-09-30T16:49:51.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 -- 172.21.15.52:0/2766108975 wait complete. 2023-09-30T16:49:51.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 Processor -- start 2023-09-30T16:49:51.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 -- start start 2023-09-30T16:49:51.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.474+0000 7f2269991640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 0x7f226414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22640b05e0 0x7f2264149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2264158ff0 0x7f22640b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640af7b0 con 0x7f226406cb40 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640af4d0 con 0x7f22640b05e0 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226414e2c0 con 0x7f2264158ff0 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 0x7f226414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 0x7f226414eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58916/0 (socket says 172.21.15.52:58916) 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 -- 172.21.15.52:0/2130756595 learned_addr learned my addr 172.21.15.52:0/2130756595 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f225a7fc640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22640b05e0 0x7f2264149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f22637fe640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2264158ff0 0x7f22640b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 -- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2264158ff0 msgr2=0x7f22640b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2264158ff0 0x7f22640b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 -- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22640b05e0 msgr2=0x7f2264149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22640b05e0 0x7f2264149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 -- 172.21.15.52:0/2130756595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0094d0 con 0x7f226406cb40 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f22637fe640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2264158ff0 0x7f22640b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2262ffd640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 0x7f226414eda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f225400c7f0 tx=0x7f225400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254007820 con 0x7f226406cb40 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254007980 con 0x7f226406cb40 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254007d30 con 0x7f226406cb40 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226414e5a0 con 0x7f226406cb40 2023-09-30T16:49:51.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2264149fa0 con 0x7f226406cb40 2023-09-30T16:49:51.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22640740a0 con 0x7f226406cb40 2023-09-30T16:49:51.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f22540113f0 con 0x7f226406cb40 2023-09-30T16:49:51.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2260ff9640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2244066160 0x7f2244068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2254083df0 con 0x7f226406cb40 2023-09-30T16:49:51.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.478+0000 7f225a7fc640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2244066160 0x7f2244068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.482+0000 7f225a7fc640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2244066160 0x7f2244068620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f224c0ad000 tx=0x7f224c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.482+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f2254051410 con 0x7f226406cb40 2023-09-30T16:49:51.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.638+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f226406c1b0 con 0x7f226406cb40 2023-09-30T16:49:51.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2260ff9640 1 -- 172.21.15.52:0/2130756595 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f2254054a30 con 0x7f226406cb40 2023-09-30T16:49:51.644 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:51.644 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:51.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2244066160 msgr2=0x7f2244068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2244066160 0x7f2244068620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f224c0ad000 tx=0x7f224c008040 comp rx=0 tx=0).stop 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 msgr2=0x7f226414eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 0x7f226414eda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f225400c7f0 tx=0x7f225400ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 shutdown_connections 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2244066160 0x7f2244068620 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2264158ff0 0x7f22640b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22640b05e0 0x7f2264149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 --2- 172.21.15.52:0/2130756595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f226406cb40 0x7f226414eda0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 >> 172.21.15.52:0/2130756595 conn(0x7f226406a5f0 msgr2=0x7f226415a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:51.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 shutdown_connections 2023-09-30T16:49:51.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.642+0000 7f2269991640 1 -- 172.21.15.52:0/2130756595 wait complete. 2023-09-30T16:49:51.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:51.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.782+0000 7f85ac01d640 1 Processor -- start 2023-09-30T16:49:51.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.782+0000 7f85ac01d640 1 -- start start 2023-09-30T16:49:51.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85ac01d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f85a40c9d20 0x7f85a4070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85ac01d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85a40ca1a0 0x7f85a40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85ac01d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a415d3a0 con 0x7f85a4159780 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85ac01d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a406db80 con 0x7f85a40ca1a0 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85ac01d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a40cd740 con 0x7f85a40c9d20 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85a40ca1a0 0x7f85a40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85a40ca1a0 0x7f85a40705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58930/0 (socket says 172.21.15.52:58930) 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 -- 172.21.15.52:0/3447492711 learned_addr learned my addr 172.21.15.52:0/3447492711 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85a95b8640 1 --2- 172.21.15.52:0/3447492711 >> v2:172.21.15.186:3300/0 conn(0x7f85a40c9d20 0x7f85a4070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 -- 172.21.15.52:0/3447492711 >> v2:172.21.15.186:3300/0 conn(0x7f85a40c9d20 msgr2=0x7f85a4070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 --2- 172.21.15.52:0/3447492711 >> v2:172.21.15.186:3300/0 conn(0x7f85a40c9d20 0x7f85a4070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 -- 172.21.15.52:0/3447492711 >> v1:172.21.15.186:6789/0 conn(0x7f85a4159780 legacy=0x7f85a406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 -- 172.21.15.52:0/3447492711 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40cda20 con 0x7f85a40ca1a0 2023-09-30T16:49:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85aa5ba640 1 --2- 172.21.15.52:0/3447492711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a40ca1a0 0x7f85a40705b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f85a406e3d0 tx=0x7f859c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a5e3bf99812a8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85a8db7640 1 -- 172.21.15.52:0/3447492711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0a5790 con 0x7f85a40ca1a0 2023-09-30T16:49:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85a8db7640 1 -- 172.21.15.52:0/3447492711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c0a58f0 con 0x7f85a40ca1a0 2023-09-30T16:49:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.786+0000 7f85a8db7640 1 -- 172.21.15.52:0/3447492711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0a5c80 con 0x7f85a40ca1a0 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/3447492711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a40ca1a0 msgr2=0x7f85a40705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 --2- 172.21.15.52:0/3447492711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a40ca1a0 0x7f85a40705b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f85a406e3d0 tx=0x7f859c01c8d0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/3447492711 shutdown_connections 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 --2- 172.21.15.52:0/3447492711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a40ca1a0 0x7f85a40705b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 --2- 172.21.15.52:0/3447492711 >> v2:172.21.15.186:3300/0 conn(0x7f85a40c9d20 0x7f85a4070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/3447492711 >> 172.21.15.52:0/3447492711 conn(0x7f85a406a5c0 msgr2=0x7f85a40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:51.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/3447492711 shutdown_connections 2023-09-30T16:49:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/3447492711 wait complete. 2023-09-30T16:49:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 Processor -- start 2023-09-30T16:49:51.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- start start 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85a40c9d20 0x7f85a414bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85a40ca1a0 0x7f85a40c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 0x7f85a40ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40aba10 con 0x7f85a4159780 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40abcf0 con 0x7f85a40ca1a0 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40abfd0 con 0x7f85a40c9d20 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 0x7f85a40ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 0x7f85a40ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58946/0 (socket says 172.21.15.52:58946) 2023-09-30T16:49:51.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 -- 172.21.15.52:0/2232863688 learned_addr learned my addr 172.21.15.52:0/2232863688 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85a95b8640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85a40ca1a0 0x7f85a40c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85a9db9640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85a40c9d20 0x7f85a414bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 -- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85a40c9d20 msgr2=0x7f85a414bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85a40c9d20 0x7f85a414bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 -- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85a40ca1a0 msgr2=0x7f85a40c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85a40ca1a0 0x7f85a40c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 -- 172.21.15.52:0/2232863688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c009b30 con 0x7f85a4159780 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85aa5ba640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 0x7f85a40ac7b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f859c01a500 tx=0x7f859c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b8670 con 0x7f85a4159780 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c0b87d0 con 0x7f85a4159780 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a40ac2b0 con 0x7f85a4159780 2023-09-30T16:49:51.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b8b60 con 0x7f85a4159780 2023-09-30T16:49:51.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.790+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a414c110 con 0x7f85a4159780 2023-09-30T16:49:51.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.794+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a40740a0 con 0x7f85a4159780 2023-09-30T16:49:51.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.794+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f859c0b8cc0 con 0x7f85a4159780 2023-09-30T16:49:51.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.794+0000 7f859a7fc640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8588066160 0x7f8588068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:51.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.794+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f859c11f000 con 0x7f85a4159780 2023-09-30T16:49:51.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.794+0000 7f85a9db9640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8588066160 0x7f8588068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:51.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.794+0000 7f85a9db9640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8588066160 0x7f8588068620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85a000b810 tx=0x7f85a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:51.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.798+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f859c0ec7d0 con 0x7f85a4159780 2023-09-30T16:49:51.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.958+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85a40abb50 con 0x7f85a4159780 2023-09-30T16:49:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.958+0000 7f859a7fc640 1 -- 172.21.15.52:0/2232863688 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85a40abb50 con 0x7f85a4159780 2023-09-30T16:49:51.960 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8588066160 msgr2=0x7f8588068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8588066160 0x7f8588068620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85a000b810 tx=0x7f85a0008040 comp rx=0 tx=0).stop 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 msgr2=0x7f85a40ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 0x7f85a40ac7b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f859c01a500 tx=0x7f859c019670 comp rx=0 tx=0).stop 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 shutdown_connections 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8588066160 0x7f8588068620 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85a4159780 0x7f85a40ac7b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85a40ca1a0 0x7f85a40c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 --2- 172.21.15.52:0/2232863688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85a40c9d20 0x7f85a414bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:51.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 >> 172.21.15.52:0/2232863688 conn(0x7f85a406a5c0 msgr2=0x7f85a40cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:51.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 shutdown_connections 2023-09-30T16:49:51.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:51.962+0000 7f85ac01d640 1 -- 172.21.15.52:0/2232863688 wait complete. 2023-09-30T16:49:51.980 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 Processor -- start 2023-09-30T16:49:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 -- start start 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1fe80d0210 0x7f1fe80d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe80d25b0 0x7f1fe80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80d39b0 con 0x7f1fe815cc60 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe815d040 con 0x7f1fe80d25b0 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1feebfa640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80d2da0 con 0x7f1fe80d0210 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fed197640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe80d25b0 0x7f1fe80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fec996640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1fe815cc60 0x7f1fe80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39432/0 (socket says 172.21.15.52:39432) 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fec996640 1 -- 172.21.15.52:0/622633782 learned_addr learned my addr 172.21.15.52:0/622633782 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fe7fff640 1 --2- 172.21.15.52:0/622633782 >> v2:172.21.15.186:3300/0 conn(0x7f1fe80d0210 0x7f1fe80d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fed197640 1 -- 172.21.15.52:0/622633782 >> v2:172.21.15.186:3300/0 conn(0x7f1fe80d0210 msgr2=0x7f1fe80d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fed197640 1 --2- 172.21.15.52:0/622633782 >> v2:172.21.15.186:3300/0 conn(0x7f1fe80d0210 0x7f1fe80d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fed197640 1 -- 172.21.15.52:0/622633782 >> v1:172.21.15.52:6789/0 conn(0x7f1fe815cc60 legacy=0x7f1fe80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fe77fe640 1 -- 172.21.15.52:0/622633782 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073845059 0 0) 0x7f1fe80d39b0 con 0x7f1fe815cc60 2023-09-30T16:49:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.102+0000 7f1fed197640 1 -- 172.21.15.52:0/622633782 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80d3080 con 0x7f1fe80d25b0 2023-09-30T16:49:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fed197640 1 --2- 172.21.15.52:0/622633782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d25b0 0x7f1fe80b5f70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80cf130 tx=0x7f1fe001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5e6db523736f0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fe77fe640 1 -- 172.21.15.52:0/622633782 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00a59a0 con 0x7f1fe80d25b0 2023-09-30T16:49:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fe77fe640 1 -- 172.21.15.52:0/622633782 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe00a5b00 con 0x7f1fe80d25b0 2023-09-30T16:49:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fe77fe640 1 -- 172.21.15.52:0/622633782 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00a5e90 con 0x7f1fe80d25b0 2023-09-30T16:49:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- 172.21.15.52:0/622633782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d25b0 msgr2=0x7f1fe80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 --2- 172.21.15.52:0/622633782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d25b0 0x7f1fe80b5f70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80cf130 tx=0x7f1fe001c8e0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- 172.21.15.52:0/622633782 shutdown_connections 2023-09-30T16:49:52.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 --2- 172.21.15.52:0/622633782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d25b0 0x7f1fe80b5f70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 --2- 172.21.15.52:0/622633782 >> v2:172.21.15.186:3300/0 conn(0x7f1fe80d0210 0x7f1fe80d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- 172.21.15.52:0/622633782 >> 172.21.15.52:0/622633782 conn(0x7f1fe8071930 msgr2=0x7f1fe8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- 172.21.15.52:0/622633782 shutdown_connections 2023-09-30T16:49:52.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- 172.21.15.52:0/622633782 wait complete. 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 Processor -- start 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- start start 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 0x7f1fe814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe80d25b0 0x7f1fe8149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe815cc60 0x7f1fe814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe814db70 con 0x7f1fe80d0210 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe814d5b0 con 0x7f1fe80d25b0 2023-09-30T16:49:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1feebfa640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe814d890 con 0x7f1fe815cc60 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fec996640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 0x7f1fe814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fec996640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 0x7f1fe814cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58968/0 (socket says 172.21.15.52:58968) 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.106+0000 7f1fec996640 1 -- 172.21.15.52:0/4083588042 learned_addr learned my addr 172.21.15.52:0/4083588042 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe7fff640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe80d25b0 0x7f1fe8149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fed197640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe815cc60 0x7f1fe814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fec996640 1 -- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe815cc60 msgr2=0x7f1fe814a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fec996640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe815cc60 0x7f1fe814a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fec996640 1 -- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe80d25b0 msgr2=0x7f1fe8149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fec996640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe80d25b0 0x7f1fe8149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fec996640 1 -- 172.21.15.52:0/4083588042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0009a70 con 0x7f1fe80d0210 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe7fff640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe80d25b0 0x7f1fe8149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fec996640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 0x7f1fe814cd20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c480 tx=0x7f1fd800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80074e0 con 0x7f1fe80d0210 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8007660 con 0x7f1fe80d0210 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8004a30 con 0x7f1fe80d0210 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe814f100 con 0x7f1fe80d0210 2023-09-30T16:49:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe814d260 con 0x7f1fe80d0210 2023-09-30T16:49:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe814ef60 con 0x7f1fe80d0210 2023-09-30T16:49:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1fd8004b90 con 0x7f1fe80d0210 2023-09-30T16:49:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe57fa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1fd4066190 0x7f1fd4068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fd8082bd0 con 0x7f1fe80d0210 2023-09-30T16:49:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe7fff640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1fd4066190 0x7f1fd4068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.110+0000 7f1fe7fff640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1fd4066190 0x7f1fd4068650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80b2570 tx=0x7f1fdc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.114+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1fe814ef60 con 0x7f1fe80d0210 2023-09-30T16:49:52.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fe814f620 con 0x7f1fe80d0210 2023-09-30T16:49:52.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1fe57fa640 1 -- 172.21.15.52:0/4083588042 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fe814f620 con 0x7f1fe80d0210 2023-09-30T16:49:52.271 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1fd4066190 msgr2=0x7f1fd4068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1fd4066190 0x7f1fd4068650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80b2570 tx=0x7f1fdc008040 comp rx=0 tx=0).stop 2023-09-30T16:49:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 msgr2=0x7f1fe814cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 0x7f1fe814cd20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c480 tx=0x7f1fd800c940 comp rx=0 tx=0).stop 2023-09-30T16:49:52.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 shutdown_connections 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1fd4066190 0x7f1fd4068650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe815cc60 0x7f1fe814a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe80d25b0 0x7f1fe8149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 --2- 172.21.15.52:0/4083588042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe80d0210 0x7f1fe814cd20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 >> 172.21.15.52:0/4083588042 conn(0x7f1fe8071930 msgr2=0x7f1fe815b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 shutdown_connections 2023-09-30T16:49:52.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.270+0000 7f1feebfa640 1 -- 172.21.15.52:0/4083588042 wait complete. 2023-09-30T16:49:52.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:52.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.414+0000 7f28f09d8640 1 Processor -- start 2023-09-30T16:49:52.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.414+0000 7f28f09d8640 1 -- start start 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28f09d8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 0x7f28ec15d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28f09d8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec15d3a0 con 0x7f28ec159780 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28f09d8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec06db80 con 0x7f28ec0c9d20 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28f09d8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0cd740 con 0x7f28ec070780 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ea59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f28ec159780 0x7f28ec06d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39434/0 (socket says 172.21.15.52:39434) 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ea59c640 1 -- 172.21.15.52:0/3949414393 learned_addr learned my addr 172.21.15.52:0/3949414393 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 0x7f28ec15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341059799 0 0) 0x7f28ec15d3a0 con 0x7f28ec159780 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d8005740 con 0x7f28ec159780 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882905116 0 0) 0x7f28d8005740 con 0x7f28ec159780 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 msgr2=0x7f28ec15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 0x7f28ec15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 >> v1:172.21.15.186:6789/0 conn(0x7f28ec0c9d20 legacy=0x7f28ec070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0cda20 con 0x7f28ec159780 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f28d4001a00 con 0x7f28ec159780 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 >> v1:172.21.15.52:6789/0 conn(0x7f28ec159780 legacy=0x7f28ec06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 0x7f28d8005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28d8006140 0x7f28d80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d8006f20 0x7f28d80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0cd740 con 0x7f28d8006f20 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d800dd30 con 0x7f28d8006140 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d800def0 con 0x7f28ec070780 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d8006f20 0x7f28d80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ea59c640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 0x7f28d8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28e9d9b640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28d8006140 0x7f28d80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 -- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 msgr2=0x7f28d8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec070780 0x7f28d8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 -- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28d8006140 msgr2=0x7f28d80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28d8006140 0x7f28d80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.418+0000 7f28ead9d640 1 -- 172.21.15.52:0/3949414393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d8005740 con 0x7f28d8006f20 2023-09-30T16:49:52.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28ead9d640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d8006f20 0x7f28d80073a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009ab0 tx=0x7f28e401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653818fe77032523 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40a5510 con 0x7f28d8006f20 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e40a5670 con 0x7f28d8006f20 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28e959a640 1 -- 172.21.15.52:0/3949414393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40a5a20 con 0x7f28d8006f20 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- 172.21.15.52:0/3949414393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d8006f20 msgr2=0x7f28d80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 --2- 172.21.15.52:0/3949414393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d8006f20 0x7f28d80073a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009ab0 tx=0x7f28e401ca30 comp rx=0 tx=0).stop 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28ead9d640 1 -- 172.21.15.52:0/3949414393 reap_dead start 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- 172.21.15.52:0/3949414393 shutdown_connections 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- 172.21.15.52:0/3949414393 >> 172.21.15.52:0/3949414393 conn(0x7f28ec06a5c0 msgr2=0x7f28ec0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- 172.21.15.52:0/3949414393 shutdown_connections 2023-09-30T16:49:52.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- 172.21.15.52:0/3949414393 wait complete. 2023-09-30T16:49:52.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 Processor -- start 2023-09-30T16:49:52.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- start start 2023-09-30T16:49:52.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28ec0c78d0 0x7f28ec0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 0x7f28ec0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec0c7cb0 0x7f28ec15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c5140 con 0x7f28ec0b3100 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0b2060 con 0x7f28ec0c78d0 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28f09d8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0b2340 con 0x7f28ec0c7cb0 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28e9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 0x7f28ec0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28e9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 0x7f28ec0c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58976/0 (socket says 172.21.15.52:58976) 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.422+0000 7f28e9d9b640 1 -- 172.21.15.52:0/4200837679 learned_addr learned my addr 172.21.15.52:0/4200837679 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28ead9d640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec0c7cb0 0x7f28ec15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28ea59c640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28ec0c78d0 0x7f28ec0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e9d9b640 1 -- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec0c7cb0 msgr2=0x7f28ec15be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e9d9b640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec0c7cb0 0x7f28ec15be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e9d9b640 1 -- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28ec0c78d0 msgr2=0x7f28ec0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e9d9b640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28ec0c78d0 0x7f28ec0b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e9d9b640 1 -- 172.21.15.52:0/4200837679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0b2620 con 0x7f28ec0b3100 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28ea59c640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28ec0c78d0 0x7f28ec0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e9d9b640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 0x7f28ec0c4c00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e550 tx=0x7f28dc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0052e0 con 0x7f28ec0b3100 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc005440 con 0x7f28ec0b3100 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec0b2900 con 0x7f28ec0b3100 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc003820 con 0x7f28ec0b3100 2023-09-30T16:49:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec15c370 con 0x7f28ec0b3100 2023-09-30T16:49:52.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec0740a0 con 0x7f28ec0b3100 2023-09-30T16:49:52.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f28dc003980 con 0x7f28ec0b3100 2023-09-30T16:49:52.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e2ffd640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f28cc066190 0x7f28cc068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28dc0837d0 con 0x7f28ec0b3100 2023-09-30T16:49:52.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28ea59c640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f28cc066190 0x7f28cc068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.426+0000 7f28ea59c640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f28cc066190 0x7f28cc068650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28d40058c0 tx=0x7f28d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.430+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f28dc050df0 con 0x7f28ec0b3100 2023-09-30T16:49:52.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28ec0713d0 con 0x7f28ec0b3100 2023-09-30T16:49:52.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28e2ffd640 1 -- 172.21.15.52:0/4200837679 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28dc054410 con 0x7f28ec0b3100 2023-09-30T16:49:52.584 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f28cc066190 msgr2=0x7f28cc068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f28cc066190 0x7f28cc068650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28d40058c0 tx=0x7f28d4009040 comp rx=0 tx=0).stop 2023-09-30T16:49:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 msgr2=0x7f28ec0c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 0x7f28ec0c4c00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e550 tx=0x7f28dc00ea10 comp rx=0 tx=0).stop 2023-09-30T16:49:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 shutdown_connections 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f28cc066190 0x7f28cc068650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28ec0c7cb0 0x7f28ec15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28ec0b3100 0x7f28ec0c4c00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 --2- 172.21.15.52:0/4200837679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28ec0c78d0 0x7f28ec0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 >> 172.21.15.52:0/4200837679 conn(0x7f28ec06a5c0 msgr2=0x7f28ec14f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.582+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 shutdown_connections 2023-09-30T16:49:52.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.586+0000 7f28f09d8640 1 -- 172.21.15.52:0/4200837679 wait complete. 2023-09-30T16:49:52.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 Processor -- start 2023-09-30T16:49:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 -- start start 2023-09-30T16:49:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2b4006d060 0x7f2b400b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b400b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400aded0 con 0x7f2b40159080 2023-09-30T16:49:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b40159460 con 0x7f2b4006d060 2023-09-30T16:49:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b45c63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4006d510 con 0x7f2b400c9460 2023-09-30T16:49:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2b40159080 0x7f2b4006c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39436/0 (socket says 172.21.15.52:39436) 2023-09-30T16:49:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3f7fe640 1 -- 172.21.15.52:0/1689499979 learned_addr learned my addr 172.21.15.52:0/1689499979 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3ffff640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b400b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117069810 0 0) 0x7f2b400aded0 con 0x7f2b40159080 2023-09-30T16:49:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3effd640 1 --2- 172.21.15.52:0/1689499979 >> v2:172.21.15.186:3300/0 conn(0x7f2b4006d060 0x7f2b400b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28003530 con 0x7f2b40159080 2023-09-30T16:49:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.722+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1300160422 0 0) 0x7f2b28003530 con 0x7f2b40159080 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 msgr2=0x7f2b400b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b400b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 >> v2:172.21.15.186:3300/0 conn(0x7f2b4006d060 msgr2=0x7f2b400b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 --2- 172.21.15.52:0/1689499979 >> v2:172.21.15.186:3300/0 conn(0x7f2b4006d060 0x7f2b400b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4006d7f0 con 0x7f2b40159080 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f2b30001680 con 0x7f2b40159080 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 >> v1:172.21.15.52:6789/0 conn(0x7f2b40159080 legacy=0x7f2b4006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b28003980 0x7f2b28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40159460 con 0x7f2b280047d0 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4006d510 con 0x7f2b28003980 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800b990 con 0x7f2b400c9460 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3f7fe640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b28003980 0x7f2b28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3ffff640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 -- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 msgr2=0x7f2b28005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b28005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 -- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b28003980 msgr2=0x7f2b28003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b28003980 0x7f2b28003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 -- 172.21.15.52:0/1689499979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28003530 con 0x7f2b280047d0 2023-09-30T16:49:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3ffff640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b400c9460 0x7f2b28005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3effd640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400aae0 tx=0x7f2b3401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f60e15f6555c86a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340a5d00 con 0x7f2b280047d0 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340a5e60 con 0x7f2b280047d0 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3e7fc640 1 -- 172.21.15.52:0/1689499979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340ad680 con 0x7f2b280047d0 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b45c63640 1 -- 172.21.15.52:0/1689499979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b280047d0 msgr2=0x7f2b28004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b45c63640 1 --2- 172.21.15.52:0/1689499979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b280047d0 0x7f2b28004c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400aae0 tx=0x7f2b3401cee0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b3ffff640 1 -- 172.21.15.52:0/1689499979 reap_dead start 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b45c63640 1 -- 172.21.15.52:0/1689499979 shutdown_connections 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b45c63640 1 -- 172.21.15.52:0/1689499979 >> 172.21.15.52:0/1689499979 conn(0x7f2b4006a5c0 msgr2=0x7f2b400ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b45c63640 1 -- 172.21.15.52:0/1689499979 shutdown_connections 2023-09-30T16:49:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.726+0000 7f2b45c63640 1 -- 172.21.15.52:0/1689499979 wait complete. 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 Processor -- start 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- start start 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b280047d0 0x7f2b4014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 0x7f2b4014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b4015b640 0x7f2b4015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4015c030 con 0x7f2b401e2240 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b400c38c0 con 0x7f2b280047d0 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b401e2ac0 con 0x7f2b4015b640 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 0x7f2b4014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 0x7f2b4014dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58996/0 (socket says 172.21.15.52:58996) 2023-09-30T16:49:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 -- 172.21.15.52:0/863980704 learned_addr learned my addr 172.21.15.52:0/863980704 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3f7fe640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b280047d0 0x7f2b4014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3ffff640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b4015b640 0x7f2b4015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 -- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b4015b640 msgr2=0x7f2b4015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b4015b640 0x7f2b4015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 -- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b280047d0 msgr2=0x7f2b4014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b280047d0 0x7f2b4014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 -- 172.21.15.52:0/863980704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b401e1fa0 con 0x7f2b401e2240 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b3effd640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 0x7f2b4014dec0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b340b0040 tx=0x7f2b28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340adbe0 con 0x7f2b401e2240 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340add80 con 0x7f2b401e2240 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b401e27e0 con 0x7f2b401e2240 2023-09-30T16:49:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34004260 con 0x7f2b401e2240 2023-09-30T16:49:52.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b400c3550 con 0x7f2b401e2240 2023-09-30T16:49:52.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b400c3a50 con 0x7f2b401e2240 2023-09-30T16:49:52.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.730+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f2b340b4040 con 0x7f2b401e2240 2023-09-30T16:49:52.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.734+0000 7f2b27fff640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2b2c066190 0x7f2b2c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:52.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.734+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b3411e810 con 0x7f2b401e2240 2023-09-30T16:49:52.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.734+0000 7f2b3f7fe640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2b2c066190 0x7f2b2c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:52.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.734+0000 7f2b3f7fe640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2b2c066190 0x7f2b2c068650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b30001ec0 tx=0x7f2b30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:52.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.738+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f2b340ebf60 con 0x7f2b401e2240 2023-09-30T16:49:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b400740a0 con 0x7f2b401e2240 2023-09-30T16:49:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b27fff640 1 -- 172.21.15.52:0/863980704 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b3400b040 con 0x7f2b401e2240 2023-09-30T16:49:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2b2c066190 msgr2=0x7f2b2c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2b2c066190 0x7f2b2c068650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b30001ec0 tx=0x7f2b30009040 comp rx=0 tx=0).stop 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 msgr2=0x7f2b4014dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 0x7f2b4014dec0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b340b0040 tx=0x7f2b28005800 comp rx=0 tx=0).stop 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 shutdown_connections 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2b2c066190 0x7f2b2c068650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b4015b640 0x7f2b4015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b401e2240 0x7f2b4014dec0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 --2- 172.21.15.52:0/863980704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b280047d0 0x7f2b4014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 >> 172.21.15.52:0/863980704 conn(0x7f2b4006a5c0 msgr2=0x7f2b400ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 shutdown_connections 2023-09-30T16:49:52.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:52.906+0000 7f2b45c63640 1 -- 172.21.15.52:0/863980704 wait complete. 2023-09-30T16:49:52.927 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:49:52.927 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:52.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:53.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 Processor -- start 2023-09-30T16:49:53.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 -- start start 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f668015a9d0 0x7f668015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f668006d650 0x7f66800b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66800b19b0 0x7f66800b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668006c240 con 0x7f66800b19b0 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668015adb0 con 0x7f668015a9d0 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.050+0000 7f6687208640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668015ea90 con 0x7f668006d650 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66800b19b0 0x7f66800b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66800b19b0 0x7f66800b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59012/0 (socket says 172.21.15.52:59012) 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 -- 172.21.15.52:0/1556120478 learned_addr learned my addr 172.21.15.52:0/1556120478 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f667ffff640 1 --2- 172.21.15.52:0/1556120478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f668006d650 0x7f66800b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6684fa4640 1 --2- 172.21.15.52:0/1556120478 >> v2:172.21.15.186:3300/0 conn(0x7f668015a9d0 0x7f668015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 -- 172.21.15.52:0/1556120478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f668006d650 msgr2=0x7f66800b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 --2- 172.21.15.52:0/1556120478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f668006d650 0x7f66800b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 -- 172.21.15.52:0/1556120478 >> v2:172.21.15.186:3300/0 conn(0x7f668015a9d0 msgr2=0x7f668015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 --2- 172.21.15.52:0/1556120478 >> v2:172.21.15.186:3300/0 conn(0x7f668015a9d0 0x7f668015e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 -- 172.21.15.52:0/1556120478 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668015ed70 con 0x7f66800b19b0 2023-09-30T16:49:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f66857a5640 1 --2- 172.21.15.52:0/1556120478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800b19b0 0x7f66800b00a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66800715f0 tx=0x7f667801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca46317463bc574 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f667f7fe640 1 -- 172.21.15.52:0/1556120478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780ab600 con 0x7f66800b19b0 2023-09-30T16:49:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f667f7fe640 1 -- 172.21.15.52:0/1556120478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780a7050 con 0x7f66800b19b0 2023-09-30T16:49:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f667f7fe640 1 -- 172.21.15.52:0/1556120478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780ab980 con 0x7f66800b19b0 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 -- 172.21.15.52:0/1556120478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800b19b0 msgr2=0x7f66800b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 --2- 172.21.15.52:0/1556120478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800b19b0 0x7f66800b00a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66800715f0 tx=0x7f667801c500 comp rx=0 tx=0).stop 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 -- 172.21.15.52:0/1556120478 shutdown_connections 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 --2- 172.21.15.52:0/1556120478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800b19b0 0x7f66800b00a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 --2- 172.21.15.52:0/1556120478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f668006d650 0x7f66800b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 --2- 172.21.15.52:0/1556120478 >> v2:172.21.15.186:3300/0 conn(0x7f668015a9d0 0x7f668015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 -- 172.21.15.52:0/1556120478 >> 172.21.15.52:0/1556120478 conn(0x7f668006a5f0 msgr2=0x7f66800ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 -- 172.21.15.52:0/1556120478 shutdown_connections 2023-09-30T16:49:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.054+0000 7f6687208640 1 -- 172.21.15.52:0/1556120478 wait complete. 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 Processor -- start 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- start start 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 0x7f66800c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66800b19b0 0x7f6680151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f668015a9d0 0x7f66800c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680151c50 con 0x7f668006d650 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680151f10 con 0x7f668015a9d0 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680152720 con 0x7f66800b19b0 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 0x7f66800c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 0x7f66800c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59014/0 (socket says 172.21.15.52:59014) 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 -- 172.21.15.52:0/1807795919 learned_addr learned my addr 172.21.15.52:0/1807795919 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f667ffff640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66800b19b0 0x7f6680151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f66857a5640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f668015a9d0 0x7f66800c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 -- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66800b19b0 msgr2=0x7f6680151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66800b19b0 0x7f6680151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 -- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f668015a9d0 msgr2=0x7f66800c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f668015a9d0 0x7f66800c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 -- 172.21.15.52:0/1807795919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780094d0 con 0x7f668006d650 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f66857a5640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f668015a9d0 0x7f66800c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6684fa4640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 0x7f66800c11c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f666800c7f0 tx=0x7f666800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007820 con 0x7f668006d650 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668007980 con 0x7f668006d650 2023-09-30T16:49:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007d30 con 0x7f668006d650 2023-09-30T16:49:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680152160 con 0x7f668006d650 2023-09-30T16:49:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6680155750 con 0x7f668006d650 2023-09-30T16:49:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66801555b0 con 0x7f668006d650 2023-09-30T16:49:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.058+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f66680113f0 con 0x7f668006d650 2023-09-30T16:49:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.062+0000 7f667d7fa640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6660066190 0x7f6660068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.062+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6668083a00 con 0x7f668006d650 2023-09-30T16:49:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.062+0000 7f667ffff640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6660066190 0x7f6660068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.062+0000 7f667ffff640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6660066190 0x7f6660068650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f66801464c0 tx=0x7f6670007560 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.066+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f66801555b0 con 0x7f668006d650 2023-09-30T16:49:53.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.214+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66801555b0 con 0x7f668006d650 2023-09-30T16:49:53.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.214+0000 7f667d7fa640 1 -- 172.21.15.52:0/1807795919 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f66801555b0 con 0x7f668006d650 2023-09-30T16:49:53.217 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:53.217 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:53.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6660066190 msgr2=0x7f6660068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6660066190 0x7f6660068650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f66801464c0 tx=0x7f6670007560 comp rx=0 tx=0).stop 2023-09-30T16:49:53.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 msgr2=0x7f66800c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 0x7f66800c11c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f666800c7f0 tx=0x7f666800ccb0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 shutdown_connections 2023-09-30T16:49:53.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6660066190 0x7f6660068650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f668015a9d0 0x7f66800c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66800b19b0 0x7f6680151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 --2- 172.21.15.52:0/1807795919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f668006d650 0x7f66800c11c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 >> 172.21.15.52:0/1807795919 conn(0x7f668006a5f0 msgr2=0x7f668015c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 shutdown_connections 2023-09-30T16:49:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.218+0000 7f6687208640 1 -- 172.21.15.52:0/1807795919 wait complete. 2023-09-30T16:49:53.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:53.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:53.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.346+0000 7f1989bd5640 1 Processor -- start 2023-09-30T16:49:53.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.346+0000 7f1989bd5640 1 -- start start 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1989bd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1989bd5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19840b07b0 0x7f198406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1989bd5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b4610 con 0x7f198415aa40 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1989bd5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198415e750 con 0x7f19840b07b0 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1989bd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198415ea30 con 0x7f19840b1470 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19840b07b0 0x7f198406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19840b07b0 0x7f198406c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59026/0 (socket says 172.21.15.52:59026) 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 -- 172.21.15.52:0/3559780189 learned_addr learned my addr 172.21.15.52:0/3559780189 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1982ffd640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 -- 172.21.15.52:0/3559780189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 msgr2=0x7f19840c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 -- 172.21.15.52:0/3559780189 >> v1:172.21.15.186:6789/0 conn(0x7f198415aa40 legacy=0x7f19840b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 -- 172.21.15.52:0/3559780189 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198415ed10 con 0x7f19840b07b0 2023-09-30T16:49:53.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1982ffd640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f1983fff640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19840b07b0 0x7f198406c250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f197c009870 tx=0x7f197c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5958afcfb59ba45f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.350+0000 7f19827fc640 1 -- 172.21.15.52:0/3559780189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0aa5f0 con 0x7f19840b07b0 2023-09-30T16:49:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f19827fc640 1 -- 172.21.15.52:0/3559780189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c0aa750 con 0x7f19840b07b0 2023-09-30T16:49:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f19827fc640 1 -- 172.21.15.52:0/3559780189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0aaae0 con 0x7f19840b07b0 2023-09-30T16:49:53.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/3559780189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19840b07b0 msgr2=0x7f198406c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19840b07b0 0x7f198406c250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f197c009870 tx=0x7f197c01c4d0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/3559780189 shutdown_connections 2023-09-30T16:49:53.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19840b07b0 0x7f198406c250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 --2- 172.21.15.52:0/3559780189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/3559780189 >> 172.21.15.52:0/3559780189 conn(0x7f198406a5c0 msgr2=0x7f19840ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/3559780189 shutdown_connections 2023-09-30T16:49:53.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/3559780189 wait complete. 2023-09-30T16:49:53.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 Processor -- start 2023-09-30T16:49:53.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- start start 2023-09-30T16:49:53.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b07b0 0x7f19840c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 0x7f19840c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c58e0 con 0x7f198415aa40 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984153de0 con 0x7f19840b07b0 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840c4bd0 con 0x7f19840b1470 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 0x7f19840c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 0x7f19840c3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59034/0 (socket says 172.21.15.52:59034) 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 -- 172.21.15.52:0/1633005084 learned_addr learned my addr 172.21.15.52:0/1633005084 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f19837fe640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b07b0 0x7f19840c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1982ffd640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 -- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 msgr2=0x7f19840c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 -- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b07b0 msgr2=0x7f19840c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b07b0 0x7f19840c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 -- 172.21.15.52:0/1633005084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0094d0 con 0x7f198415aa40 2023-09-30T16:49:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1983fff640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 0x7f19840c3a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f197c0ac040 tx=0x7f197c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0b3800 con 0x7f198415aa40 2023-09-30T16:49:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c0b3980 con 0x7f198415aa40 2023-09-30T16:49:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19840c4eb0 con 0x7f198415aa40 2023-09-30T16:49:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0b3d30 con 0x7f198415aa40 2023-09-30T16:49:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.354+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19840c5190 con 0x7f198415aa40 2023-09-30T16:49:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.358+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984153f50 con 0x7f198415aa40 2023-09-30T16:49:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.358+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f197c0c6390 con 0x7f198415aa40 2023-09-30T16:49:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.358+0000 7f196bfff640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1970066160 0x7f1970068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.358+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f197c0a7070 con 0x7f198415aa40 2023-09-30T16:49:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.358+0000 7f19837fe640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1970066160 0x7f1970068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.358+0000 7f19837fe640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1970066160 0x7f1970068620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1974009f20 tx=0x7f19740094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.362+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f197c0ebad0 con 0x7f198415aa40 2023-09-30T16:49:53.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.514+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19840740a0 con 0x7f198415aa40 2023-09-30T16:49:53.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f196bfff640 1 -- 172.21.15.52:0/1633005084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f197c0ef0f0 con 0x7f198415aa40 2023-09-30T16:49:53.519 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1970066160 msgr2=0x7f1970068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1970066160 0x7f1970068620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1974009f20 tx=0x7f19740094d0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 msgr2=0x7f19840c3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 0x7f19840c3a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f197c0ac040 tx=0x7f197c01ad10 comp rx=0 tx=0).stop 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 shutdown_connections 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1970066160 0x7f1970068620 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f198415aa40 0x7f19840c3a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19840b1470 0x7f19840c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 --2- 172.21.15.52:0/1633005084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b07b0 0x7f19840c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 >> 172.21.15.52:0/1633005084 conn(0x7f198406a5c0 msgr2=0x7f1984159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 shutdown_connections 2023-09-30T16:49:53.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.518+0000 7f1989bd5640 1 -- 172.21.15.52:0/1633005084 wait complete. 2023-09-30T16:49:53.539 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.658+0000 7f6b78e19640 1 Processor -- start 2023-09-30T16:49:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.658+0000 7f6b78e19640 1 -- start start 2023-09-30T16:49:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b78e19640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b740d0210 0x7f6b740d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b78e19640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6b740d25b0 0x7f6b740b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b78e19640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740d39b0 con 0x7f6b7415cc60 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b78e19640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7415d040 con 0x7f6b740d0210 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b78e19640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740d2da0 con 0x7f6b740d25b0 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b740d0210 0x7f6b740d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b740d0210 0x7f6b740d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59044/0 (socket says 172.21.15.52:59044) 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 -- 172.21.15.52:0/1595932936 learned_addr learned my addr 172.21.15.52:0/1595932936 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 -- 172.21.15.52:0/1595932936 >> v2:172.21.15.186:3300/0 conn(0x7f6b740d25b0 msgr2=0x7f6b740b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b72d9d640 1 --2- 172.21.15.52:0/1595932936 >> v2:172.21.15.186:3300/0 conn(0x7f6b740d25b0 0x7f6b740b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 --2- 172.21.15.52:0/1595932936 >> v2:172.21.15.186:3300/0 conn(0x7f6b740d25b0 0x7f6b740b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 -- 172.21.15.52:0/1595932936 >> v1:172.21.15.186:6789/0 conn(0x7f6b7415cc60 legacy=0x7f6b740cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 -- 172.21.15.52:0/1595932936 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740d3080 con 0x7f6b740d0210 2023-09-30T16:49:53.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b71d9b640 1 --2- 172.21.15.52:0/1595932936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b740d0210 0x7f6b740d2070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b740b4b30 tx=0x7f6b6801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c3a908e812387f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b7159a640 1 -- 172.21.15.52:0/1595932936 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680aa5f0 con 0x7f6b740d0210 2023-09-30T16:49:53.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b7159a640 1 -- 172.21.15.52:0/1595932936 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680aa750 con 0x7f6b740d0210 2023-09-30T16:49:53.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.662+0000 7f6b7159a640 1 -- 172.21.15.52:0/1595932936 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680aaae0 con 0x7f6b740d0210 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/1595932936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b740d0210 msgr2=0x7f6b740d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 --2- 172.21.15.52:0/1595932936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b740d0210 0x7f6b740d2070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b740b4b30 tx=0x7f6b6801c490 comp rx=0 tx=0).stop 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/1595932936 shutdown_connections 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 --2- 172.21.15.52:0/1595932936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b740d0210 0x7f6b740d2070 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 --2- 172.21.15.52:0/1595932936 >> v2:172.21.15.186:3300/0 conn(0x7f6b740d25b0 0x7f6b740b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/1595932936 >> 172.21.15.52:0/1595932936 conn(0x7f6b74071930 msgr2=0x7f6b74071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/1595932936 shutdown_connections 2023-09-30T16:49:53.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/1595932936 wait complete. 2023-09-30T16:49:53.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 Processor -- start 2023-09-30T16:49:53.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- start start 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b740d0210 0x7f6b7415da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b740d25b0 0x7f6b7414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 0x7f6b74151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7414f2e0 con 0x7f6b7415cc60 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7414e6f0 con 0x7f6b740d0210 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7415dfb0 con 0x7f6b740d25b0 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 0x7f6b74151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 0x7f6b74151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59054/0 (socket says 172.21.15.52:59054) 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 -- 172.21.15.52:0/2235808320 learned_addr learned my addr 172.21.15.52:0/2235808320 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b71d9b640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b740d25b0 0x7f6b7414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b7259c640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b740d0210 0x7f6b7415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 -- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b740d25b0 msgr2=0x7f6b7414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b740d25b0 0x7f6b7414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 -- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b740d0210 msgr2=0x7f6b7415da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b740d0210 0x7f6b7415da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 -- 172.21.15.52:0/2235808320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094d0 con 0x7f6b7415cc60 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b72d9d640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 0x7f6b74151b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00cd70 tx=0x7f6b6c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c003ba0 con 0x7f6b7415cc60 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c003d00 con 0x7f6b7415cc60 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c004240 con 0x7f6b7415cc60 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7414e940 con 0x7f6b7415cc60 2023-09-30T16:49:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.666+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7414ef00 con 0x7f6b7415cc60 2023-09-30T16:49:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.670+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7414f420 con 0x7f6b7415cc60 2023-09-30T16:49:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.670+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f6b6c0043a0 con 0x7f6b7415cc60 2023-09-30T16:49:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.670+0000 7f6b62ffd640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6b54066160 0x7f6b54068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.670+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b6c012070 con 0x7f6b7415cc60 2023-09-30T16:49:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.670+0000 7f6b7259c640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6b54066160 0x7f6b54068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.670+0000 7f6b7259c640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6b54066160 0x7f6b54068620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b810 tx=0x7f6b64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.674+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6b7414f420 con 0x7f6b7415cc60 2023-09-30T16:49:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.826+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b7414f420 con 0x7f6b7415cc60 2023-09-30T16:49:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b62ffd640 1 -- 172.21.15.52:0/2235808320 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b7414f420 con 0x7f6b7415cc60 2023-09-30T16:49:53.830 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6b54066160 msgr2=0x7f6b54068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6b54066160 0x7f6b54068620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b810 tx=0x7f6b64008040 comp rx=0 tx=0).stop 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 msgr2=0x7f6b74151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 0x7f6b74151b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00cd70 tx=0x7f6b6c00a660 comp rx=0 tx=0).stop 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 shutdown_connections 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6b54066160 0x7f6b54068620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b7415cc60 0x7f6b74151b40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b740d25b0 0x7f6b7414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 --2- 172.21.15.52:0/2235808320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b740d0210 0x7f6b7415da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 >> 172.21.15.52:0/2235808320 conn(0x7f6b74071930 msgr2=0x7f6b74152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 shutdown_connections 2023-09-30T16:49:53.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.830+0000 7f6b78e19640 1 -- 172.21.15.52:0/2235808320 wait complete. 2023-09-30T16:49:53.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:53.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 Processor -- start 2023-09-30T16:49:53.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 -- start start 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc0d0210 0x7efdbc0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdbc0d25b0 0x7efdbc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc0d39b0 con 0x7efdbc15cc60 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc15d040 con 0x7efdbc0d25b0 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc43bb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0d2da0 con 0x7efdbc0d0210 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdbc0d25b0 0x7efdbc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdbc0d25b0 0x7efdbc0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59070/0 (socket says 172.21.15.52:59070) 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 -- 172.21.15.52:0/978638710 learned_addr learned my addr 172.21.15.52:0/978638710 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc1956640 1 --2- 172.21.15.52:0/978638710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc0d0210 0x7efdbc0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 -- 172.21.15.52:0/978638710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc0d0210 msgr2=0x7efdbc0d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 --2- 172.21.15.52:0/978638710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc0d0210 0x7efdbc0d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 -- 172.21.15.52:0/978638710 >> v1:172.21.15.186:6789/0 conn(0x7efdbc15cc60 legacy=0x7efdbc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 -- 172.21.15.52:0/978638710 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc0d3080 con 0x7efdbc0d25b0 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.970+0000 7efdc2958640 1 --2- 172.21.15.52:0/978638710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0b5f70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009870 tx=0x7efdb401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d317f2b4485869 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc1155640 1 -- 172.21.15.52:0/978638710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb40aa670 con 0x7efdbc0d25b0 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc1155640 1 -- 172.21.15.52:0/978638710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb40aa7d0 con 0x7efdbc0d25b0 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc1155640 1 -- 172.21.15.52:0/978638710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb40aab60 con 0x7efdbc0d25b0 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/978638710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d25b0 msgr2=0x7efdbc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 --2- 172.21.15.52:0/978638710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0b5f70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009870 tx=0x7efdb401c510 comp rx=0 tx=0).stop 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/978638710 shutdown_connections 2023-09-30T16:49:53.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 --2- 172.21.15.52:0/978638710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0b5f70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 --2- 172.21.15.52:0/978638710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc0d0210 0x7efdbc0d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/978638710 >> 172.21.15.52:0/978638710 conn(0x7efdbc071930 msgr2=0x7efdbc071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:53.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/978638710 shutdown_connections 2023-09-30T16:49:53.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/978638710 wait complete. 2023-09-30T16:49:53.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 Processor -- start 2023-09-30T16:49:53.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- start start 2023-09-30T16:49:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 0x7efdbc0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc15cc60 0x7efdbc152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c6750 con 0x7efdbc0d0210 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c95d0 con 0x7efdbc0d25b0 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c69f0 con 0x7efdbc15cc60 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 0x7efdbc0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 0x7efdbc0c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59080/0 (socket says 172.21.15.52:59080) 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 -- 172.21.15.52:0/2108042513 learned_addr learned my addr 172.21.15.52:0/2108042513 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2958640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc15cc60 0x7efdbc152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc1956640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 -- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc15cc60 msgr2=0x7efdbc152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc15cc60 0x7efdbc152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 -- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc0d25b0 msgr2=0x7efdbc0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:53.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 -- 172.21.15.52:0/2108042513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb40094d0 con 0x7efdbc0d0210 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc2157640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 0x7efdbc0c9090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efdac00c3c0 tx=0x7efdac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0052d0 con 0x7efdbc0d0210 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac005430 con 0x7efdbc0d0210 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc0c6cd0 con 0x7efdbc0d0210 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac003840 con 0x7efdbc0d0210 2023-09-30T16:49:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.974+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc0c7290 con 0x7efdbc0d0210 2023-09-30T16:49:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.978+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0740a0 con 0x7efdbc0d0210 2023-09-30T16:49:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.978+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7efdac0039a0 con 0x7efdbc0d0210 2023-09-30T16:49:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.978+0000 7efdbaffd640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda8066160 0x7efda8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.978+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdac082f40 con 0x7efdbc0d0210 2023-09-30T16:49:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.978+0000 7efdc1956640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda8066160 0x7efda8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:53.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.978+0000 7efdc1956640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda8066160 0x7efda8068620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdb0003fd0 tx=0x7efdb00039a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:53.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:53.982+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7efdac0505f0 con 0x7efdbc0d0210 2023-09-30T16:49:54.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.130+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdbc0b6140 con 0x7efdbc0d0210 2023-09-30T16:49:54.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdbaffd640 1 -- 172.21.15.52:0/2108042513 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdac0170a0 con 0x7efdbc0d0210 2023-09-30T16:49:54.134 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda8066160 msgr2=0x7efda8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda8066160 0x7efda8068620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdb0003fd0 tx=0x7efdb00039a0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 msgr2=0x7efdbc0c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 0x7efdbc0c9090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efdac00c3c0 tx=0x7efdac00c880 comp rx=0 tx=0).stop 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 shutdown_connections 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efda8066160 0x7efda8068620 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdbc15cc60 0x7efdbc152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdbc0d25b0 0x7efdbc0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 --2- 172.21.15.52:0/2108042513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0d0210 0x7efdbc0c9090 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 >> 172.21.15.52:0/2108042513 conn(0x7efdbc071930 msgr2=0x7efdbc0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 shutdown_connections 2023-09-30T16:49:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.134+0000 7efdc43bb640 1 -- 172.21.15.52:0/2108042513 wait complete. 2023-09-30T16:49:54.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.258+0000 7f445c62f640 1 Processor -- start 2023-09-30T16:49:54.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.258+0000 7f445c62f640 1 -- start start 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445c62f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 0x7f44540c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445c62f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445406bf70 con 0x7f445406d440 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445c62f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445406c250 con 0x7f4454070780 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445c62f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540ce2e0 con 0x7f44541599c0 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f445406d440 0x7f4454070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39442/0 (socket says 172.21.15.52:39442) 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 -- 172.21.15.52:0/1049836955 learned_addr learned my addr 172.21.15.52:0/1049836955 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445a3cb640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 0x7f44540c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091563907 0 0) 0x7f445406bf70 con 0x7f445406d440 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4440003530 con 0x7f445406d440 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972250693 0 0) 0x7f4440003530 con 0x7f445406d440 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 msgr2=0x7f44540c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 0x7f44540c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 >> v1:172.21.15.186:6789/0 conn(0x7f4454070780 legacy=0x7f445415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445406c530 con 0x7f445406d440 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f4444001680 con 0x7f445406d440 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 >> v1:172.21.15.52:6789/0 conn(0x7f445406d440 legacy=0x7f4454070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 0x7f44400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4440003f30 0x7f44400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440004d10 0x7f4440005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540ce2e0 con 0x7f4440003f30 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444000ba70 con 0x7f4440004d10 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444000bc30 con 0x7f44541599c0 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4440003f30 0x7f44400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445a3cb640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 0x7f44400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445abcc640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440004d10 0x7f4440005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 -- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 msgr2=0x7f44400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541599c0 0x7f44400039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 -- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440004d10 msgr2=0x7f4440005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440004d10 0x7f4440005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 -- 172.21.15.52:0/1049836955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440003530 con 0x7f4440003f30 2023-09-30T16:49:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f445abcc640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440004d10 0x7f4440005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f4459bca640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4440003f30 0x7f44400047d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f444400c240 tx=0x7f444401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd23789e52fdcf1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444005ae0 con 0x7f4440003f30 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44440ab070 con 0x7f4440003f30 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.262+0000 7f44593c9640 1 -- 172.21.15.52:0/1049836955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444007070 con 0x7f4440003f30 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/1049836955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4440003f30 msgr2=0x7f44400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 --2- 172.21.15.52:0/1049836955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4440003f30 0x7f44400047d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f444400c240 tx=0x7f444401f3b0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 -- 172.21.15.52:0/1049836955 reap_dead start 2023-09-30T16:49:54.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/1049836955 shutdown_connections 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/1049836955 >> 172.21.15.52:0/1049836955 conn(0x7f445406a5c0 msgr2=0x7f44540ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/1049836955 shutdown_connections 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/1049836955 wait complete. 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 Processor -- start 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- start start 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440003f30 0x7f44541ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541eba00 0x7f44540b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 0x7f44540b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540b1760 con 0x7f44540b0da0 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540b4460 con 0x7f4440003f30 2023-09-30T16:49:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540b3850 con 0x7f44541eba00 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 0x7f44540b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 0x7f44540b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59110/0 (socket says 172.21.15.52:59110) 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 -- 172.21.15.52:0/2793764061 learned_addr learned my addr 172.21.15.52:0/2793764061 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445a3cb640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440003f30 0x7f44541ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f4459bca640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541eba00 0x7f44540b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 -- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541eba00 msgr2=0x7f44540b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541eba00 0x7f44540b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 -- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440003f30 msgr2=0x7f44541ee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440003f30 0x7f44541ee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 -- 172.21.15.52:0/2793764061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540b3b30 con 0x7f44540b0da0 2023-09-30T16:49:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445abcc640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 0x7f44540b1220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44540cef60 tx=0x7f444c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c006d60 con 0x7f44540b0da0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c003980 con 0x7f44540b0da0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44540b3e10 con 0x7f44540b0da0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c003d30 con 0x7f44540b0da0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.266+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44541ebe80 con 0x7f44540b0da0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.270+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44541ef6e0 con 0x7f44540b0da0 2023-09-30T16:49:54.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.270+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f444c005070 con 0x7f44540b0da0 2023-09-30T16:49:54.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.270+0000 7f444affd640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4438066190 0x7f4438068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.270+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f444c083db0 con 0x7f44540b0da0 2023-09-30T16:49:54.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.270+0000 7f445a3cb640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4438066190 0x7f4438068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.270+0000 7f445a3cb640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4438066190 0x7f4438068650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4450009a30 tx=0x7f4450008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:54.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.274+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f444c051540 con 0x7f44540b0da0 2023-09-30T16:49:54.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f44541ef6c0 con 0x7f44540b0da0 2023-09-30T16:49:54.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f444affd640 1 -- 172.21.15.52:0/2793764061 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f444c054b60 con 0x7f44540b0da0 2023-09-30T16:49:54.439 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4438066190 msgr2=0x7f4438068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4438066190 0x7f4438068650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4450009a30 tx=0x7f4450008040 comp rx=0 tx=0).stop 2023-09-30T16:49:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 msgr2=0x7f44540b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 0x7f44540b1220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44540cef60 tx=0x7f444c00dc00 comp rx=0 tx=0).stop 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 shutdown_connections 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4438066190 0x7f4438068650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44540b0da0 0x7f44540b1220 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44541eba00 0x7f44540b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 --2- 172.21.15.52:0/2793764061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4440003f30 0x7f44541ee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 >> 172.21.15.52:0/2793764061 conn(0x7f445406a5c0 msgr2=0x7f44540af050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 shutdown_connections 2023-09-30T16:49:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.438+0000 7f445c62f640 1 -- 172.21.15.52:0/2793764061 wait complete. 2023-09-30T16:49:54.457 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi186.front.sepia.ceph.com... 2023-09-30T16:49:54.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:54.457 DEBUG:teuthology.orchestra.run.smithi186:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-09-30T16:49:54.683 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:49:54.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:49:54.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:54.684 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T16:49:54.694 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:49:54.694 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:54.700 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:49:54.701 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:54.747 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 Processor -- start 2023-09-30T16:49:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 -- start start 2023-09-30T16:49:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a0c15a9d0 0x7f5a0c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0c06c240 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c15adb0 con 0x7f5a0c15a9d0 2023-09-30T16:49:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a12421640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c15ea90 con 0x7f5a0c06d650 2023-09-30T16:49:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a109be640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5a0c0b19b0 0x7f5a0c0b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39458/0 (socket says 172.21.15.52:39458) 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a0c15a9d0 0x7f5a0c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a109be640 1 -- 172.21.15.52:0/486492157 learned_addr learned my addr 172.21.15.52:0/486492157 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0b7fe640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0affd640 1 -- 172.21.15.52:0/486492157 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363360836 0 0) 0x7f5a0c06c240 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0bfff640 1 -- 172.21.15.52:0/486492157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 msgr2=0x7f5a0c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0bfff640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0bfff640 1 -- 172.21.15.52:0/486492157 >> v1:172.21.15.52:6789/0 conn(0x7f5a0c0b19b0 legacy=0x7f5a0c0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0bfff640 1 -- 172.21.15.52:0/486492157 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c15ed70 con 0x7f5a0c15a9d0 2023-09-30T16:49:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.926+0000 7f5a0b7fe640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a0bfff640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c15e4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f59f40097c0 tx=0x7f59f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1385ebc92c5e58c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a0affd640 1 -- 172.21.15.52:0/486492157 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40ab600 con 0x7f5a0c15a9d0 2023-09-30T16:49:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a0affd640 1 -- 172.21.15.52:0/486492157 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40a7050 con 0x7f5a0c15a9d0 2023-09-30T16:49:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a0affd640 1 -- 172.21.15.52:0/486492157 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40ab980 con 0x7f5a0c15a9d0 2023-09-30T16:49:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 -- 172.21.15.52:0/486492157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c15a9d0 msgr2=0x7f5a0c15e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c15e4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f59f40097c0 tx=0x7f59f401c480 comp rx=0 tx=0).stop 2023-09-30T16:49:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 -- 172.21.15.52:0/486492157 shutdown_connections 2023-09-30T16:49:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 --2- 172.21.15.52:0/486492157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c15e4b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 -- 172.21.15.52:0/486492157 >> 172.21.15.52:0/486492157 conn(0x7f5a0c06a5f0 msgr2=0x7f5a0c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 -- 172.21.15.52:0/486492157 shutdown_connections 2023-09-30T16:49:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 -- 172.21.15.52:0/486492157 wait complete. 2023-09-30T16:49:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 Processor -- start 2023-09-30T16:49:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.930+0000 7f5a12421640 1 -- start start 2023-09-30T16:49:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 0x7f5a0c0c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c152870 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0cd200 con 0x7f5a0c15a9d0 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0ccf20 con 0x7f5a0c06d650 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 0x7f5a0c0c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 0x7f5a0c0c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59128/0 (socket says 172.21.15.52:59128) 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 -- 172.21.15.52:0/3273046505 learned_addr learned my addr 172.21.15.52:0/3273046505 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0bfff640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a109be640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 -- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 msgr2=0x7f5a0c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 -- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c15a9d0 msgr2=0x7f5a0c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c0cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 -- 172.21.15.52:0/3273046505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4009420 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0bfff640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a109be640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0b7fe640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 0x7f5a0c0c1070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00c7c0 tx=0x7f59fc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc007a30 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc007b90 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c152aa0 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00ce70 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c153060 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0c0740a0 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f59fc0113f0 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a08ff9640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f59ec066160 0x7f59ec068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59fc083ef0 con 0x7f5a0c0b19b0 2023-09-30T16:49:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.934+0000 7f5a0bfff640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f59ec066160 0x7f59ec068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.938+0000 7f5a0bfff640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f59ec066160 0x7f59ec068620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ad000 tx=0x7f59f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:54.938+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f59fc0515a0 con 0x7f5a0c0b19b0 2023-09-30T16:49:55.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.090+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0c0cf0e0 con 0x7f5a0c0b19b0 2023-09-30T16:49:55.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.090+0000 7f5a08ff9640 1 -- 172.21.15.52:0/3273046505 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f59fc054bc0 con 0x7f5a0c0b19b0 2023-09-30T16:49:55.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:55.094 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f59ec066160 msgr2=0x7f59ec068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f59ec066160 0x7f59ec068620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ad000 tx=0x7f59f4008040 comp rx=0 tx=0).stop 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 msgr2=0x7f5a0c0c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 0x7f5a0c0c1070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00c7c0 tx=0x7f59fc00cc80 comp rx=0 tx=0).stop 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 shutdown_connections 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f59ec066160 0x7f59ec068620 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c15a9d0 0x7f5a0c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a0c0b19b0 0x7f5a0c0c1070 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 --2- 172.21.15.52:0/3273046505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c06d650 0x7f5a0c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 >> 172.21.15.52:0/3273046505 conn(0x7f5a0c06a5f0 msgr2=0x7f5a0c0cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 shutdown_connections 2023-09-30T16:49:55.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.094+0000 7f5a12421640 1 -- 172.21.15.52:0/3273046505 wait complete. 2023-09-30T16:49:55.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:55.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:55.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 Processor -- start 2023-09-30T16:49:55.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 -- start start 2023-09-30T16:49:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f482815cc60 0x7f48280cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48280d0040 0x7f48280d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f48280d25b0 0x7f48280d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280d04a0 con 0x7f482815cc60 2023-09-30T16:49:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280d39b0 con 0x7f48280d25b0 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482ff4b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482815d040 con 0x7f48280d0040 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f482815cc60 0x7f48280cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f482815cc60 0x7f48280cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59144/0 (socket says 172.21.15.52:59144) 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 -- 172.21.15.52:0/4224691634 learned_addr learned my addr 172.21.15.52:0/4224691634 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482d4e6640 1 --2- 172.21.15.52:0/4224691634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48280d0040 0x7f48280d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482e4e8640 1 --2- 172.21.15.52:0/4224691634 >> v2:172.21.15.186:3300/0 conn(0x7f48280d25b0 0x7f48280d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 -- 172.21.15.52:0/4224691634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48280d0040 msgr2=0x7f48280d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 --2- 172.21.15.52:0/4224691634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48280d0040 0x7f48280d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 -- 172.21.15.52:0/4224691634 >> v2:172.21.15.186:3300/0 conn(0x7f48280d25b0 msgr2=0x7f48280d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 --2- 172.21.15.52:0/4224691634 >> v2:172.21.15.186:3300/0 conn(0x7f48280d25b0 0x7f48280d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482dce7640 1 -- 172.21.15.52:0/4224691634 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280d2da0 con 0x7f482815cc60 2023-09-30T16:49:55.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.234+0000 7f482e4e8640 1 --2- 172.21.15.52:0/4224691634 >> v2:172.21.15.186:3300/0 conn(0x7f48280d25b0 0x7f48280d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482dce7640 1 --2- 172.21.15.52:0/4224691634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482815cc60 0x7f48280cfb00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f48280b2550 tx=0x7f482001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f6ce4e7cea2245 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482cce5640 1 -- 172.21.15.52:0/4224691634 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48200a5560 con 0x7f482815cc60 2023-09-30T16:49:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482cce5640 1 -- 172.21.15.52:0/4224691634 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48200a56c0 con 0x7f482815cc60 2023-09-30T16:49:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482cce5640 1 -- 172.21.15.52:0/4224691634 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48200a5a50 con 0x7f482815cc60 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 -- 172.21.15.52:0/4224691634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482815cc60 msgr2=0x7f48280cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 --2- 172.21.15.52:0/4224691634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482815cc60 0x7f48280cfb00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f48280b2550 tx=0x7f482001c6e0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 -- 172.21.15.52:0/4224691634 shutdown_connections 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 --2- 172.21.15.52:0/4224691634 >> v2:172.21.15.186:3300/0 conn(0x7f48280d25b0 0x7f48280d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 --2- 172.21.15.52:0/4224691634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48280d0040 0x7f48280d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 --2- 172.21.15.52:0/4224691634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f482815cc60 0x7f48280cfb00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 -- 172.21.15.52:0/4224691634 >> 172.21.15.52:0/4224691634 conn(0x7f4828071930 msgr2=0x7f4828071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 -- 172.21.15.52:0/4224691634 shutdown_connections 2023-09-30T16:49:55.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 -- 172.21.15.52:0/4224691634 wait complete. 2023-09-30T16:49:55.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.238+0000 7f482ff4b640 1 Processor -- start 2023-09-30T16:49:55.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- start start 2023-09-30T16:49:55.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 0x7f4828148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48280d25b0 0x7f48281f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f482815cc60 0x7f48280cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4828148770 con 0x7f48280d0040 2023-09-30T16:49:55.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48281f90f0 con 0x7f48280d25b0 2023-09-30T16:49:55.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280cb560 con 0x7f482815cc60 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 0x7f4828148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 0x7f4828148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59150/0 (socket says 172.21.15.52:59150) 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 -- 172.21.15.52:0/2182735505 learned_addr learned my addr 172.21.15.52:0/2182735505 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482d4e6640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48280d25b0 0x7f48281f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482e4e8640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f482815cc60 0x7f48280cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 -- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f482815cc60 msgr2=0x7f48280cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f482815cc60 0x7f48280cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 -- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48280d25b0 msgr2=0x7f48281f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48280d25b0 0x7f48281f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 -- 172.21.15.52:0/2182735505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820009b30 con 0x7f48280d0040 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482dce7640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 0x7f4828148230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f482001ad90 tx=0x7f4820019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48200b8670 con 0x7f48280d0040 2023-09-30T16:49:55.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48200b87f0 con 0x7f48280d0040 2023-09-30T16:49:55.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48200b8ba0 con 0x7f48280d0040 2023-09-30T16:49:55.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48280ca950 con 0x7f48280d0040 2023-09-30T16:49:55.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280caf10 con 0x7f48280d0040 2023-09-30T16:49:55.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48280740a0 con 0x7f48280d0040 2023-09-30T16:49:55.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f48200b8d00 con 0x7f48280d0040 2023-09-30T16:49:55.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f48267fc640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4814066160 0x7f4814068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.242+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f482011edd0 con 0x7f48280d0040 2023-09-30T16:49:55.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.246+0000 7f482d4e6640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4814066160 0x7f4814068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.246+0000 7f482d4e6640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4814066160 0x7f4814068620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48280b2550 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.246+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f48200ec480 con 0x7f48280d0040 2023-09-30T16:49:55.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.402+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4828153dc0 con 0x7f48280d0040 2023-09-30T16:49:55.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.402+0000 7f48267fc640 1 -- 172.21.15.52:0/2182735505 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4820009510 con 0x7f48280d0040 2023-09-30T16:49:55.404 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4814066160 msgr2=0x7f4814068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4814066160 0x7f4814068620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48280b2550 tx=0x7f481c008040 comp rx=0 tx=0).stop 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 msgr2=0x7f4828148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 0x7f4828148230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f482001ad90 tx=0x7f4820019480 comp rx=0 tx=0).stop 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 shutdown_connections 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4814066160 0x7f4814068620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f482815cc60 0x7f48280cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48280d25b0 0x7f48281f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 --2- 172.21.15.52:0/2182735505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48280d0040 0x7f4828148230 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 >> 172.21.15.52:0/2182735505 conn(0x7f4828071930 msgr2=0x7f48280b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 shutdown_connections 2023-09-30T16:49:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.406+0000 7f482ff4b640 1 -- 172.21.15.52:0/2182735505 wait complete. 2023-09-30T16:49:55.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 Processor -- start 2023-09-30T16:49:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 -- start start 2023-09-30T16:49:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facd0070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7facd0160d30 0x7facd0161160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd0070f10 con 0x7facd006d730 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd01616a0 con 0x7facd0160d30 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd77c2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd0070670 con 0x7facd015cb50 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd4d5d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7facd006d730 0x7facd00c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56838/0 (socket says 172.21.15.52:56838) 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd4d5d640 1 -- 172.21.15.52:0/3898540281 learned_addr learned my addr 172.21.15.52:0/3898540281 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd5d5f640 1 --2- 172.21.15.52:0/3898540281 >> v2:172.21.15.186:3300/0 conn(0x7facd0160d30 0x7facd0161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facd0070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153192360 0 0) 0x7facd0070f10 con 0x7facd006d730 2023-09-30T16:49:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facbc003530 con 0x7facd006d730 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442415024 0 0) 0x7facbc003530 con 0x7facd006d730 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 msgr2=0x7facd0070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facd0070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 >> v2:172.21.15.186:3300/0 conn(0x7facd0160d30 msgr2=0x7facd0161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 --2- 172.21.15.52:0/3898540281 >> v2:172.21.15.186:3300/0 conn(0x7facd0160d30 0x7facd0161160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0070950 con 0x7facd006d730 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7facc0001680 con 0x7facd006d730 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 >> v1:172.21.15.52:6789/0 conn(0x7facd006d730 legacy=0x7facd00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facbc003980 0x7facbc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc0047d0 0x7facbc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facbc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01616a0 con 0x7facbc003980 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd0070670 con 0x7facbc0047d0 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc00b990 con 0x7facd015cb50 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facbc003980 0x7facbc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd5d5f640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facbc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd4d5d640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc0047d0 0x7facbc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 -- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 msgr2=0x7facbc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facbc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 -- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc0047d0 msgr2=0x7facbc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc0047d0 0x7facbc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd555e640 1 -- 172.21.15.52:0/3898540281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc003530 con 0x7facbc003980 2023-09-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd5d5f640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015cb50 0x7facbc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.554+0000 7facd4d5d640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc0047d0 0x7facbc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd555e640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facbc003980 0x7facbc003da0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faccc009ae0 tx=0x7faccc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef7bff63ada08c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0a6460 con 0x7facbc003980 2023-09-30T16:49:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0a65c0 con 0x7facbc003980 2023-09-30T16:49:55.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facc7fff640 1 -- 172.21.15.52:0/3898540281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0a6970 con 0x7facbc003980 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 -- 172.21.15.52:0/3898540281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facbc003980 msgr2=0x7facbc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 --2- 172.21.15.52:0/3898540281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facbc003980 0x7facbc003da0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faccc009ae0 tx=0x7faccc01ca50 comp rx=0 tx=0).stop 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd5d5f640 1 -- 172.21.15.52:0/3898540281 reap_dead start 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 -- 172.21.15.52:0/3898540281 shutdown_connections 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 -- 172.21.15.52:0/3898540281 >> 172.21.15.52:0/3898540281 conn(0x7facd006a5c0 msgr2=0x7facd00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 -- 172.21.15.52:0/3898540281 shutdown_connections 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 -- 172.21.15.52:0/3898540281 wait complete. 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 Processor -- start 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 -- start start 2023-09-30T16:49:55.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc003980 0x7facd015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.558+0000 7facd77c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd01f2ec0 0x7facd01597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 0x7facd015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd015d470 con 0x7facd00b3b90 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00b1f80 con 0x7facbc003980 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00acb50 con 0x7facd01f2ec0 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 0x7facd015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 0x7facd015ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38314/0 (socket says 172.21.15.52:38314) 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 -- 172.21.15.52:0/3873334296 learned_addr learned my addr 172.21.15.52:0/3873334296 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd4d5d640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd01f2ec0 0x7facd01597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 -- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd01f2ec0 msgr2=0x7facd01597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd555e640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc003980 0x7facd015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd01f2ec0 0x7facd01597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 -- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc003980 msgr2=0x7facd015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc003980 0x7facd015cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 -- 172.21.15.52:0/3873334296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00ace30 con 0x7facd00b3b90 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd5d5f640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 0x7facd015ed40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7facd00c8b70 tx=0x7facc800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8016620 con 0x7facd00b3b90 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8016780 con 0x7facd00b3b90 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00ad110 con 0x7facd00b3b90 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8016b10 con 0x7facd00b3b90 2023-09-30T16:49:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd0159ce0 con 0x7facd00b3b90 2023-09-30T16:49:55.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd00740a0 con 0x7facd00b3b90 2023-09-30T16:49:55.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7facc8016c70 con 0x7facd00b3b90 2023-09-30T16:49:55.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facc5ffb640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7facb4066190 0x7facb4068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facc80846a0 con 0x7facd00b3b90 2023-09-30T16:49:55.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd555e640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7facb4066190 0x7facb4068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.562+0000 7facd555e640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7facb4066190 0x7facb4068650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ad000 tx=0x7faccc0046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.566+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7facc8051cc0 con 0x7facd00b3b90 2023-09-30T16:49:55.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facd00cf2d0 con 0x7facd00b3b90 2023-09-30T16:49:55.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facc5ffb640 1 -- 172.21.15.52:0/3873334296 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7facc80552e0 con 0x7facd00b3b90 2023-09-30T16:49:55.720 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7facb4066190 msgr2=0x7facb4068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7facb4066190 0x7facb4068650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ad000 tx=0x7faccc0046d0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 msgr2=0x7facd015ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 0x7facd015ed40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7facd00c8b70 tx=0x7facc800f520 comp rx=0 tx=0).stop 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 shutdown_connections 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7facb4066190 0x7facb4068650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facd00b3b90 0x7facd015ed40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd01f2ec0 0x7facd01597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 --2- 172.21.15.52:0/3873334296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facbc003980 0x7facd015cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 >> 172.21.15.52:0/3873334296 conn(0x7facd006a5c0 msgr2=0x7facd015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:55.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 shutdown_connections 2023-09-30T16:49:55.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.718+0000 7facd77c2640 1 -- 172.21.15.52:0/3873334296 wait complete. 2023-09-30T16:49:55.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:55.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 Processor -- start 2023-09-30T16:49:55.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 -- start start 2023-09-30T16:49:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f3815a9e0 0x7f7f38070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f380b2310 0x7f7f380b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f380b2cb0 con 0x7f7f380b63e0 2023-09-30T16:49:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f380b3ef0 con 0x7f7f380b2310 2023-09-30T16:49:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3fc92640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380ce770 con 0x7f7f3815a9e0 2023-09-30T16:49:55.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3e22f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f380b2310 0x7f7f380b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3da2e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f3815a9e0 0x7f7f38070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3e22f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f380b2310 0x7f7f380b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:53312/0 (socket says 172.21.15.52:53312) 2023-09-30T16:49:55.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3d22d640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f7f380b63e0 0x7f7f380b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39590/0 (socket says 172.21.15.52:39590) 2023-09-30T16:49:55.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3e22f640 1 -- 172.21.15.52:0/3226303572 learned_addr learned my addr 172.21.15.52:0/3226303572 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:55.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3da2e640 1 -- 172.21.15.52:0/3226303572 >> v2:172.21.15.186:3300/0 conn(0x7f7f380b2310 msgr2=0x7f7f380b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:55.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3da2e640 1 --2- 172.21.15.52:0/3226303572 >> v2:172.21.15.186:3300/0 conn(0x7f7f380b2310 0x7f7f380b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3da2e640 1 -- 172.21.15.52:0/3226303572 >> v1:172.21.15.186:6789/0 conn(0x7f7f380b63e0 legacy=0x7f7f380b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.862+0000 7f7f3da2e640 1 -- 172.21.15.52:0/3226303572 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380cea10 con 0x7f7f3815a9e0 2023-09-30T16:49:55.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3da2e640 1 --2- 172.21.15.52:0/3226303572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f3815a9e0 0x7f7f38070850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f340097c0 tx=0x7f7f3401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b09fae67c46a646d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3ca2c640 1 -- 172.21.15.52:0/3226303572 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340ac620 con 0x7f7f3815a9e0 2023-09-30T16:49:55.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3ca2c640 1 -- 172.21.15.52:0/3226303572 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f340ac780 con 0x7f7f3815a9e0 2023-09-30T16:49:55.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3ca2c640 1 -- 172.21.15.52:0/3226303572 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340acb10 con 0x7f7f3815a9e0 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 -- 172.21.15.52:0/3226303572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f3815a9e0 msgr2=0x7f7f38070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/3226303572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f3815a9e0 0x7f7f38070850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f340097c0 tx=0x7f7f3401c3c0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 -- 172.21.15.52:0/3226303572 shutdown_connections 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/3226303572 >> v2:172.21.15.186:3300/0 conn(0x7f7f380b2310 0x7f7f380b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/3226303572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f3815a9e0 0x7f7f38070850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 -- 172.21.15.52:0/3226303572 >> 172.21.15.52:0/3226303572 conn(0x7f7f380cd310 msgr2=0x7f7f380cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 -- 172.21.15.52:0/3226303572 shutdown_connections 2023-09-30T16:49:55.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 -- 172.21.15.52:0/3226303572 wait complete. 2023-09-30T16:49:55.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 Processor -- start 2023-09-30T16:49:55.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.866+0000 7f7f3fc92640 1 -- start start 2023-09-30T16:49:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f380b2310 0x7f7f38144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f380b63e0 0x7f7f3806bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 0x7f7f3806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38145110 con 0x7f7f3815a9e0 2023-09-30T16:49:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380d16d0 con 0x7f7f380b63e0 2023-09-30T16:49:55.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380c9ae0 con 0x7f7f380b2310 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 0x7f7f3806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 0x7f7f3806c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38330/0 (socket says 172.21.15.52:38330) 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 -- 172.21.15.52:0/1092716861 learned_addr learned my addr 172.21.15.52:0/1092716861 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3da2e640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f380b2310 0x7f7f38144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3d22d640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f380b63e0 0x7f7f3806bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 -- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f380b2310 msgr2=0x7f7f38144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f380b2310 0x7f7f38144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 -- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f380b63e0 msgr2=0x7f7f3806bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f380b63e0 0x7f7f3806bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 -- 172.21.15.52:0/1092716861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34009420 con 0x7f7f3815a9e0 2023-09-30T16:49:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3e22f640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 0x7f7f3806c4a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009ce0 tx=0x7f7f3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000ccc0 con 0x7f7f3815a9e0 2023-09-30T16:49:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3000f040 con 0x7f7f3815a9e0 2023-09-30T16:49:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300039a0 con 0x7f7f3815a9e0 2023-09-30T16:49:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f380c9dc0 con 0x7f7f3815a9e0 2023-09-30T16:49:55.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f380ca380 con 0x7f7f3815a9e0 2023-09-30T16:49:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f380ca5a0 con 0x7f7f3815a9e0 2023-09-30T16:49:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7f30003b00 con 0x7f7f3815a9e0 2023-09-30T16:49:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f2e7fc640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f1c066160 0x7f7f1c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f30083f70 con 0x7f7f3815a9e0 2023-09-30T16:49:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.870+0000 7f7f3da2e640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f1c066160 0x7f7f1c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:55.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.874+0000 7f7f3da2e640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f1c066160 0x7f7f1c068620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7f340ae000 tx=0x7f7f340a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:55.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:55.874+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7f300b4ed0 con 0x7f7f3815a9e0 2023-09-30T16:49:56.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f38066750 con 0x7f7f3815a9e0 2023-09-30T16:49:56.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f2e7fc640 1 -- 172.21.15.52:0/1092716861 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f30051590 con 0x7f7f3815a9e0 2023-09-30T16:49:56.032 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f1c066160 msgr2=0x7f7f1c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f1c066160 0x7f7f1c068620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7f340ae000 tx=0x7f7f340a7000 comp rx=0 tx=0).stop 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 msgr2=0x7f7f3806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 0x7f7f3806c4a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009ce0 tx=0x7f7f3000c490 comp rx=0 tx=0).stop 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 shutdown_connections 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f1c066160 0x7f7f1c068620 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3815a9e0 0x7f7f3806c4a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f380b63e0 0x7f7f3806bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 --2- 172.21.15.52:0/1092716861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f380b2310 0x7f7f38144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.030+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 >> 172.21.15.52:0/1092716861 conn(0x7f7f380cd310 msgr2=0x7f7f380b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:56.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.034+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 shutdown_connections 2023-09-30T16:49:56.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.034+0000 7f7f3fc92640 1 -- 172.21.15.52:0/1092716861 wait complete. 2023-09-30T16:49:56.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:56.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 Processor -- start 2023-09-30T16:49:56.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 -- start start 2023-09-30T16:49:56.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f532015aa40 0x7f53200c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53200b07b0 0x7f532006c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200b4610 con 0x7f53200b1470 2023-09-30T16:49:56.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532015e750 con 0x7f53200b07b0 2023-09-30T16:49:56.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532799f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532015ea30 con 0x7f532015aa40 2023-09-30T16:49:56.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53200b07b0 0x7f532006c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53200b07b0 0x7f532006c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38340/0 (socket says 172.21.15.52:38340) 2023-09-30T16:49:56.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 -- 172.21.15.52:0/4184728653 learned_addr learned my addr 172.21.15.52:0/4184728653 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:56.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f532573b640 1 --2- 172.21.15.52:0/4184728653 >> v2:172.21.15.186:3300/0 conn(0x7f532015aa40 0x7f53200c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 -- 172.21.15.52:0/4184728653 >> v2:172.21.15.186:3300/0 conn(0x7f532015aa40 msgr2=0x7f53200c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:56.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 --2- 172.21.15.52:0/4184728653 >> v2:172.21.15.186:3300/0 conn(0x7f532015aa40 0x7f53200c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 -- 172.21.15.52:0/4184728653 >> v1:172.21.15.186:6789/0 conn(0x7f53200b1470 legacy=0x7f53200b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:56.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.174+0000 7f5325f3c640 1 -- 172.21.15.52:0/4184728653 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532015ed10 con 0x7f53200b07b0 2023-09-30T16:49:56.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f5325f3c640 1 --2- 172.21.15.52:0/4184728653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b07b0 0x7f532006c250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f532006e640 tx=0x7f531801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4cddad77ab40c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f5317fff640 1 -- 172.21.15.52:0/4184728653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53180aa5f0 con 0x7f53200b07b0 2023-09-30T16:49:56.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f5317fff640 1 -- 172.21.15.52:0/4184728653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53180aa750 con 0x7f53200b07b0 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f5317fff640 1 -- 172.21.15.52:0/4184728653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53180aaae0 con 0x7f53200b07b0 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 -- 172.21.15.52:0/4184728653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b07b0 msgr2=0x7f532006c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 --2- 172.21.15.52:0/4184728653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b07b0 0x7f532006c250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f532006e640 tx=0x7f531801c490 comp rx=0 tx=0).stop 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 -- 172.21.15.52:0/4184728653 shutdown_connections 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 --2- 172.21.15.52:0/4184728653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b07b0 0x7f532006c250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 --2- 172.21.15.52:0/4184728653 >> v2:172.21.15.186:3300/0 conn(0x7f532015aa40 0x7f53200c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 -- 172.21.15.52:0/4184728653 >> 172.21.15.52:0/4184728653 conn(0x7f532006a5c0 msgr2=0x7f53200ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 -- 172.21.15.52:0/4184728653 shutdown_connections 2023-09-30T16:49:56.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.178+0000 7f532799f640 1 -- 172.21.15.52:0/4184728653 wait complete. 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 Processor -- start 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- start start 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53200b07b0 0x7f5320151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 0x7f5320150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015aa40 0x7f53200ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53200c84c0 con 0x7f53200b1470 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320151d90 con 0x7f53200b07b0 2023-09-30T16:49:56.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5320152070 con 0x7f532015aa40 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 0x7f5320150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 0x7f5320150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38356/0 (socket says 172.21.15.52:38356) 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 -- 172.21.15.52:0/386668180 learned_addr learned my addr 172.21.15.52:0/386668180 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532573b640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53200b07b0 0x7f5320151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5325f3c640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015aa40 0x7f53200ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 -- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015aa40 msgr2=0x7f53200ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015aa40 0x7f53200ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 -- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53200b07b0 msgr2=0x7f5320151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53200b07b0 0x7f5320151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 -- 172.21.15.52:0/386668180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53180094d0 con 0x7f53200b1470 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532573b640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53200b07b0 0x7f5320151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:49:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5324f3a640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 0x7f5320150ed0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f531000c450 tx=0x7f531000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310012830 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53100129b0 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5320152350 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310012d60 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5320152910 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5320153420 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.182+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f531001c460 con 0x7f53200b1470 2023-09-30T16:49:56.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.186+0000 7f5315ffb640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5304066160 0x7f5304068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.186+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5310083820 con 0x7f53200b1470 2023-09-30T16:49:56.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.186+0000 7f532573b640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5304066160 0x7f5304068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.186+0000 7f532573b640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5304066160 0x7f5304068620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f531c003fd0 tx=0x7f531c0039e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.190+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5320153420 con 0x7f53200b1470 2023-09-30T16:49:56.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.362+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5320153420 con 0x7f53200b1470 2023-09-30T16:49:56.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.362+0000 7f5315ffb640 1 -- 172.21.15.52:0/386668180 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5320153420 con 0x7f53200b1470 2023-09-30T16:49:56.403 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:56.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5304066160 msgr2=0x7f5304068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5304066160 0x7f5304068620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f531c003fd0 tx=0x7f531c0039e0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 msgr2=0x7f5320150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 0x7f5320150ed0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f531000c450 tx=0x7f531000c910 comp rx=0 tx=0).stop 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 shutdown_connections 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5304066160 0x7f5304068620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015aa40 0x7f53200ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53200b1470 0x7f5320150ed0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 --2- 172.21.15.52:0/386668180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53200b07b0 0x7f5320151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 >> 172.21.15.52:0/386668180 conn(0x7f532006a5c0 msgr2=0x7f53200aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 shutdown_connections 2023-09-30T16:49:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.366+0000 7f532799f640 1 -- 172.21.15.52:0/386668180 wait complete. 2023-09-30T16:49:56.405 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:49:56.405 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:56.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:56.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.566+0000 7f9b7c68e640 1 Processor -- start 2023-09-30T16:49:56.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.566+0000 7f9b7c68e640 1 -- start start 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7c68e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b740b07b0 0x7f9b7406c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7c68e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9b7406cb40 0x7f9b740cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7c68e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740cc320 con 0x7f9b74158ff0 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7c68e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7406d2a0 con 0x7f9b740b07b0 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7c68e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7406d580 con 0x7f9b7406cb40 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b740b07b0 0x7f9b7406c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b740b07b0 0x7f9b7406c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38362/0 (socket says 172.21.15.52:38362) 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 -- 172.21.15.52:0/2139464771 learned_addr learned my addr 172.21.15.52:0/2139464771 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7a42a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9b74158ff0 0x7f9b740b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56850/0 (socket says 172.21.15.52:56850) 2023-09-30T16:49:56.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 -- 172.21.15.52:0/2139464771 >> v2:172.21.15.186:3300/0 conn(0x7f9b7406cb40 msgr2=0x7f9b740cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:56.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b7ac2b640 1 --2- 172.21.15.52:0/2139464771 >> v2:172.21.15.186:3300/0 conn(0x7f9b7406cb40 0x7f9b740cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 --2- 172.21.15.52:0/2139464771 >> v2:172.21.15.186:3300/0 conn(0x7f9b7406cb40 0x7f9b740cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79428640 1 -- 172.21.15.52:0/2139464771 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543343400 0 0) 0x7f9b740cc320 con 0x7f9b74158ff0 2023-09-30T16:49:56.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 -- 172.21.15.52:0/2139464771 >> v1:172.21.15.52:6789/0 conn(0x7f9b74158ff0 legacy=0x7f9b740b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 -- 172.21.15.52:0/2139464771 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7406d860 con 0x7f9b740b07b0 2023-09-30T16:49:56.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79c29640 1 --2- 172.21.15.52:0/2139464771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b740b07b0 0x7f9b7406c600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b7406bdf0 tx=0x7f9b6401e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61d1a6e88f2f76f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79428640 1 -- 172.21.15.52:0/2139464771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64004230 con 0x7f9b740b07b0 2023-09-30T16:49:56.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79428640 1 -- 172.21.15.52:0/2139464771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b640ab070 con 0x7f9b740b07b0 2023-09-30T16:49:56.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.570+0000 7f9b79428640 1 -- 172.21.15.52:0/2139464771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640a7790 con 0x7f9b740b07b0 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/2139464771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b740b07b0 msgr2=0x7f9b7406c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/2139464771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b740b07b0 0x7f9b7406c600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9b7406bdf0 tx=0x7f9b6401e8e0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/2139464771 shutdown_connections 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/2139464771 >> v2:172.21.15.186:3300/0 conn(0x7f9b7406cb40 0x7f9b740cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/2139464771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b740b07b0 0x7f9b7406c600 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/2139464771 >> 172.21.15.52:0/2139464771 conn(0x7f9b7406a5f0 msgr2=0x7f9b740ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/2139464771 shutdown_connections 2023-09-30T16:49:56.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/2139464771 wait complete. 2023-09-30T16:49:56.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 Processor -- start 2023-09-30T16:49:56.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- start start 2023-09-30T16:49:56.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 0x7f9b7414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b740b07b0 0x7f9b741572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b74158ff0 0x7f9b74157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415b790 con 0x7f9b7406cb40 2023-09-30T16:49:56.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b741f69c0 con 0x7f9b74158ff0 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415adf0 con 0x7f9b740b07b0 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 0x7f9b7414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 0x7f9b7414a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38372/0 (socket says 172.21.15.52:38372) 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 -- 172.21.15.52:0/750678719 learned_addr learned my addr 172.21.15.52:0/750678719 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 -- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b740b07b0 msgr2=0x7f9b741572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b740b07b0 0x7f9b741572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 -- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b74158ff0 msgr2=0x7f9b74157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b74158ff0 0x7f9b74157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 -- 172.21.15.52:0/750678719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6400b780 con 0x7f9b7406cb40 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7a42a640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 0x7f9b7414a940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c480 tx=0x7f9b7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700074e0 con 0x7f9b7406cb40 2023-09-30T16:49:56.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70007660 con 0x7f9b7406cb40 2023-09-30T16:49:56.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70004a30 con 0x7f9b7406cb40 2023-09-30T16:49:56.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7415b0d0 con 0x7f9b7406cb40 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.574+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7414ae80 con 0x7f9b7406cb40 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.578+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7415b8d0 con 0x7f9b7406cb40 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.578+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f9b70004b90 con 0x7f9b7406cb40 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.578+0000 7f9b6affd640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b58066160 0x7f9b58068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.578+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b70082ca0 con 0x7f9b7406cb40 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.578+0000 7f9b79c29640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b58066160 0x7f9b58068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.578+0000 7f9b79c29640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b58066160 0x7f9b58068620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b640b1000 tx=0x7f9b64004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.582+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f9b7415b8d0 con 0x7f9b7406cb40 2023-09-30T16:49:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.738+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b7415b8d0 con 0x7f9b7406cb40 2023-09-30T16:49:56.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.738+0000 7f9b6affd640 1 -- 172.21.15.52:0/750678719 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f9b70053d40 con 0x7f9b7406cb40 2023-09-30T16:49:56.741 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:56.741 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b58066160 msgr2=0x7f9b58068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b58066160 0x7f9b58068620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b640b1000 tx=0x7f9b64004740 comp rx=0 tx=0).stop 2023-09-30T16:49:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 msgr2=0x7f9b7414a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 0x7f9b7414a940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c480 tx=0x7f9b7000c940 comp rx=0 tx=0).stop 2023-09-30T16:49:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 shutdown_connections 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9b58066160 0x7f9b58068620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b74158ff0 0x7f9b74157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b740b07b0 0x7f9b741572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 --2- 172.21.15.52:0/750678719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b7406cb40 0x7f9b7414a940 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 >> 172.21.15.52:0/750678719 conn(0x7f9b7406a5f0 msgr2=0x7f9b740aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 shutdown_connections 2023-09-30T16:49:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.742+0000 7f9b7c68e640 1 -- 172.21.15.52:0/750678719 wait complete. 2023-09-30T16:49:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:56.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:56.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 Processor -- start 2023-09-30T16:49:56.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 -- start start 2023-09-30T16:49:56.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb97815cc60 0x7fb9780cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9780d2780 0x7fb9780b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780d04a0 con 0x7fb9780d0040 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9780d39b0 con 0x7fb9780d2780 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97ce6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815d040 con 0x7fb97815cc60 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9780d2780 0x7fb9780b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9780d2780 0x7fb9780b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38388/0 (socket says 172.21.15.52:38388) 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 -- 172.21.15.52:0/1680220278 learned_addr learned my addr 172.21.15.52:0/1680220278 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb97659c640 1 --2- 172.21.15.52:0/1680220278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb97815cc60 0x7fb9780cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 -- 172.21.15.52:0/1680220278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb97815cc60 msgr2=0x7fb9780cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 --2- 172.21.15.52:0/1680220278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb97815cc60 0x7fb9780cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 -- 172.21.15.52:0/1680220278 >> v1:172.21.15.186:6789/0 conn(0x7fb9780d0040 legacy=0x7fb9780d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:56.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.874+0000 7fb976d9d640 1 -- 172.21.15.52:0/1680220278 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780d2da0 con 0x7fb9780d2780 2023-09-30T16:49:56.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb976d9d640 1 --2- 172.21.15.52:0/1680220278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d2780 0x7fb9780b5f70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb970009e50 tx=0x7fb97001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72892e454e87eae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97559a640 1 -- 172.21.15.52:0/1680220278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700a5740 con 0x7fb9780d2780 2023-09-30T16:49:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97559a640 1 -- 172.21.15.52:0/1680220278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9700a58a0 con 0x7fb9780d2780 2023-09-30T16:49:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97559a640 1 -- 172.21.15.52:0/1680220278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700a5c30 con 0x7fb9780d2780 2023-09-30T16:49:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/1680220278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d2780 msgr2=0x7fb9780b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/1680220278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d2780 0x7fb9780b5f70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb970009e50 tx=0x7fb97001c9d0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/1680220278 shutdown_connections 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/1680220278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d2780 0x7fb9780b5f70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/1680220278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb97815cc60 0x7fb9780cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/1680220278 >> 172.21.15.52:0/1680220278 conn(0x7fb978071930 msgr2=0x7fb978071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/1680220278 shutdown_connections 2023-09-30T16:49:56.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/1680220278 wait complete. 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 Processor -- start 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- start start 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 0x7fb9780cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9780d2780 0x7fb9781516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb97815cc60 0x7fb978151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9781488d0 con 0x7fb9780d0040 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978152410 con 0x7fb97815cc60 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780c9d10 con 0x7fb9780d2780 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 0x7fb9780cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 0x7fb9780cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38402/0 (socket says 172.21.15.52:38402) 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 -- 172.21.15.52:0/2063227298 learned_addr learned my addr 172.21.15.52:0/2063227298 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb976d9d640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb97815cc60 0x7fb978151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb975d9b640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9780d2780 0x7fb9781516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 -- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9780d2780 msgr2=0x7fb9781516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9780d2780 0x7fb9781516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 -- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb97815cc60 msgr2=0x7fb978151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb97815cc60 0x7fb978151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 -- 172.21.15.52:0/2063227298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970009b30 con 0x7fb9780d0040 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97659c640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 0x7fb9780cc2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb96800d5f0 tx=0x7fb96800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680125f0 con 0x7fb9780d0040 2023-09-30T16:49:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968012750 con 0x7fb9780d0040 2023-09-30T16:49:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9780c9ff0 con 0x7fb9780d0040 2023-09-30T16:49:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968012ae0 con 0x7fb9780d0040 2023-09-30T16:49:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.878+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb978152130 con 0x7fb9780d0040 2023-09-30T16:49:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.882+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9780740a0 con 0x7fb9780d0040 2023-09-30T16:49:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.882+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb968012c40 con 0x7fb9780d0040 2023-09-30T16:49:56.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.882+0000 7fb966ffd640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb958066160 0x7fb958068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:56.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.882+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb968083f20 con 0x7fb9780d0040 2023-09-30T16:49:56.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.882+0000 7fb975d9b640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb958066160 0x7fb958068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:56.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.882+0000 7fb975d9b640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb958066160 0x7fb958068620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb9780c9b00 tx=0x7fb96c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:56.886+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb968051540 con 0x7fb9780d0040 2023-09-30T16:49:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.034+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb978153bc0 con 0x7fb9780d0040 2023-09-30T16:49:57.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.034+0000 7fb966ffd640 1 -- 172.21.15.52:0/2063227298 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb968054b60 con 0x7fb9780d0040 2023-09-30T16:49:57.038 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb958066160 msgr2=0x7fb958068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb958066160 0x7fb958068620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb9780c9b00 tx=0x7fb96c009040 comp rx=0 tx=0).stop 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 msgr2=0x7fb9780cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 0x7fb9780cc2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb96800d5f0 tx=0x7fb96800dab0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 shutdown_connections 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb958066160 0x7fb958068620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb97815cc60 0x7fb978151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9780d2780 0x7fb9781516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 --2- 172.21.15.52:0/2063227298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9780d0040 0x7fb9780cc2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 >> 172.21.15.52:0/2063227298 conn(0x7fb978071930 msgr2=0x7fb978152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 shutdown_connections 2023-09-30T16:49:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.038+0000 7fb97ce6a640 1 -- 172.21.15.52:0/2063227298 wait complete. 2023-09-30T16:49:57.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.166+0000 7f213f145640 1 Processor -- start 2023-09-30T16:49:57.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.166+0000 7f213f145640 1 -- start start 2023-09-30T16:49:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213815cb50 0x7f2138070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f213806d730 0x7f21380c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21380c9120 0x7f2138160d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21380c9550 con 0x7f21380c9120 2023-09-30T16:49:57.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2138070f10 con 0x7f213806d730 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2138070670 con 0x7f213815cb50 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21380c9120 0x7f2138160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21380c9120 0x7f2138160d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38412/0 (socket says 172.21.15.52:38412) 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 -- 172.21.15.52:0/1815052189 learned_addr learned my addr 172.21.15.52:0/1815052189 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213cee1640 1 --2- 172.21.15.52:0/1815052189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213815cb50 0x7f2138070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f2137fff640 1 --2- 172.21.15.52:0/1815052189 >> v2:172.21.15.186:3300/0 conn(0x7f213806d730 0x7f21380c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 -- 172.21.15.52:0/1815052189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213815cb50 msgr2=0x7f2138070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 --2- 172.21.15.52:0/1815052189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213815cb50 0x7f2138070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 -- 172.21.15.52:0/1815052189 >> v2:172.21.15.186:3300/0 conn(0x7f213806d730 msgr2=0x7f21380c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 --2- 172.21.15.52:0/1815052189 >> v2:172.21.15.186:3300/0 conn(0x7f213806d730 0x7f21380c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 -- 172.21.15.52:0/1815052189 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138070950 con 0x7f21380c9120 2023-09-30T16:49:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213d6e2640 1 --2- 172.21.15.52:0/1815052189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380c9120 0x7f2138160d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f213806e430 tx=0x7f212801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fe44db62bca399 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f21377fe640 1 -- 172.21.15.52:0/1815052189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21280a89b0 con 0x7f21380c9120 2023-09-30T16:49:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f21377fe640 1 -- 172.21.15.52:0/1815052189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21280a8b10 con 0x7f21380c9120 2023-09-30T16:49:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f21377fe640 1 -- 172.21.15.52:0/1815052189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21280a8ea0 con 0x7f21380c9120 2023-09-30T16:49:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- 172.21.15.52:0/1815052189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380c9120 msgr2=0x7f2138160d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- 172.21.15.52:0/1815052189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380c9120 0x7f2138160d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f213806e430 tx=0x7f212801ecf0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- 172.21.15.52:0/1815052189 shutdown_connections 2023-09-30T16:49:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- 172.21.15.52:0/1815052189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380c9120 0x7f2138160d30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- 172.21.15.52:0/1815052189 >> v2:172.21.15.186:3300/0 conn(0x7f213806d730 0x7f21380c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 --2- 172.21.15.52:0/1815052189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213815cb50 0x7f2138070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- 172.21.15.52:0/1815052189 >> 172.21.15.52:0/1815052189 conn(0x7f213806a5c0 msgr2=0x7f21380ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- 172.21.15.52:0/1815052189 shutdown_connections 2023-09-30T16:49:57.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.170+0000 7f213f145640 1 -- 172.21.15.52:0/1815052189 wait complete. 2023-09-30T16:49:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 Processor -- start 2023-09-30T16:49:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- start start 2023-09-30T16:49:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213806d730 0x7f21381efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21380c9120 0x7f21380c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 0x7f21380c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21380b2480 con 0x7f213815cb50 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21380b2720 con 0x7f21380c9120 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21380b2a00 con 0x7f213806d730 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 0x7f21380c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 0x7f21380c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38420/0 (socket says 172.21.15.52:38420) 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 -- 172.21.15.52:0/1055855084 learned_addr learned my addr 172.21.15.52:0/1055855084 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213cee1640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213806d730 0x7f21381efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 -- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213806d730 msgr2=0x7f21381efe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213806d730 0x7f21381efe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 -- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21380c9120 msgr2=0x7f21380c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f2137fff640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21380c9120 0x7f21380c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21380c9120 0x7f21380c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 -- 172.21.15.52:0/1055855084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280094d0 con 0x7f213815cb50 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f2137fff640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21380c9120 0x7f21380c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213d6e2640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 0x7f21380c7d70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f21280b3040 tx=0x7f212801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21280ba600 con 0x7f213815cb50 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21280ba760 con 0x7f213815cb50 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21380b2ce0 con 0x7f213815cb50 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21280bab10 con 0x7f213815cb50 2023-09-30T16:49:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21381f3a70 con 0x7f213815cb50 2023-09-30T16:49:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.174+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21380740a0 con 0x7f213815cb50 2023-09-30T16:49:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.178+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f21280bac70 con 0x7f213815cb50 2023-09-30T16:49:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.178+0000 7f21357fa640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2118066160 0x7f2118068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.178+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2128122020 con 0x7f213815cb50 2023-09-30T16:49:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.178+0000 7f213cee1640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2118066160 0x7f2118068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.178+0000 7f213cee1640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2118066160 0x7f2118068620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2130003fd0 tx=0x7f21300039a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.182+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f21280ef7f0 con 0x7f213815cb50 2023-09-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21380b3190 con 0x7f213815cb50 2023-09-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f21357fa640 1 -- 172.21.15.52:0/1055855084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21280b5020 con 0x7f213815cb50 2023-09-30T16:49:57.335 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2118066160 msgr2=0x7f2118068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2118066160 0x7f2118068620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2130003fd0 tx=0x7f21300039a0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 msgr2=0x7f21380c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 0x7f21380c7d70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f21280b3040 tx=0x7f212801ba90 comp rx=0 tx=0).stop 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 shutdown_connections 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2118066160 0x7f2118068620 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f213815cb50 0x7f21380c7d70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21380c9120 0x7f21380c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 --2- 172.21.15.52:0/1055855084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f213806d730 0x7f21381efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 >> 172.21.15.52:0/1055855084 conn(0x7f213806a5c0 msgr2=0x7f2138160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 shutdown_connections 2023-09-30T16:49:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.334+0000 7f213f145640 1 -- 172.21.15.52:0/1055855084 wait complete. 2023-09-30T16:49:57.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:57.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 Processor -- start 2023-09-30T16:49:57.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 -- start start 2023-09-30T16:49:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76441599c0 0x7f76440c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f764406d880 0x7f76440705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440ce2e0 con 0x7f764406d880 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764406caf0 con 0x7f76441599c0 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764a3be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764406bf70 con 0x7f764406d440 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f764406d880 0x7f76440705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f764406d880 0x7f76440705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38428/0 (socket says 172.21.15.52:38428) 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 -- 172.21.15.52:0/3108311602 learned_addr learned my addr 172.21.15.52:0/3108311602 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f763bfff640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f7643fff640 1 --2- 172.21.15.52:0/3108311602 >> v2:172.21.15.186:3300/0 conn(0x7f76441599c0 0x7f76440c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 -- 172.21.15.52:0/3108311602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 msgr2=0x7f7644070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 -- 172.21.15.52:0/3108311602 >> v2:172.21.15.186:3300/0 conn(0x7f76441599c0 msgr2=0x7f76440c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 --2- 172.21.15.52:0/3108311602 >> v2:172.21.15.186:3300/0 conn(0x7f76441599c0 0x7f76440c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f764895b640 1 -- 172.21.15.52:0/3108311602 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764406c250 con 0x7f764406d880 2023-09-30T16:49:57.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.466+0000 7f763bfff640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:57.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764406d880 0x7f76440705b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7644071120 tx=0x7f763c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1d402f984e82f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f76437fe640 1 -- 172.21.15.52:0/3108311602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0a7a40 con 0x7f764406d880 2023-09-30T16:49:57.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f76437fe640 1 -- 172.21.15.52:0/3108311602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c0a7ba0 con 0x7f764406d880 2023-09-30T16:49:57.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f76437fe640 1 -- 172.21.15.52:0/3108311602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0af3f0 con 0x7f764406d880 2023-09-30T16:49:57.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- 172.21.15.52:0/3108311602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764406d880 msgr2=0x7f76440705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764406d880 0x7f76440705b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7644071120 tx=0x7f763c01ebb0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- 172.21.15.52:0/3108311602 shutdown_connections 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f764406d880 0x7f76440705b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- 172.21.15.52:0/3108311602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- 172.21.15.52:0/3108311602 >> v2:172.21.15.186:3300/0 conn(0x7f76441599c0 0x7f76440c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- 172.21.15.52:0/3108311602 >> 172.21.15.52:0/3108311602 conn(0x7f764406a5c0 msgr2=0x7f76440ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- 172.21.15.52:0/3108311602 shutdown_connections 2023-09-30T16:49:57.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- 172.21.15.52:0/3108311602 wait complete. 2023-09-30T16:49:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 Processor -- start 2023-09-30T16:49:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- start start 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764406d880 0x7f7644151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 0x7f76440c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644151860 con 0x7f76441599c0 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764415ab00 con 0x7f764406d880 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764a3be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440c85b0 con 0x7f764406d440 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 0x7f76440c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 0x7f76440c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38438/0 (socket says 172.21.15.52:38438) 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 -- 172.21.15.52:0/381586491 learned_addr learned my addr 172.21.15.52:0/381586491 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f7643fff640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f763bfff640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764406d880 0x7f7644151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 -- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 msgr2=0x7f7644153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 -- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764406d880 msgr2=0x7f7644151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764406d880 0x7f7644151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 -- 172.21.15.52:0/381586491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c009b30 con 0x7f76441599c0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.470+0000 7f764895b640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 0x7f76440c8070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f763c0b1040 tx=0x7f763c01b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00e150 con 0x7f76441599c0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c009510 con 0x7f76441599c0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764415a7b0 con 0x7f76441599c0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c007e40 con 0x7f76441599c0 2023-09-30T16:49:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76440c74a0 con 0x7f76441599c0 2023-09-30T16:49:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764415a940 con 0x7f76441599c0 2023-09-30T16:49:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f763c0c3440 con 0x7f76441599c0 2023-09-30T16:49:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f76417fa640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7624066160 0x7f7624068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f763c11e420 con 0x7f76441599c0 2023-09-30T16:49:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f7643fff640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7624066160 0x7f7624068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.474+0000 7f7643fff640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7624066160 0x7f7624068620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f763400a8d0 tx=0x7f7634008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.478+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f763c0ebc40 con 0x7f76441599c0 2023-09-30T16:49:57.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.634+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f764415a940 con 0x7f76441599c0 2023-09-30T16:49:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f76417fa640 1 -- 172.21.15.52:0/381586491 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f764415a940 con 0x7f76441599c0 2023-09-30T16:49:57.638 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7624066160 msgr2=0x7f7624068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7624066160 0x7f7624068620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f763400a8d0 tx=0x7f7634008040 comp rx=0 tx=0).stop 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 msgr2=0x7f76440c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 0x7f76440c8070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f763c0b1040 tx=0x7f763c01b950 comp rx=0 tx=0).stop 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 shutdown_connections 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7624066160 0x7f7624068620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76441599c0 0x7f76440c8070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764406d880 0x7f7644151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 --2- 172.21.15.52:0/381586491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764406d440 0x7f7644153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 >> 172.21.15.52:0/381586491 conn(0x7f764406a5c0 msgr2=0x7f7644158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 shutdown_connections 2023-09-30T16:49:57.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.638+0000 7f764a3be640 1 -- 172.21.15.52:0/381586491 wait complete. 2023-09-30T16:49:57.657 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:57.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc80870640 1 Processor -- start 2023-09-30T16:49:57.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc80870640 1 -- start start 2023-09-30T16:49:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc80870640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc7c070780 0x7fbc7c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc80870640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c15d3a0 con 0x7fbc7c159780 2023-09-30T16:49:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc80870640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c06db80 con 0x7fbc7c0c9d20 2023-09-30T16:49:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc80870640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cd740 con 0x7fbc7c070780 2023-09-30T16:49:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7ad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc7c070780 0x7fbc7c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7ad9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc7c070780 0x7fbc7c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38448/0 (socket says 172.21.15.52:38448) 2023-09-30T16:49:57.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbc7c159780 0x7fbc7c06d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56866/0 (socket says 172.21.15.52:56866) 2023-09-30T16:49:57.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/3630625725 learned_addr learned my addr 172.21.15.52:0/3630625725 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:57.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/3630625725 >> v1:172.21.15.186:6789/0 conn(0x7fbc7c0c9d20 legacy=0x7fbc7c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/3630625725 >> v1:172.21.15.52:6789/0 conn(0x7fbc7c159780 legacy=0x7fbc7c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.782+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/3630625725 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0cda20 con 0x7fbc7c070780 2023-09-30T16:49:57.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc7ad9d640 1 --2- 172.21.15.52:0/3630625725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c070780 0x7fbc7c15d830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009870 tx=0x7fbc7401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e7d2023794483 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc7959a640 1 -- 172.21.15.52:0/3630625725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740a8050 con 0x7fbc7c070780 2023-09-30T16:49:57.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc7959a640 1 -- 172.21.15.52:0/3630625725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc740ac5f0 con 0x7fbc7c070780 2023-09-30T16:49:57.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc7959a640 1 -- 172.21.15.52:0/3630625725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740ac980 con 0x7fbc7c070780 2023-09-30T16:49:57.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 -- 172.21.15.52:0/3630625725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c070780 msgr2=0x7fbc7c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 --2- 172.21.15.52:0/3630625725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c070780 0x7fbc7c15d830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009870 tx=0x7fbc7401c480 comp rx=0 tx=0).stop 2023-09-30T16:49:57.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 -- 172.21.15.52:0/3630625725 shutdown_connections 2023-09-30T16:49:57.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 --2- 172.21.15.52:0/3630625725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c070780 0x7fbc7c15d830 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 -- 172.21.15.52:0/3630625725 >> 172.21.15.52:0/3630625725 conn(0x7fbc7c06a5c0 msgr2=0x7fbc7c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 -- 172.21.15.52:0/3630625725 shutdown_connections 2023-09-30T16:49:57.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 -- 172.21.15.52:0/3630625725 wait complete. 2023-09-30T16:49:57.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 Processor -- start 2023-09-30T16:49:57.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.786+0000 7fbc80870640 1 -- start start 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc7c070780 0x7fbc7c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc7c0c9d20 0x7fbc7c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 0x7fbc7c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15baa0 con 0x7fbc7c159780 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15bd20 con 0x7fbc7c0c9d20 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15bfc0 con 0x7fbc7c070780 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 0x7fbc7c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 0x7fbc7c159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38462/0 (socket says 172.21.15.52:38462) 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/947867374 learned_addr learned my addr 172.21.15.52:0/947867374 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:57.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc79d9b640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc7c0c9d20 0x7fbc7c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7a59c640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc7c070780 0x7fbc7c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc7c070780 msgr2=0x7fbc7c155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc7c070780 0x7fbc7c155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc7c0c9d20 msgr2=0x7fbc7c149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc7c0c9d20 0x7fbc7c149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 -- 172.21.15.52:0/947867374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740094d0 con 0x7fbc7c159780 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7a59c640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc7c070780 0x7fbc7c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7ad9d640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 0x7fbc7c159b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc7401a0b0 tx=0x7fbc7401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740b7630 con 0x7fbc7c159780 2023-09-30T16:49:57.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc740b7790 con 0x7fbc7c159780 2023-09-30T16:49:57.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c15e300 con 0x7fbc7c159780 2023-09-30T16:49:57.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740b7b40 con 0x7fbc7c159780 2023-09-30T16:49:57.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c15c580 con 0x7fbc7c159780 2023-09-30T16:49:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c0740a0 con 0x7fbc7c159780 2023-09-30T16:49:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fbc740b3040 con 0x7fbc7c159780 2023-09-30T16:49:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc72ffd640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc5c066190 0x7fbc5c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc7411df00 con 0x7fbc7c159780 2023-09-30T16:49:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.790+0000 7fbc7a59c640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc5c066190 0x7fbc5c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.794+0000 7fbc7a59c640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc5c066190 0x7fbc5c068650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc640012f0 tx=0x7fbc64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:57.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.794+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fbc740eb520 con 0x7fbc7c159780 2023-09-30T16:49:57.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.962+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc7c0713d0 con 0x7fbc7c159780 2023-09-30T16:49:57.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.962+0000 7fbc72ffd640 1 -- 172.21.15.52:0/947867374 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc740eeb40 con 0x7fbc7c159780 2023-09-30T16:49:57.966 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:57.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc5c066190 msgr2=0x7fbc5c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc5c066190 0x7fbc5c068650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc640012f0 tx=0x7fbc64009040 comp rx=0 tx=0).stop 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 msgr2=0x7fbc7c159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 0x7fbc7c159b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc7401a0b0 tx=0x7fbc7401acc0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 shutdown_connections 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbc5c066190 0x7fbc5c068650 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c159780 0x7fbc7c159b60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc7c0c9d20 0x7fbc7c149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 --2- 172.21.15.52:0/947867374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc7c070780 0x7fbc7c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 >> 172.21.15.52:0/947867374 conn(0x7fbc7c06a5c0 msgr2=0x7fbc7c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 shutdown_connections 2023-09-30T16:49:57.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:57.966+0000 7fbc80870640 1 -- 172.21.15.52:0/947867374 wait complete. 2023-09-30T16:49:57.986 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2023-09-30T16:49:57.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:57.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-09-30T16:49:57.999 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:49:57.999 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-09-30T16:49:57.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:49:57.999 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-30T16:49:58.046 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:49:58.046 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:58.053 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:49:58.053 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:58.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:58.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 Processor -- start 2023-09-30T16:49:58.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 -- start start 2023-09-30T16:49:58.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15e4b0 0x7fb89c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb89c0b19b0 0x7fb89c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c06c240 con 0x7fb89c15a9d0 2023-09-30T16:49:58.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c15adb0 con 0x7fb89c0b19b0 2023-09-30T16:49:58.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb8a1ab2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c15ea90 con 0x7fb89c15e4b0 2023-09-30T16:49:58.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb89c0b19b0 0x7fb89c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb89c0b19b0 0x7fb89c0b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38468/0 (socket says 172.21.15.52:38468) 2023-09-30T16:49:58.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 -- 172.21.15.52:0/736946590 learned_addr learned my addr 172.21.15.52:0/736946590 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:58.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89affd640 1 --2- 172.21.15.52:0/736946590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15e4b0 0x7fb89c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 -- 172.21.15.52:0/736946590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15e4b0 msgr2=0x7fb89c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:58.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 --2- 172.21.15.52:0/736946590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15e4b0 0x7fb89c0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 -- 172.21.15.52:0/736946590 >> v1:172.21.15.186:6789/0 conn(0x7fb89c15a9d0 legacy=0x7fb89c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.218+0000 7fb89bfff640 1 -- 172.21.15.52:0/736946590 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c15ed70 con 0x7fb89c0b19b0 2023-09-30T16:49:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb89bfff640 1 --2- 172.21.15.52:0/736946590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c0b00a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb894009e50 tx=0x7fb89401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9518b51c3dd45438 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb89a7fc640 1 -- 172.21.15.52:0/736946590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a56e0 con 0x7fb89c0b19b0 2023-09-30T16:49:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb89a7fc640 1 -- 172.21.15.52:0/736946590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940a5840 con 0x7fb89c0b19b0 2023-09-30T16:49:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb89a7fc640 1 -- 172.21.15.52:0/736946590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a5bd0 con 0x7fb89c0b19b0 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/736946590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 msgr2=0x7fb89c0b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/736946590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c0b00a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb894009e50 tx=0x7fb89401ca10 comp rx=0 tx=0).stop 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/736946590 shutdown_connections 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/736946590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c0b00a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/736946590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15e4b0 0x7fb89c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/736946590 >> 172.21.15.52:0/736946590 conn(0x7fb89c06a5f0 msgr2=0x7fb89c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/736946590 shutdown_connections 2023-09-30T16:49:58.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/736946590 wait complete. 2023-09-30T16:49:58.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 Processor -- start 2023-09-30T16:49:58.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.222+0000 7fb8a1ab2640 1 -- start start 2023-09-30T16:49:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15a9d0 0x7fb89c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb89c15e4b0 0x7fb89c148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c14a400 con 0x7fb89c0b19b0 2023-09-30T16:49:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c149b60 con 0x7fb89c15e4b0 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c149e40 con 0x7fb89c15a9d0 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c1491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38470/0 (socket says 172.21.15.52:38470) 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 -- 172.21.15.52:0/3864298992 learned_addr learned my addr 172.21.15.52:0/3864298992 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89affd640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15a9d0 0x7fb89c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89bfff640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb89c15e4b0 0x7fb89c148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 -- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15a9d0 msgr2=0x7fb89c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15a9d0 0x7fb89c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 -- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb89c15e4b0 msgr2=0x7fb89c148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb89c15e4b0 0x7fb89c148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 -- 172.21.15.52:0/3864298992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009b30 con 0x7fb89c0b19b0 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89bfff640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb89c15e4b0 0x7fb89c148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89b7fe640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c1491f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c500 tx=0x7fb88c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c005220 con 0x7fb89c0b19b0 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c005380 con 0x7fb89c0b19b0 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c14a120 con 0x7fb89c0b19b0 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c007270 con 0x7fb89c0b19b0 2023-09-30T16:49:58.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c149730 con 0x7fb89c0b19b0 2023-09-30T16:49:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c154890 con 0x7fb89c0b19b0 2023-09-30T16:49:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb88c0073d0 con 0x7fb89c0b19b0 2023-09-30T16:49:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb883fff640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb888066160 0x7fb888068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb88c083340 con 0x7fb89c0b19b0 2023-09-30T16:49:58.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.226+0000 7fb89affd640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb888066160 0x7fb888068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.230+0000 7fb89affd640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb888066160 0x7fb888068620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0c7be0 tx=0x7fb890008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.230+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb89c154890 con 0x7fb89c0b19b0 2023-09-30T16:49:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.390+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb89c154890 con 0x7fb89c0b19b0 2023-09-30T16:49:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb883fff640 1 -- 172.21.15.52:0/3864298992 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fb89c154890 con 0x7fb89c0b19b0 2023-09-30T16:49:58.395 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:49:58.395 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:11.590246+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb888066160 msgr2=0x7fb888068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb888066160 0x7fb888068620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0c7be0 tx=0x7fb890008040 comp rx=0 tx=0).stop 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 msgr2=0x7fb89c1491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c1491f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c500 tx=0x7fb88c00c9c0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 shutdown_connections 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb888066160 0x7fb888068620 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb89c15e4b0 0x7fb89c148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89c15a9d0 0x7fb89c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 --2- 172.21.15.52:0/3864298992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb89c0b19b0 0x7fb89c1491f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 >> 172.21.15.52:0/3864298992 conn(0x7fb89c06a5f0 msgr2=0x7fb89c1572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 shutdown_connections 2023-09-30T16:49:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.394+0000 7fb8a1ab2640 1 -- 172.21.15.52:0/3864298992 wait complete. 2023-09-30T16:49:58.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:49:58.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:49:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 Processor -- start 2023-09-30T16:49:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 -- start start 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f956015a9e0 0x7f9560070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95600b63e0 0x7f95600b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95600b2310 0x7f95600b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600b2ce0 con 0x7f95600b63e0 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600ce770 con 0x7f956015a9e0 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f9564b72640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600cea10 con 0x7f95600b2310 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95600b63e0 0x7f95600b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95600b63e0 0x7f95600b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38478/0 (socket says 172.21.15.52:38478) 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 -- 172.21.15.52:0/3345528486 learned_addr learned my addr 172.21.15.52:0/3345528486 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955ed9d640 1 --2- 172.21.15.52:0/3345528486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95600b2310 0x7f95600b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955e59c640 1 --2- 172.21.15.52:0/3345528486 >> v2:172.21.15.186:3300/0 conn(0x7f956015a9e0 0x7f9560070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 -- 172.21.15.52:0/3345528486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95600b2310 msgr2=0x7f95600b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 --2- 172.21.15.52:0/3345528486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95600b2310 0x7f95600b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 -- 172.21.15.52:0/3345528486 >> v2:172.21.15.186:3300/0 conn(0x7f956015a9e0 msgr2=0x7f9560070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 --2- 172.21.15.52:0/3345528486 >> v2:172.21.15.186:3300/0 conn(0x7f956015a9e0 0x7f9560070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.542+0000 7f955dd9b640 1 -- 172.21.15.52:0/3345528486 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600cecf0 con 0x7f95600b63e0 2023-09-30T16:49:58.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f955dd9b640 1 --2- 172.21.15.52:0/3345528486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b37e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f95600cdf50 tx=0x7f955401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150542edc4c57a03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f955d59a640 1 -- 172.21.15.52:0/3345528486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540a5790 con 0x7f95600b63e0 2023-09-30T16:49:58.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f955d59a640 1 -- 172.21.15.52:0/3345528486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95540a58f0 con 0x7f95600b63e0 2023-09-30T16:49:58.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f955d59a640 1 -- 172.21.15.52:0/3345528486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540a5c80 con 0x7f95600b63e0 2023-09-30T16:49:58.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- 172.21.15.52:0/3345528486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 msgr2=0x7f95600b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- 172.21.15.52:0/3345528486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b37e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f95600cdf50 tx=0x7f955401c910 comp rx=0 tx=0).stop 2023-09-30T16:49:58.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- 172.21.15.52:0/3345528486 shutdown_connections 2023-09-30T16:49:58.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- 172.21.15.52:0/3345528486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95600b2310 0x7f95600b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- 172.21.15.52:0/3345528486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b37e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- 172.21.15.52:0/3345528486 >> v2:172.21.15.186:3300/0 conn(0x7f956015a9e0 0x7f9560070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- 172.21.15.52:0/3345528486 >> 172.21.15.52:0/3345528486 conn(0x7f95600cd310 msgr2=0x7f95600cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- 172.21.15.52:0/3345528486 shutdown_connections 2023-09-30T16:49:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- 172.21.15.52:0/3345528486 wait complete. 2023-09-30T16:49:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 Processor -- start 2023-09-30T16:49:58.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- start start 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95600b2310 0x7f95601f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f956015a9e0 0x7f95601fc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600b14a0 con 0x7f95600b63e0 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95601fd330 con 0x7f95600b2310 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.546+0000 7f9564b72640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95601fd610 con 0x7f956015a9e0 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38490/0 (socket says 172.21.15.52:38490) 2023-09-30T16:49:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 -- 172.21.15.52:0/44320823 learned_addr learned my addr 172.21.15.52:0/44320823 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955e59c640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95600b2310 0x7f95601f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955ed9d640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f956015a9e0 0x7f95601fc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 -- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f956015a9e0 msgr2=0x7f95601fc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f956015a9e0 0x7f95601fc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 -- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95600b2310 msgr2=0x7f95601f9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95600b2310 0x7f95601f9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 -- 172.21.15.52:0/44320823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554009b30 con 0x7f95600b63e0 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955e59c640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95600b2310 0x7f95601f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955ed9d640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f956015a9e0 0x7f95601fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955dd9b640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b4bd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f955401afc0 tx=0x7f95540196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540b8670 con 0x7f95600b63e0 2023-09-30T16:49:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95540b87d0 con 0x7f95600b63e0 2023-09-30T16:49:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956015af40 con 0x7f95600b63e0 2023-09-30T16:49:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540b8b80 con 0x7f95600b63e0 2023-09-30T16:49:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95601f9800 con 0x7f95600b63e0 2023-09-30T16:49:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560066750 con 0x7f95600b63e0 2023-09-30T16:49:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f95540b8ce0 con 0x7f95600b63e0 2023-09-30T16:49:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f954effd640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9540066160 0x7f9540068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f955411f4e0 con 0x7f95600b63e0 2023-09-30T16:49:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.550+0000 7f955e59c640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9540066160 0x7f9540068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.554+0000 7f955e59c640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9540066160 0x7f9540068620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95500097a0 tx=0x7f9550008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.554+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f95540ecbc0 con 0x7f95600b63e0 2023-09-30T16:49:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95601fd750 con 0x7f95600b63e0 2023-09-30T16:49:58.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f954effd640 1 -- 172.21.15.52:0/44320823 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95601fd750 con 0x7f95600b63e0 2023-09-30T16:49:58.719 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:49:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9540066160 msgr2=0x7f9540068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9540066160 0x7f9540068620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95500097a0 tx=0x7f9550008040 comp rx=0 tx=0).stop 2023-09-30T16:49:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 msgr2=0x7f95600b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b4bd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f955401afc0 tx=0x7f95540196b0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 shutdown_connections 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9540066160 0x7f9540068620 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f956015a9e0 0x7f95601fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95600b63e0 0x7f95600b4bd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 --2- 172.21.15.52:0/44320823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95600b2310 0x7f95601f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 >> 172.21.15.52:0/44320823 conn(0x7f95600cd310 msgr2=0x7f95600b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 shutdown_connections 2023-09-30T16:49:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.718+0000 7f9564b72640 1 -- 172.21.15.52:0/44320823 wait complete. 2023-09-30T16:49:58.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:49:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.862+0000 7fa5f60f5640 1 Processor -- start 2023-09-30T16:49:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5f60f5640 1 -- start start 2023-09-30T16:49:58.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5f60f5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5f0159080 0x7fa5f006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5f60f5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00aded0 con 0x7fa5f00c9460 2023-09-30T16:49:58.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5f60f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f0159460 con 0x7fa5f00b07b0 2023-09-30T16:49:58.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5f60f5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f006d510 con 0x7fa5f0159080 2023-09-30T16:49:58.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5eeffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa5f00c9460 0x7fa5f00b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56868/0 (socket says 172.21.15.52:56868) 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5eeffd640 1 -- 172.21.15.52:0/2557750284 learned_addr learned my addr 172.21.15.52:0/2557750284 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5ef7fe640 1 --2- 172.21.15.52:0/2557750284 >> v2:172.21.15.52:3300/0 conn(0x7fa5f0159080 0x7fa5f006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5ee7fc640 1 -- 172.21.15.52:0/2557750284 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045779301 0 0) 0x7fa5f00aded0 con 0x7fa5f00c9460 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5ee7fc640 1 -- 172.21.15.52:0/2557750284 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d8003530 con 0x7fa5f00c9460 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/2557750284 >> v1:172.21.15.186:6789/0 conn(0x7fa5f00b07b0 legacy=0x7fa5f00cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/2557750284 >> v1:172.21.15.52:6789/0 conn(0x7fa5f00c9460 legacy=0x7fa5f00b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.866+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/2557750284 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f006d7f0 con 0x7fa5f0159080 2023-09-30T16:49:58.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ef7fe640 1 --2- 172.21.15.52:0/2557750284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f0159080 0x7fa5f006c950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00097c0 tx=0x7fa5e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee72c8bdaa03e79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ee7fc640 1 -- 172.21.15.52:0/2557750284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00ab600 con 0x7fa5f0159080 2023-09-30T16:49:58.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ee7fc640 1 -- 172.21.15.52:0/2557750284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00a7050 con 0x7fa5f0159080 2023-09-30T16:49:58.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ee7fc640 1 -- 172.21.15.52:0/2557750284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00ab960 con 0x7fa5f0159080 2023-09-30T16:49:58.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- 172.21.15.52:0/2557750284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f0159080 msgr2=0x7fa5f006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/2557750284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f0159080 0x7fa5f006c950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00097c0 tx=0x7fa5e001c450 comp rx=0 tx=0).stop 2023-09-30T16:49:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- 172.21.15.52:0/2557750284 shutdown_connections 2023-09-30T16:49:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/2557750284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f0159080 0x7fa5f006c950 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- 172.21.15.52:0/2557750284 >> 172.21.15.52:0/2557750284 conn(0x7fa5f006a5c0 msgr2=0x7fa5f00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- 172.21.15.52:0/2557750284 shutdown_connections 2023-09-30T16:49:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- 172.21.15.52:0/2557750284 wait complete. 2023-09-30T16:49:58.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 Processor -- start 2023-09-30T16:49:58.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- start start 2023-09-30T16:49:58.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 0x7fa5f0148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5f00c9460 0x7fa5f014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f0159080 0x7fa5f014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c36e0 con 0x7fa5f00b07b0 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c4540 con 0x7fa5f0159080 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5f60f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c3930 con 0x7fa5f00c9460 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 0x7fa5f0148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 0x7fa5f0148290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38510/0 (socket says 172.21.15.52:38510) 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.870+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/835765563 learned_addr learned my addr 172.21.15.52:0/835765563 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5eeffd640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5f00c9460 0x7fa5f014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5effff640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f0159080 0x7fa5f014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5f00c9460 msgr2=0x7fa5f014c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5ef7fe640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5f00c9460 0x7fa5f014c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f0159080 msgr2=0x7fa5f014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5ef7fe640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f0159080 0x7fa5f014e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5ef7fe640 1 -- 172.21.15.52:0/835765563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009420 con 0x7fa5f00b07b0 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5eeffd640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5f00c9460 0x7fa5f014c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5ef7fe640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 0x7fa5f0148290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0019060 tx=0x7fa5e00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00bc070 con 0x7fa5f00b07b0 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0003830 con 0x7fa5f00b07b0 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00c3c10 con 0x7fa5f00b07b0 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0003ba0 con 0x7fa5f00b07b0 2023-09-30T16:49:58.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00c41d0 con 0x7fa5f00b07b0 2023-09-30T16:49:58.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00740a0 con 0x7fa5f00b07b0 2023-09-30T16:49:58.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa5e00b2050 con 0x7fa5f00b07b0 2023-09-30T16:49:58.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5d7fff640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa5dc066160 0x7fa5dc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:58.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa5e011d420 con 0x7fa5f00b07b0 2023-09-30T16:49:58.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5eeffd640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa5dc066160 0x7fa5dc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:58.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.874+0000 7fa5eeffd640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa5dc066160 0x7fa5dc068620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5f01f5a90 tx=0x7fa5e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:58.878+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fa5e00eab40 con 0x7fa5f00b07b0 2023-09-30T16:49:59.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.034+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5f0158590 con 0x7fa5f00b07b0 2023-09-30T16:49:59.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.034+0000 7fa5d7fff640 1 -- 172.21.15.52:0/835765563 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5e00ee160 con 0x7fa5f00b07b0 2023-09-30T16:49:59.037 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa5dc066160 msgr2=0x7fa5dc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa5dc066160 0x7fa5dc068620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5f01f5a90 tx=0x7fa5e4009040 comp rx=0 tx=0).stop 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 msgr2=0x7fa5f0148290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 0x7fa5f0148290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0019060 tx=0x7fa5e00191f0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 shutdown_connections 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa5dc066160 0x7fa5dc068620 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f0159080 0x7fa5f014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5f00c9460 0x7fa5f014c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 --2- 172.21.15.52:0/835765563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00b07b0 0x7fa5f0148290 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 >> 172.21.15.52:0/835765563 conn(0x7fa5f006a5c0 msgr2=0x7fa5f00c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:59.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 shutdown_connections 2023-09-30T16:49:59.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.038+0000 7fa5f60f5640 1 -- 172.21.15.52:0/835765563 wait complete. 2023-09-30T16:49:59.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:49:59.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.182+0000 7fcd63a14640 1 Processor -- start 2023-09-30T16:49:59.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.182+0000 7fcd63a14640 1 -- start start 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd63a14640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcd5c15e4b0 0x7fcd5c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd63a14640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd5c0b00a0 0x7fcd5c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd63a14640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0b09f0 con 0x7fcd5c15a8b0 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd63a14640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c15ea50 con 0x7fcd5c0b00a0 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd63a14640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c15ed30 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd617b0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcd5c15a8b0 0x7fcd5c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56882/0 (socket says 172.21.15.52:56882) 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd617b0640 1 -- 172.21.15.52:0/3001541114 learned_addr learned my addr 172.21.15.52:0/3001541114 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd61fb1640 1 --2- 172.21.15.52:0/3001541114 >> v2:172.21.15.52:3300/0 conn(0x7fcd5c0b00a0 0x7fcd5c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd4ffff640 1 -- 172.21.15.52:0/3001541114 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764229213 0 0) 0x7fcd5c0b09f0 con 0x7fcd5c15a8b0 2023-09-30T16:49:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd60faf640 1 --2- 172.21.15.52:0/3001541114 >> v2:172.21.15.186:3300/0 conn(0x7fcd5c15e4b0 0x7fcd5c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd4ffff640 1 -- 172.21.15.52:0/3001541114 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd48003530 con 0x7fcd5c15a8b0 2023-09-30T16:49:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd61fb1640 1 -- 172.21.15.52:0/3001541114 >> v2:172.21.15.186:3300/0 conn(0x7fcd5c15e4b0 msgr2=0x7fcd5c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd61fb1640 1 --2- 172.21.15.52:0/3001541114 >> v2:172.21.15.186:3300/0 conn(0x7fcd5c15e4b0 0x7fcd5c0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd61fb1640 1 -- 172.21.15.52:0/3001541114 >> v1:172.21.15.52:6789/0 conn(0x7fcd5c15a8b0 legacy=0x7fcd5c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd61fb1640 1 -- 172.21.15.52:0/3001541114 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c15f010 con 0x7fcd5c0b00a0 2023-09-30T16:49:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.186+0000 7fcd61fb1640 1 --2- 172.21.15.52:0/3001541114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c0b00a0 0x7fcd5c0b04b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0ce5b0 tx=0x7fcd5401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b58909b99cdfd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd4ffff640 1 -- 172.21.15.52:0/3001541114 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540a7070 con 0x7fcd5c0b00a0 2023-09-30T16:49:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd4ffff640 1 -- 172.21.15.52:0/3001541114 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd540ab430 con 0x7fcd5c0b00a0 2023-09-30T16:49:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd4ffff640 1 -- 172.21.15.52:0/3001541114 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540ab7c0 con 0x7fcd5c0b00a0 2023-09-30T16:49:59.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/3001541114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c0b00a0 msgr2=0x7fcd5c0b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 --2- 172.21.15.52:0/3001541114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c0b00a0 0x7fcd5c0b04b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0ce5b0 tx=0x7fcd5401c430 comp rx=0 tx=0).stop 2023-09-30T16:49:59.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/3001541114 shutdown_connections 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 --2- 172.21.15.52:0/3001541114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c0b00a0 0x7fcd5c0b04b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 --2- 172.21.15.52:0/3001541114 >> v2:172.21.15.186:3300/0 conn(0x7fcd5c15e4b0 0x7fcd5c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/3001541114 >> 172.21.15.52:0/3001541114 conn(0x7fcd5c06a5c0 msgr2=0x7fcd5c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/3001541114 shutdown_connections 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/3001541114 wait complete. 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 Processor -- start 2023-09-30T16:49:59.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- start start 2023-09-30T16:49:59.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5c0b00a0 0x7fcd5c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd5c15a8b0 0x7fcd5c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 0x7fcd5c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c1549f0 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c158920 con 0x7fcd5c15a8b0 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c158360 con 0x7fcd5c0b00a0 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 0x7fcd5c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 0x7fcd5c155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38522/0 (socket says 172.21.15.52:38522) 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 -- 172.21.15.52:0/2033955740 learned_addr learned my addr 172.21.15.52:0/2033955740 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd60faf640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd5c15a8b0 0x7fcd5c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd617b0640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5c0b00a0 0x7fcd5c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 -- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5c0b00a0 msgr2=0x7fcd5c154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5c0b00a0 0x7fcd5c154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 -- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd5c15a8b0 msgr2=0x7fcd5c157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd5c15a8b0 0x7fcd5c157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 -- 172.21.15.52:0/2033955740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54009420 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd61fb1640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 0x7fcd5c155f40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcd540ad040 tx=0x7fcd5401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540bf610 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd540bf790 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c158640 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540bfb40 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.190+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c155350 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.194+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c0740a0 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.194+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fcd540c9430 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.194+0000 7fcd4dffb640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd40066160 0x7fcd40068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.194+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcd5411e7f0 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.194+0000 7fcd617b0640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd40066160 0x7fcd40068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.194+0000 7fcd617b0640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd40066160 0x7fcd40068620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd500011f0 tx=0x7fcd50009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.198+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fcd540ec030 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd5c0afe80 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd4dffb640 1 -- 172.21.15.52:0/2033955740 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd540ef650 con 0x7fcd5c15e4b0 2023-09-30T16:49:59.356 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd40066160 msgr2=0x7fcd40068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd40066160 0x7fcd40068620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd500011f0 tx=0x7fcd50009040 comp rx=0 tx=0).stop 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 msgr2=0x7fcd5c155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 0x7fcd5c155f40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcd540ad040 tx=0x7fcd5401ac70 comp rx=0 tx=0).stop 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 shutdown_connections 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd40066160 0x7fcd40068620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5c15e4b0 0x7fcd5c155f40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd5c15a8b0 0x7fcd5c157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 --2- 172.21.15.52:0/2033955740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5c0b00a0 0x7fcd5c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 >> 172.21.15.52:0/2033955740 conn(0x7fcd5c06a5c0 msgr2=0x7fcd5c156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 shutdown_connections 2023-09-30T16:49:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.354+0000 7fcd63a14640 1 -- 172.21.15.52:0/2033955740 wait complete. 2023-09-30T16:49:59.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:49:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c9806c640 1 Processor -- start 2023-09-30T16:49:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c9806c640 1 -- start start 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c9806c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 0x7f8c900ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c9806c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9006dfc0 con 0x7f8c90142170 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c9806c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9006e2a0 con 0x7f8c90141d90 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c9806c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9006e580 con 0x7f8c900712b0 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c95607640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8c90142170 0x7f8c90070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56896/0 (socket says 172.21.15.52:56896) 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.498+0000 7f8c95607640 1 -- 172.21.15.52:0/2643756663 learned_addr learned my addr 172.21.15.52:0/2643756663 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c96609640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 0x7f8c900ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334220847 0 0) 0x7f8c9006dfc0 con 0x7f8c90142170 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c7c003530 con 0x7f8c90142170 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 114471219 0 0) 0x7f8c7c003530 con 0x7f8c90142170 2023-09-30T16:49:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 msgr2=0x7f8c900ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 0x7f8c900ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 >> v1:172.21.15.186:6789/0 conn(0x7f8c90141d90 legacy=0x7f8c90142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9006e860 con 0x7f8c90142170 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f8c80001680 con 0x7f8c90142170 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 >> v1:172.21.15.52:6789/0 conn(0x7f8c90142170 legacy=0x7f8c90070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7c0039b0 0x7f8c7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 0x7f8c7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c7c004d10 0x7f8c7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9006e580 con 0x7f8c7c0039b0 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c00ba70 con 0x7f8c7c004d10 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c00bc30 con 0x7f8c900712b0 2023-09-30T16:49:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7c0039b0 0x7f8c7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c96609640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c7c004d10 0x7f8c7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95607640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 0x7f8c7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 -- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 msgr2=0x7f8c7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c900712b0 0x7f8c7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 -- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c7c004d10 msgr2=0x7f8c7c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c7c004d10 0x7f8c7c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 -- 172.21.15.52:0/2643756663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c003530 con 0x7f8c7c0039b0 2023-09-30T16:49:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7c0039b0 0x7f8c7c003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8c88001e40 tx=0x7f8c8801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19830c256f1a15d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88003b80 con 0x7f8c7c0039b0 2023-09-30T16:49:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88003ce0 con 0x7f8c7c0039b0 2023-09-30T16:49:59.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.502+0000 7f8c94e06640 1 -- 172.21.15.52:0/2643756663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88005310 con 0x7f8c7c0039b0 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- 172.21.15.52:0/2643756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7c0039b0 msgr2=0x7f8c7c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2643756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7c0039b0 0x7f8c7c003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8c88001e40 tx=0x7f8c8801c710 comp rx=0 tx=0).stop 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 -- 172.21.15.52:0/2643756663 reap_dead start 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- 172.21.15.52:0/2643756663 shutdown_connections 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- 172.21.15.52:0/2643756663 >> 172.21.15.52:0/2643756663 conn(0x7f8c900cbb80 msgr2=0x7f8c900cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- 172.21.15.52:0/2643756663 shutdown_connections 2023-09-30T16:49:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- 172.21.15.52:0/2643756663 wait complete. 2023-09-30T16:49:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 Processor -- start 2023-09-30T16:49:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- start start 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c7c0039b0 0x7f8c900af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9013eb40 0x7f8c9013efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 0x7f8c900b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900b2020 con 0x7f8c9013f500 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9013f980 con 0x7f8c9013eb40 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c9806c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9013fc60 con 0x7f8c7c0039b0 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 0x7f8c900b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 0x7f8c900b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38538/0 (socket says 172.21.15.52:38538) 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 -- 172.21.15.52:0/2444316457 learned_addr learned my addr 172.21.15.52:0/2444316457 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c7c0039b0 0x7f8c900af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c95607640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9013eb40 0x7f8c9013efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 -- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c7c0039b0 msgr2=0x7f8c900af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c7c0039b0 0x7f8c900af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 -- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9013eb40 msgr2=0x7f8c9013efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9013eb40 0x7f8c9013efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 -- 172.21.15.52:0/2444316457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900c4140 con 0x7f8c9013f500 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c95607640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9013eb40 0x7f8c9013efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.506+0000 7f8c96609640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 0x7f8c900b40b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c900cd480 tx=0x7f8c8c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c004500 con 0x7f8c9013f500 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c003620 con 0x7f8c9013f500 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c900b38b0 con 0x7f8c9013f500 2023-09-30T16:49:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0039d0 con 0x7f8c9013f500 2023-09-30T16:49:59.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c900b3560 con 0x7f8c9013f500 2023-09-30T16:49:59.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c900740a0 con 0x7f8c9013f500 2023-09-30T16:49:59.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8c8c003b30 con 0x7f8c9013f500 2023-09-30T16:49:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c867fc640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8c74066190 0x7f8c74068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8c8c083e90 con 0x7f8c9013f500 2023-09-30T16:49:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8c74066190 0x7f8c74068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.510+0000 7f8c95e08640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8c74066190 0x7f8c74068650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8c880ac000 tx=0x7f8c88001520 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.514+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f8c8c051480 con 0x7f8c9013f500 2023-09-30T16:49:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8c900b3d60 con 0x7f8c9013f500 2023-09-30T16:49:59.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c867fc640 1 -- 172.21.15.52:0/2444316457 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8c8c054aa0 con 0x7f8c9013f500 2023-09-30T16:49:59.688 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8c74066190 msgr2=0x7f8c74068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8c74066190 0x7f8c74068650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8c880ac000 tx=0x7f8c88001520 comp rx=0 tx=0).stop 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 msgr2=0x7f8c900b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 0x7f8c900b40b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c900cd480 tx=0x7f8c8c011920 comp rx=0 tx=0).stop 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 shutdown_connections 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8c74066190 0x7f8c74068650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c9013f500 0x7f8c900b40b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c9013eb40 0x7f8c9013efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 --2- 172.21.15.52:0/2444316457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c7c0039b0 0x7f8c900af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 >> 172.21.15.52:0/2444316457 conn(0x7f8c900cbb80 msgr2=0x7f8c90166000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:59.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 shutdown_connections 2023-09-30T16:49:59.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.686+0000 7f8c9806c640 1 -- 172.21.15.52:0/2444316457 wait complete. 2023-09-30T16:49:59.707 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-09-30T16:49:59.707 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T16:49:59.713 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:49:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 Processor -- start 2023-09-30T16:49:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 -- start start 2023-09-30T16:49:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd5ec15ce10 0x7fd5ec0b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd5ec0d1fb0 0x7fd5ec0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ec0b7570 con 0x7fd5ec0cd870 2023-09-30T16:49:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec0b7850 con 0x7fd5ec0d1fb0 2023-09-30T16:49:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f3ef8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec0b7b30 con 0x7fd5ec15ce10 2023-09-30T16:49:59.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f2495640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd5ec0d1fb0 0x7fd5ec0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f1493640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd5ec0cd870 0x7fd5ec0cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56904/0 (socket says 172.21.15.52:56904) 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f1493640 1 -- 172.21.15.52:0/1399048440 learned_addr learned my addr 172.21.15.52:0/1399048440 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f1c94640 1 --2- 172.21.15.52:0/1399048440 >> v2:172.21.15.186:3300/0 conn(0x7fd5ec15ce10 0x7fd5ec0b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.838+0000 7fd5f2495640 1 -- 172.21.15.52:0/1399048440 >> v2:172.21.15.186:3300/0 conn(0x7fd5ec15ce10 msgr2=0x7fd5ec0b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f2495640 1 --2- 172.21.15.52:0/1399048440 >> v2:172.21.15.186:3300/0 conn(0x7fd5ec15ce10 0x7fd5ec0b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f2495640 1 -- 172.21.15.52:0/1399048440 >> v1:172.21.15.52:6789/0 conn(0x7fd5ec0cd870 legacy=0x7fd5ec0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f2495640 1 -- 172.21.15.52:0/1399048440 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0b7e10 con 0x7fd5ec0d1fb0 2023-09-30T16:49:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f0c92640 1 -- 172.21.15.52:0/1399048440 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008643327 0 0) 0x7fd5ec0b7570 con 0x7fd5ec0cd870 2023-09-30T16:49:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f2495640 1 --2- 172.21.15.52:0/1399048440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec0b5c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0b4e30 tx=0x7fd5e401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06f8b251474e9dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f0c92640 1 -- 172.21.15.52:0/1399048440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40a58d0 con 0x7fd5ec0d1fb0 2023-09-30T16:49:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f0c92640 1 -- 172.21.15.52:0/1399048440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e40a5a30 con 0x7fd5ec0d1fb0 2023-09-30T16:49:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f0c92640 1 -- 172.21.15.52:0/1399048440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40a5dc0 con 0x7fd5ec0d1fb0 2023-09-30T16:49:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/1399048440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec0d1fb0 msgr2=0x7fd5ec0b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/1399048440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec0b5c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0b4e30 tx=0x7fd5e401c7f0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/1399048440 shutdown_connections 2023-09-30T16:49:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/1399048440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec0b5c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/1399048440 >> v2:172.21.15.186:3300/0 conn(0x7fd5ec15ce10 0x7fd5ec0b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/1399048440 >> 172.21.15.52:0/1399048440 conn(0x7fd5ec071930 msgr2=0x7fd5ec071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:49:59.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/1399048440 shutdown_connections 2023-09-30T16:49:59.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.842+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/1399048440 wait complete. 2023-09-30T16:49:59.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 Processor -- start 2023-09-30T16:49:59.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- start start 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5ec0cd870 0x7fd5ec0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 0x7fd5ec153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0c95b0 con 0x7fd5ec152fe0 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec1539a0 con 0x7fd5ec0d1fb0 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec14bb10 con 0x7fd5ec0cd870 2023-09-30T16:49:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 0x7fd5ec153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 0x7fd5ec153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38550/0 (socket says 172.21.15.52:38550) 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 -- 172.21.15.52:0/12546999 learned_addr learned my addr 172.21.15.52:0/12546999 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f1493640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f1c94640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5ec0cd870 0x7fd5ec0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 -- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5ec0cd870 msgr2=0x7fd5ec0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5ec0cd870 0x7fd5ec0c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 -- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ec0d1fb0 msgr2=0x7fd5ec149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 -- 172.21.15.52:0/12546999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4009a70 con 0x7fd5ec152fe0 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f1493640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f2495640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 0x7fd5ec153460 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4019400 tx=0x7fd5e4019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40adc00 con 0x7fd5ec152fe0 2023-09-30T16:49:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e40add60 con 0x7fd5ec152fe0 2023-09-30T16:49:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec157920 con 0x7fd5ec152fe0 2023-09-30T16:49:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40b9690 con 0x7fd5ec152fe0 2023-09-30T16:49:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec14b830 con 0x7fd5ec152fe0 2023-09-30T16:49:59.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.846+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec0740a0 con 0x7fd5ec152fe0 2023-09-30T16:49:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.850+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd5e40b97f0 con 0x7fd5ec152fe0 2023-09-30T16:49:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.850+0000 7fd5e27fc640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd5d0066160 0x7fd5d0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:49:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.850+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd5e411f5a0 con 0x7fd5ec152fe0 2023-09-30T16:49:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.850+0000 7fd5f1c94640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd5d0066160 0x7fd5d0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:49:59.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.850+0000 7fd5f1c94640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd5d0066160 0x7fd5d0068620 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0c8d30 tx=0x7fd5dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:49:59.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:49:59.854+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd5e40eccb0 con 0x7fd5ec152fe0 2023-09-30T16:50:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.002+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5ec15a4d0 con 0x7fd5ec152fe0 2023-09-30T16:50:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5e27fc640 1 -- 172.21.15.52:0/12546999 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16570 (secure 0 0 0) 0x7fd5e40f02d0 con 0x7fd5ec152fe0 2023-09-30T16:50:00.007 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:00.007 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:59.618635+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd5d0066160 msgr2=0x7fd5d0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd5d0066160 0x7fd5d0068620 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0c8d30 tx=0x7fd5dc008040 comp rx=0 tx=0).stop 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 msgr2=0x7fd5ec153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 0x7fd5ec153460 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4019400 tx=0x7fd5e4019590 comp rx=0 tx=0).stop 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 shutdown_connections 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd5d0066160 0x7fd5d0068620 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5ec152fe0 0x7fd5ec153460 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5ec0d1fb0 0x7fd5ec149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 --2- 172.21.15.52:0/12546999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5ec0cd870 0x7fd5ec0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 >> 172.21.15.52:0/12546999 conn(0x7fd5ec071930 msgr2=0x7fd5ec14c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 shutdown_connections 2023-09-30T16:50:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.006+0000 7fd5f3ef8640 1 -- 172.21.15.52:0/12546999 wait complete. 2023-09-30T16:50:00.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:50:00.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:50:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 Processor -- start 2023-09-30T16:50:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 -- start start 2023-09-30T16:50:00.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f156c15a9e0 0x7f156c070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b2310 0x7f156c0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c0ce770 con 0x7f156c0b63e0 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b2ce0 con 0x7f156c15a9e0 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1570c66640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0b3ef0 con 0x7f156c0b2310 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f156c15a9e0 0x7f156c070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f156c15a9e0 0x7f156c070850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38566/0 (socket says 172.21.15.52:38566) 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 -- 172.21.15.52:0/3468663688 learned_addr learned my addr 172.21.15.52:0/3468663688 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f1569d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f156c0b63e0 0x7f156c0b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56916/0 (socket says 172.21.15.52:56916) 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156ad9d640 1 --2- 172.21.15.52:0/3468663688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b2310 0x7f156c0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 -- 172.21.15.52:0/3468663688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b2310 msgr2=0x7f156c0b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 --2- 172.21.15.52:0/3468663688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b2310 0x7f156c0b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 -- 172.21.15.52:0/3468663688 >> v1:172.21.15.52:6789/0 conn(0x7f156c0b63e0 legacy=0x7f156c0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.154+0000 7f156a59c640 1 -- 172.21.15.52:0/3468663688 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0cea10 con 0x7f156c15a9e0 2023-09-30T16:50:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 --2- 172.21.15.52:0/3468663688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c15a9e0 0x7f156c070850 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f155c0098a0 tx=0x7f155c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2947d01e2e423050 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156959a640 1 -- 172.21.15.52:0/3468663688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0ab660 con 0x7f156c15a9e0 2023-09-30T16:50:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156959a640 1 -- 172.21.15.52:0/3468663688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0ab7c0 con 0x7f156c15a9e0 2023-09-30T16:50:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156959a640 1 -- 172.21.15.52:0/3468663688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0abb50 con 0x7f156c15a9e0 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- 172.21.15.52:0/3468663688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c15a9e0 msgr2=0x7f156c070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 --2- 172.21.15.52:0/3468663688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c15a9e0 0x7f156c070850 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f155c0098a0 tx=0x7f155c01c460 comp rx=0 tx=0).stop 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- 172.21.15.52:0/3468663688 shutdown_connections 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 --2- 172.21.15.52:0/3468663688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b2310 0x7f156c0b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 --2- 172.21.15.52:0/3468663688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c15a9e0 0x7f156c070850 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- 172.21.15.52:0/3468663688 >> 172.21.15.52:0/3468663688 conn(0x7f156c0cd310 msgr2=0x7f156c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- 172.21.15.52:0/3468663688 shutdown_connections 2023-09-30T16:50:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- 172.21.15.52:0/3468663688 wait complete. 2023-09-30T16:50:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 Processor -- start 2023-09-30T16:50:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- start start 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 0x7f156c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b63e0 0x7f156c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c15a9e0 0x7f156c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c1586f0 con 0x7f156c0b2310 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15cd50 con 0x7f156c15a9e0 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1570c66640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15d030 con 0x7f156c0b63e0 2023-09-30T16:50:00.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 0x7f156c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 0x7f156c15c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38574/0 (socket says 172.21.15.52:38574) 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 -- 172.21.15.52:0/624136584 learned_addr learned my addr 172.21.15.52:0/624136584 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1569d9b640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b63e0 0x7f156c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 -- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b63e0 msgr2=0x7f156c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b63e0 0x7f156c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 -- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c15a9e0 msgr2=0x7f156c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156ad9d640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c15a9e0 0x7f156c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c15a9e0 0x7f156c0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f156a59c640 1 -- 172.21.15.52:0/624136584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0094d0 con 0x7f156c0b2310 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.158+0000 7f1569d9b640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b63e0 0x7f156c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:00.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f156a59c640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 0x7f156c15c770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f155c0ad040 tx=0x7f155c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b4800 con 0x7f156c0b2310 2023-09-30T16:50:00.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0b4980 con 0x7f156c0b2310 2023-09-30T16:50:00.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c15d310 con 0x7f156c0b2310 2023-09-30T16:50:00.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b4d30 con 0x7f156c0b2310 2023-09-30T16:50:00.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c15d8d0 con 0x7f156c0b2310 2023-09-30T16:50:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c15dac0 con 0x7f156c0b2310 2023-09-30T16:50:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f155c0a9070 con 0x7f156c0b2310 2023-09-30T16:50:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f155affd640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f154c066160 0x7f154c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f155c11dfe0 con 0x7f156c0b2310 2023-09-30T16:50:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f1569d9b640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f154c066160 0x7f154c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.162+0000 7f1569d9b640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f154c066160 0x7f154c068620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f156c1f8220 tx=0x7f1560009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.166+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f155c0eb770 con 0x7f156c0b2310 2023-09-30T16:50:00.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.322+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f156c066750 con 0x7f156c0b2310 2023-09-30T16:50:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f155affd640 1 -- 172.21.15.52:0/624136584 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f155c0c40a0 con 0x7f156c0b2310 2023-09-30T16:50:00.326 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f154c066160 msgr2=0x7f154c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f154c066160 0x7f154c068620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f156c1f8220 tx=0x7f1560009040 comp rx=0 tx=0).stop 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 msgr2=0x7f156c15c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 0x7f156c15c770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f155c0ad040 tx=0x7f155c01aca0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 shutdown_connections 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f154c066160 0x7f154c068620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c15a9e0 0x7f156c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f156c0b63e0 0x7f156c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 --2- 172.21.15.52:0/624136584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f156c0b2310 0x7f156c15c770 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 >> 172.21.15.52:0/624136584 conn(0x7f156c0cd310 msgr2=0x7f156c0d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 shutdown_connections 2023-09-30T16:50:00.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.326+0000 7f1570c66640 1 -- 172.21.15.52:0/624136584 wait complete. 2023-09-30T16:50:00.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:50:00.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 Processor -- start 2023-09-30T16:50:00.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 -- start start 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7fa8159780 0x7f7fa806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7fa8070070 0x7f7fa80704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8070a00 con 0x7f7fa806d9b0 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa815d3a0 con 0x7f7fa8159780 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fb07b8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80cd740 con 0x7f7fa8070070 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7fa8159780 0x7f7fa806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7fa8159780 0x7f7fa806d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38590/0 (socket says 172.21.15.52:38590) 2023-09-30T16:50:00.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 -- 172.21.15.52:0/3873683772 learned_addr learned my addr 172.21.15.52:0/3873683772 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:00.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fadd53640 1 --1- 172.21.15.52:0/3873683772 >> v1:172.21.15.52:6789/0 conn(0x7f7fa806d9b0 0x7f7fa80c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56918/0 (socket says 172.21.15.52:56918) 2023-09-30T16:50:00.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7faed55640 1 --2- 172.21.15.52:0/3873683772 >> v2:172.21.15.186:3300/0 conn(0x7f7fa8070070 0x7f7fa80704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 -- 172.21.15.52:0/3873683772 >> v2:172.21.15.186:3300/0 conn(0x7f7fa8070070 msgr2=0x7f7fa80704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:00.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 --2- 172.21.15.52:0/3873683772 >> v2:172.21.15.186:3300/0 conn(0x7f7fa8070070 0x7f7fa80704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 -- 172.21.15.52:0/3873683772 >> v1:172.21.15.52:6789/0 conn(0x7f7fa806d9b0 legacy=0x7f7fa80c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.466+0000 7f7fae554640 1 -- 172.21.15.52:0/3873683772 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80cda20 con 0x7f7fa8159780 2023-09-30T16:50:00.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fae554640 1 --2- 172.21.15.52:0/3873683772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8159780 0x7f7fa806d470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806e5c0 tx=0x7f7fa401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8a8b895b7516be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fad552640 1 -- 172.21.15.52:0/3873683772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40ab640 con 0x7f7fa8159780 2023-09-30T16:50:00.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fad552640 1 -- 172.21.15.52:0/3873683772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a7070 con 0x7f7fa8159780 2023-09-30T16:50:00.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fad552640 1 -- 172.21.15.52:0/3873683772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40ab9c0 con 0x7f7fa8159780 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- 172.21.15.52:0/3873683772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8159780 msgr2=0x7f7fa806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/3873683772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8159780 0x7f7fa806d470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806e5c0 tx=0x7f7fa401c440 comp rx=0 tx=0).stop 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- 172.21.15.52:0/3873683772 shutdown_connections 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/3873683772 >> v2:172.21.15.186:3300/0 conn(0x7f7fa8070070 0x7f7fa80704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/3873683772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8159780 0x7f7fa806d470 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- 172.21.15.52:0/3873683772 >> 172.21.15.52:0/3873683772 conn(0x7f7fa806a5c0 msgr2=0x7f7fa80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- 172.21.15.52:0/3873683772 shutdown_connections 2023-09-30T16:50:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- 172.21.15.52:0/3873683772 wait complete. 2023-09-30T16:50:00.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 Processor -- start 2023-09-30T16:50:00.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- start start 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 0x7f7fa81437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fa8159780 0x7f7fa815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fa815bc10 0x7f7fa8163490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa814fc70 con 0x7f7fa8070070 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa815c0c0 con 0x7f7fa8159780 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fb07b8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c5660 con 0x7f7fa815bc10 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fae554640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 0x7f7fa81437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fae554640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 0x7f7fa81437d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38592/0 (socket says 172.21.15.52:38592) 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.470+0000 7f7fae554640 1 -- 172.21.15.52:0/766470559 learned_addr learned my addr 172.21.15.52:0/766470559 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fae554640 1 -- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fa815bc10 msgr2=0x7f7fa8163490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fae554640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fa815bc10 0x7f7fa8163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fae554640 1 -- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fa8159780 msgr2=0x7f7fa815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fae554640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fa8159780 0x7f7fa815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fae554640 1 -- 172.21.15.52:0/766470559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40094d0 con 0x7f7fa8070070 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fae554640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 0x7f7fa81437d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ad040 tx=0x7f7fa401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40be5f0 con 0x7f7fa8070070 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40be750 con 0x7f7fa8070070 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa80c5870 con 0x7f7fa8070070 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40beb00 con 0x7f7fa8070070 2023-09-30T16:50:00.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80c5e30 con 0x7f7fa8070070 2023-09-30T16:50:00.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa80c8b50 con 0x7f7fa8070070 2023-09-30T16:50:00.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7fa40b43f0 con 0x7f7fa8070070 2023-09-30T16:50:00.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7f9effd640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f8c066160 0x7f7f8c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7fa411e130 con 0x7f7fa8070070 2023-09-30T16:50:00.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fadd53640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f8c066160 0x7f7f8c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.474+0000 7f7fadd53640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f8c066160 0x7f7f8c068620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80aee70 tx=0x7f7f980079d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.478+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7fa40eb690 con 0x7f7fa8070070 2023-09-30T16:50:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.630+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fa80740a0 con 0x7f7fa8070070 2023-09-30T16:50:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7f9effd640 1 -- 172.21.15.52:0/766470559 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7fa40eecb0 con 0x7f7fa8070070 2023-09-30T16:50:00.635 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f8c066160 msgr2=0x7f7f8c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f8c066160 0x7f7f8c068620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80aee70 tx=0x7f7f980079d0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 msgr2=0x7f7fa81437d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 0x7f7fa81437d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ad040 tx=0x7f7fa401ac80 comp rx=0 tx=0).stop 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 shutdown_connections 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f8c066160 0x7f7f8c068620 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fa815bc10 0x7f7fa8163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fa8159780 0x7f7fa815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 --2- 172.21.15.52:0/766470559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fa8070070 0x7f7fa81437d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 >> 172.21.15.52:0/766470559 conn(0x7f7fa806a5c0 msgr2=0x7f7fa80ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 shutdown_connections 2023-09-30T16:50:00.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.634+0000 7f7fb07b8640 1 -- 172.21.15.52:0/766470559 wait complete. 2023-09-30T16:50:00.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:50:00.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 Processor -- start 2023-09-30T16:50:00.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 -- start start 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f714815ccd0 0x7f714806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f714806a510 0x7f71480cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714815d0b0 con 0x7f714806f750 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71480cbbc0 con 0x7f714815ccd0 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714cb1b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7148071450 con 0x7f714806a510 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f714815ccd0 0x7f714806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f714815ccd0 0x7f714806ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38598/0 (socket says 172.21.15.52:38598) 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 -- 172.21.15.52:0/963415416 learned_addr learned my addr 172.21.15.52:0/963415416 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f7146d9d640 1 --2- 172.21.15.52:0/963415416 >> v2:172.21.15.186:3300/0 conn(0x7f714806a510 0x7f71480cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 -- 172.21.15.52:0/963415416 >> v2:172.21.15.186:3300/0 conn(0x7f714806a510 msgr2=0x7f71480cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 --2- 172.21.15.52:0/963415416 >> v2:172.21.15.186:3300/0 conn(0x7f714806a510 0x7f71480cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 -- 172.21.15.52:0/963415416 >> v1:172.21.15.186:6789/0 conn(0x7f714806f750 legacy=0x7f7148069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.774+0000 7f714659c640 1 -- 172.21.15.52:0/963415416 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148071730 con 0x7f714815ccd0 2023-09-30T16:50:00.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714659c640 1 --2- 172.21.15.52:0/963415416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714815ccd0 0x7f714806ef90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f71480af1c0 tx=0x7f713801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca06ea9cf011881a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714559a640 1 -- 172.21.15.52:0/963415416 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71380a56d0 con 0x7f714815ccd0 2023-09-30T16:50:00.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714559a640 1 -- 172.21.15.52:0/963415416 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71380a5830 con 0x7f714815ccd0 2023-09-30T16:50:00.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714559a640 1 -- 172.21.15.52:0/963415416 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71380a5bc0 con 0x7f714815ccd0 2023-09-30T16:50:00.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- 172.21.15.52:0/963415416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714815ccd0 msgr2=0x7f714806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 --2- 172.21.15.52:0/963415416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714815ccd0 0x7f714806ef90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f71480af1c0 tx=0x7f713801c900 comp rx=0 tx=0).stop 2023-09-30T16:50:00.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- 172.21.15.52:0/963415416 shutdown_connections 2023-09-30T16:50:00.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 --2- 172.21.15.52:0/963415416 >> v2:172.21.15.186:3300/0 conn(0x7f714806a510 0x7f71480cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 --2- 172.21.15.52:0/963415416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714815ccd0 0x7f714806ef90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- 172.21.15.52:0/963415416 >> 172.21.15.52:0/963415416 conn(0x7f714806d320 msgr2=0x7f714806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- 172.21.15.52:0/963415416 shutdown_connections 2023-09-30T16:50:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- 172.21.15.52:0/963415416 wait complete. 2023-09-30T16:50:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 Processor -- start 2023-09-30T16:50:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- start start 2023-09-30T16:50:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f714806a510 0x7f71480afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 0x7f71480c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f714815ccd0 0x7f7148155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714813dfb0 con 0x7f714806f750 2023-09-30T16:50:00.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714813d3a0 con 0x7f714806a510 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f714cb1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714813d680 con 0x7f714815ccd0 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f7145d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 0x7f71480c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f7145d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 0x7f71480c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38610/0 (socket says 172.21.15.52:38610) 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.778+0000 7f7145d9b640 1 -- 172.21.15.52:0/1031355091 learned_addr learned my addr 172.21.15.52:0/1031355091 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f714659c640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f714806a510 0x7f71480afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7146d9d640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f714815ccd0 0x7f7148155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7145d9b640 1 -- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f714815ccd0 msgr2=0x7f7148155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7145d9b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f714815ccd0 0x7f7148155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7145d9b640 1 -- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f714806a510 msgr2=0x7f71480afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7145d9b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f714806a510 0x7f71480afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7145d9b640 1 -- 172.21.15.52:0/1031355091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138009b30 con 0x7f714806f750 2023-09-30T16:50:00.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7145d9b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 0x7f71480c6af0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c450 tx=0x7f713c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c012830 con 0x7f714806f750 2023-09-30T16:50:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0129b0 con 0x7f714806f750 2023-09-30T16:50:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714813d960 con 0x7f714806f750 2023-09-30T16:50:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c012d60 con 0x7f714806f750 2023-09-30T16:50:00.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71480c7030 con 0x7f714806f750 2023-09-30T16:50:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714813e160 con 0x7f714806f750 2023-09-30T16:50:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f713c01c460 con 0x7f714806f750 2023-09-30T16:50:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7136ffd640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7128066160 0x7f7128068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f713c0841f0 con 0x7f714806f750 2023-09-30T16:50:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f714659c640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7128066160 0x7f7128068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:00.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.782+0000 7f714659c640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7128066160 0x7f7128068620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f71380ae000 tx=0x7f71380a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:00.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.786+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f713c0518d0 con 0x7f714806f750 2023-09-30T16:50:00.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.934+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71480740a0 con 0x7f714806f750 2023-09-30T16:50:00.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.934+0000 7f7136ffd640 1 -- 172.21.15.52:0/1031355091 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f713c054ef0 con 0x7f714806f750 2023-09-30T16:50:00.938 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:50:00.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7128066160 msgr2=0x7f7128068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7128066160 0x7f7128068620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f71380ae000 tx=0x7f71380a7070 comp rx=0 tx=0).stop 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 msgr2=0x7f71480c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 0x7f71480c6af0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c450 tx=0x7f713c00c910 comp rx=0 tx=0).stop 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 shutdown_connections 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7128066160 0x7f7128068620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f714815ccd0 0x7f7148155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f714806f750 0x7f71480c6af0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 --2- 172.21.15.52:0/1031355091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f714806a510 0x7f71480afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 >> 172.21.15.52:0/1031355091 conn(0x7f714806d320 msgr2=0x7f71480cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 shutdown_connections 2023-09-30T16:50:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:00.938+0000 7f714cb1b640 1 -- 172.21.15.52:0/1031355091 wait complete. 2023-09-30T16:50:00.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T16:50:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 Processor -- start 2023-09-30T16:50:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 -- start start 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd16c159080 0x7fd16c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd16c0c9460 0x7fd16c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c0aded0 con 0x7fd16c0b00a0 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c159460 con 0x7fd16c159080 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd170bf0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c06d510 con 0x7fd16c0c9460 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd16c159080 0x7fd16c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16ad9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd16c0b00a0 0x7fd16c070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56932/0 (socket says 172.21.15.52:56932) 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd16c159080 0x7fd16c06c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38616/0 (socket says 172.21.15.52:38616) 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16ad9d640 1 -- 172.21.15.52:0/3071040717 learned_addr learned my addr 172.21.15.52:0/3071040717 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16a59c640 1 -- 172.21.15.52:0/3071040717 >> v2:172.21.15.186:3300/0 conn(0x7fd16c0c9460 msgr2=0x7fd16c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd169d9b640 1 --2- 172.21.15.52:0/3071040717 >> v2:172.21.15.186:3300/0 conn(0x7fd16c0c9460 0x7fd16c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16a59c640 1 --2- 172.21.15.52:0/3071040717 >> v2:172.21.15.186:3300/0 conn(0x7fd16c0c9460 0x7fd16c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16a59c640 1 -- 172.21.15.52:0/3071040717 >> v1:172.21.15.52:6789/0 conn(0x7fd16c0b00a0 legacy=0x7fd16c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16a59c640 1 -- 172.21.15.52:0/3071040717 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c06d7f0 con 0x7fd16c159080 2023-09-30T16:50:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd16959a640 1 -- 172.21.15.52:0/3071040717 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399034533 0 0) 0x7fd16c0aded0 con 0x7fd16c0b00a0 2023-09-30T16:50:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.078+0000 7fd169d9b640 1 --2- 172.21.15.52:0/3071040717 >> v2:172.21.15.186:3300/0 conn(0x7fd16c0c9460 0x7fd16c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd16a59c640 1 --2- 172.21.15.52:0/3071040717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c159080 0x7fd16c06c950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd16c071610 tx=0x7fd15c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8276ea869064efbf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd16959a640 1 -- 172.21.15.52:0/3071040717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0ab600 con 0x7fd16c159080 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd16959a640 1 -- 172.21.15.52:0/3071040717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c0a7050 con 0x7fd16c159080 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd16959a640 1 -- 172.21.15.52:0/3071040717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0ab980 con 0x7fd16c159080 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 -- 172.21.15.52:0/3071040717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c159080 msgr2=0x7fd16c06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 --2- 172.21.15.52:0/3071040717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c159080 0x7fd16c06c950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd16c071610 tx=0x7fd15c01c430 comp rx=0 tx=0).stop 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 -- 172.21.15.52:0/3071040717 shutdown_connections 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 --2- 172.21.15.52:0/3071040717 >> v2:172.21.15.186:3300/0 conn(0x7fd16c0c9460 0x7fd16c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 --2- 172.21.15.52:0/3071040717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c159080 0x7fd16c06c950 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 -- 172.21.15.52:0/3071040717 >> 172.21.15.52:0/3071040717 conn(0x7fd16c06a5c0 msgr2=0x7fd16c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 -- 172.21.15.52:0/3071040717 shutdown_connections 2023-09-30T16:50:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 -- 172.21.15.52:0/3071040717 wait complete. 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 Processor -- start 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.082+0000 7fd170bf0640 1 -- start start 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd16c0b00a0 0x7fd16c0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 0x7fd16c144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd16c159080 0x7fd16c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c070590 con 0x7fd16c0c9460 2023-09-30T16:50:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c15c210 con 0x7fd16c0b00a0 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c15c4f0 con 0x7fd16c159080 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 0x7fd16c144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 0x7fd16c144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38618/0 (socket says 172.21.15.52:38618) 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 -- 172.21.15.52:0/2525515707 learned_addr learned my addr 172.21.15.52:0/2525515707 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd16ad9d640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd16c159080 0x7fd16c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd16a59c640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd16c0b00a0 0x7fd16c0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 -- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd16c159080 msgr2=0x7fd16c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd16c159080 0x7fd16c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 -- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd16c0b00a0 msgr2=0x7fd16c0c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd16c0b00a0 0x7fd16c0c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 -- 172.21.15.52:0/2525515707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c009420 con 0x7fd16c0c9460 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd16a59c640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd16c0b00a0 0x7fd16c0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd16ad9d640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd16c159080 0x7fd16c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd169d9b640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 0x7fd16c144980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c7c0 tx=0x7fd16000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160007a30 con 0x7fd16c0c9460 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160007b90 con 0x7fd16c0c9460 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c145c30 con 0x7fd16c0c9460 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ce70 con 0x7fd16c0c9460 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c1461f0 con 0x7fd16c0c9460 2023-09-30T16:50:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c1463b0 con 0x7fd16c0c9460 2023-09-30T16:50:01.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd1600113f0 con 0x7fd16c0c9460 2023-09-30T16:50:01.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd15affd640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd14c066160 0x7fd14c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd160083e90 con 0x7fd16c0c9460 2023-09-30T16:50:01.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.086+0000 7fd16a59c640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd14c066160 0x7fd14c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.090+0000 7fd16a59c640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd14c066160 0x7fd14c068620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0ad000 tx=0x7fd15c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.090+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd160051520 con 0x7fd16c0c9460 2023-09-30T16:50:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd16c070730 con 0x7fd16c0c9460 2023-09-30T16:50:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd15affd640 1 -- 172.21.15.52:0/2525515707 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd16001e080 con 0x7fd16c0c9460 2023-09-30T16:50:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-09-30T16:50:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd14c066160 msgr2=0x7fd14c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd14c066160 0x7fd14c068620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0ad000 tx=0x7fd15c0a6000 comp rx=0 tx=0).stop 2023-09-30T16:50:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 msgr2=0x7fd16c144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 0x7fd16c144980 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c7c0 tx=0x7fd16000cc80 comp rx=0 tx=0).stop 2023-09-30T16:50:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 shutdown_connections 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd14c066160 0x7fd14c068620 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd16c159080 0x7fd16c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c0c9460 0x7fd16c144980 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 --2- 172.21.15.52:0/2525515707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd16c0b00a0 0x7fd16c0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 >> 172.21.15.52:0/2525515707 conn(0x7fd16c06a5c0 msgr2=0x7fd16c1595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 shutdown_connections 2023-09-30T16:50:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.258+0000 7fd170bf0640 1 -- 172.21.15.52:0/2525515707 wait complete. 2023-09-30T16:50:01.279 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi186.front.sepia.ceph.com... 2023-09-30T16:50:01.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:01.279 DEBUG:teuthology.orchestra.run.smithi186:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-09-30T16:50:01.295 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:50:01.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2023-09-30T16:50:01.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:01.296 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-30T16:50:01.343 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T16:50:01.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:50:01.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 Processor -- start 2023-09-30T16:50:01.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 -- start start 2023-09-30T16:50:01.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a680ca180 0x7f1a6815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1a680ca560 0x7f1a6806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a680cc2b0 con 0x7f1a6806f2b0 2023-09-30T16:50:01.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a680cc010 con 0x7f1a680ca180 2023-09-30T16:50:01.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6d181640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6815bda0 con 0x7f1a680ca560 2023-09-30T16:50:01.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a680ca180 0x7f1a6815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a680ca180 0x7f1a6815ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38624/0 (socket says 172.21.15.52:38624) 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 -- 172.21.15.52:0/2157127100 learned_addr learned my addr 172.21.15.52:0/2157127100 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a6659c640 1 --2- 172.21.15.52:0/2157127100 >> v2:172.21.15.186:3300/0 conn(0x7f1a680ca560 0x7f1a6806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 -- 172.21.15.52:0/2157127100 >> v2:172.21.15.186:3300/0 conn(0x7f1a680ca560 msgr2=0x7f1a6806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 --2- 172.21.15.52:0/2157127100 >> v2:172.21.15.186:3300/0 conn(0x7f1a680ca560 0x7f1a6806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 -- 172.21.15.52:0/2157127100 >> v1:172.21.15.186:6789/0 conn(0x7f1a6806f2b0 legacy=0x7f1a680cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.470+0000 7f1a66d9d640 1 -- 172.21.15.52:0/2157127100 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680b5310 con 0x7f1a680ca180 2023-09-30T16:50:01.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a66d9d640 1 --2- 172.21.15.52:0/2157127100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a680ca180 0x7f1a6815ae40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009870 tx=0x7f1a5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a69f3a0ba4ce0d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a65d9b640 1 -- 172.21.15.52:0/2157127100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580aa5f0 con 0x7f1a680ca180 2023-09-30T16:50:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a65d9b640 1 -- 172.21.15.52:0/2157127100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a580aa750 con 0x7f1a680ca180 2023-09-30T16:50:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a65d9b640 1 -- 172.21.15.52:0/2157127100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580aaae0 con 0x7f1a680ca180 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 -- 172.21.15.52:0/2157127100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a680ca180 msgr2=0x7f1a6815ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 --2- 172.21.15.52:0/2157127100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a680ca180 0x7f1a6815ae40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009870 tx=0x7f1a5801c490 comp rx=0 tx=0).stop 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 -- 172.21.15.52:0/2157127100 shutdown_connections 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 --2- 172.21.15.52:0/2157127100 >> v2:172.21.15.186:3300/0 conn(0x7f1a680ca560 0x7f1a6806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 --2- 172.21.15.52:0/2157127100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a680ca180 0x7f1a6815ae40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 -- 172.21.15.52:0/2157127100 >> 172.21.15.52:0/2157127100 conn(0x7f1a6806d320 msgr2=0x7f1a6806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 -- 172.21.15.52:0/2157127100 shutdown_connections 2023-09-30T16:50:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 -- 172.21.15.52:0/2157127100 wait complete. 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 Processor -- start 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.474+0000 7f1a6d181640 1 -- start start 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 0x7f1a68155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a680ca180 0x7f1a680c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a680ca560 0x7f1a68157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680c8040 con 0x7f1a6806f2b0 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681565a0 con 0x7f1a680ca560 2023-09-30T16:50:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68156880 con 0x7f1a680ca180 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 0x7f1a68155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 0x7f1a68155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38638/0 (socket says 172.21.15.52:38638) 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 -- 172.21.15.52:0/762749209 learned_addr learned my addr 172.21.15.52:0/762749209 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6759e640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a680ca560 0x7f1a68157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6659c640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a680ca180 0x7f1a680c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 -- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a680ca180 msgr2=0x7f1a680c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a680ca180 0x7f1a680c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 -- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a680ca560 msgr2=0x7f1a68157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a680ca560 0x7f1a68157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 -- 172.21.15.52:0/762749209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580094d0 con 0x7f1a6806f2b0 2023-09-30T16:50:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a66d9d640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 0x7f1a68155c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a580ac040 tx=0x7f1a5801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580aa5f0 con 0x7f1a6806f2b0 2023-09-30T16:50:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a580b3800 con 0x7f1a6806f2b0 2023-09-30T16:50:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a68156b60 con 0x7f1a6806f2b0 2023-09-30T16:50:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580b3bb0 con 0x7f1a6806f2b0 2023-09-30T16:50:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a680c9e40 con 0x7f1a6806f2b0 2023-09-30T16:50:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a68156400 con 0x7f1a6806f2b0 2023-09-30T16:50:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1a580b3d10 con 0x7f1a6806f2b0 2023-09-30T16:50:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a4f7fe640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1a54066160 0x7f1a54068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1a580a7070 con 0x7f1a6806f2b0 2023-09-30T16:50:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.478+0000 7f1a6659c640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1a54066160 0x7f1a54068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.482+0000 7f1a6659c640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1a54066160 0x7f1a54068620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a680c6ef0 tx=0x7f1a5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.482+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1a68156400 con 0x7f1a6806f2b0 2023-09-30T16:50:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a68156400 con 0x7f1a6806f2b0 2023-09-30T16:50:01.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a4f7fe640 1 -- 172.21.15.52:0/762749209 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f1a68156400 con 0x7f1a6806f2b0 2023-09-30T16:50:01.675 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:01.676 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:50:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1a54066160 msgr2=0x7f1a54068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1a54066160 0x7f1a54068620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a680c6ef0 tx=0x7f1a5c008040 comp rx=0 tx=0).stop 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 msgr2=0x7f1a68155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 0x7f1a68155c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a580ac040 tx=0x7f1a5801acd0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 shutdown_connections 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1a54066160 0x7f1a54068620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a680ca560 0x7f1a68157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a680ca180 0x7f1a680c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 --2- 172.21.15.52:0/762749209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6806f2b0 0x7f1a68155c40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 >> 172.21.15.52:0/762749209 conn(0x7f1a6806d320 msgr2=0x7f1a680cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 shutdown_connections 2023-09-30T16:50:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.674+0000 7f1a6d181640 1 -- 172.21.15.52:0/762749209 wait complete. 2023-09-30T16:50:01.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:01.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 Processor -- start 2023-09-30T16:50:01.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 -- start start 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 0x7fbe8415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe8406d650 0x7fbe840b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8406c240 con 0x7fbe840b19b0 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8415adb0 con 0x7fbe8406d650 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe890ad640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415ea90 con 0x7fbe8415a9d0 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbe840b19b0 0x7fbe840b00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56946/0 (socket says 172.21.15.52:56946) 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 -- 172.21.15.52:0/1562356554 learned_addr learned my addr 172.21.15.52:0/1562356554 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe82d9d640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 0x7fbe8415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937441229 0 0) 0x7fbe8406c240 con 0x7fbe840b19b0 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe7bfff640 1 --2- 172.21.15.52:0/1562356554 >> v2:172.21.15.186:3300/0 conn(0x7fbe8406d650 0x7fbe840b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe70003530 con 0x7fbe840b19b0 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3816710966 0 0) 0x7fbe70003530 con 0x7fbe840b19b0 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 msgr2=0x7fbe8415e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 0x7fbe8415e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 >> v2:172.21.15.186:3300/0 conn(0x7fbe8406d650 msgr2=0x7fbe840b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 --2- 172.21.15.52:0/1562356554 >> v2:172.21.15.186:3300/0 conn(0x7fbe8406d650 0x7fbe840b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8415ed70 con 0x7fbe840b19b0 2023-09-30T16:50:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fbe7c001a00 con 0x7fbe840b19b0 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 >> v1:172.21.15.52:6789/0 conn(0x7fbe840b19b0 legacy=0x7fbe840b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe700039f0 0x7fbe70003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 0x7fbe700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe70004d10 0x7fbe70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415adb0 con 0x7fbe70004d10 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415ea90 con 0x7fbe700039f0 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7000b990 con 0x7fbe8415a9d0 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe70004d10 0x7fbe70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe82d9d640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe700039f0 0x7fbe70003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe7bfff640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 0x7fbe700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 -- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 msgr2=0x7fbe700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe8415a9d0 0x7fbe700047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 -- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe700039f0 msgr2=0x7fbe70003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe700039f0 0x7fbe70003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe8359e640 1 -- 172.21.15.52:0/1562356554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70003530 con 0x7fbe70004d10 2023-09-30T16:50:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.810+0000 7fbe82d9d640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe700039f0 0x7fbe70003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:01.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe8359e640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe70004d10 0x7fbe70005190 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00a830 tx=0x7fbe7c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb7849a69ea2491 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0ad630 con 0x7fbe70004d10 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0a8070 con 0x7fbe70004d10 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe8259c640 1 -- 172.21.15.52:0/1562356554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0ad9f0 con 0x7fbe70004d10 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 -- 172.21.15.52:0/1562356554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe70004d10 msgr2=0x7fbe70005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 --2- 172.21.15.52:0/1562356554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe70004d10 0x7fbe70005190 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00a830 tx=0x7fbe7c01d340 comp rx=0 tx=0).stop 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe8359e640 1 -- 172.21.15.52:0/1562356554 reap_dead start 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 -- 172.21.15.52:0/1562356554 shutdown_connections 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 -- 172.21.15.52:0/1562356554 >> 172.21.15.52:0/1562356554 conn(0x7fbe8406a5f0 msgr2=0x7fbe840ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 -- 172.21.15.52:0/1562356554 shutdown_connections 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 -- 172.21.15.52:0/1562356554 wait complete. 2023-09-30T16:50:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 Processor -- start 2023-09-30T16:50:01.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.814+0000 7fbe890ad640 1 -- start start 2023-09-30T16:50:01.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 0x7fbe840c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe841588b0 0x7fbe840cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe840c5ba0 0x7fbe840cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840a78b0 con 0x7fbe841584d0 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840c60b0 con 0x7fbe841588b0 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840c6390 con 0x7fbe840c5ba0 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 0x7fbe840c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 0x7fbe840c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38666/0 (socket says 172.21.15.52:38666) 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 -- 172.21.15.52:0/3844462418 learned_addr learned my addr 172.21.15.52:0/3844462418 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe8359e640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe840c5ba0 0x7fbe840cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7bfff640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe841588b0 0x7fbe840cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 -- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe840c5ba0 msgr2=0x7fbe840cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe840c5ba0 0x7fbe840cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 -- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe841588b0 msgr2=0x7fbe840cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe841588b0 0x7fbe840cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 -- 172.21.15.52:0/3844462418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840c6670 con 0x7fbe841584d0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7bfff640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe841588b0 0x7fbe840cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe82d9d640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 0x7fbe840c5660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c006f90 tx=0x7fbe6c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004220 con 0x7fbe841584d0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c004380 con 0x7fbe841584d0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe840a74d0 con 0x7fbe841584d0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c015890 con 0x7fbe841584d0 2023-09-30T16:50:01.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe841f3800 con 0x7fbe841584d0 2023-09-30T16:50:01.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe840740a0 con 0x7fbe841584d0 2023-09-30T16:50:01.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fbe6c0159f0 con 0x7fbe841584d0 2023-09-30T16:50:01.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7b7fe640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe64066160 0x7fbe64068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:01.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.818+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbe6c083c70 con 0x7fbe841584d0 2023-09-30T16:50:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.822+0000 7fbe7bfff640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe64066160 0x7fbe64068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.822+0000 7fbe7bfff640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe64066160 0x7fbe64068620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe840b42b0 tx=0x7fbe74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:01.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.822+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fbe6c051260 con 0x7fbe841584d0 2023-09-30T16:50:01.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.978+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe8415f300 con 0x7fbe841584d0 2023-09-30T16:50:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.978+0000 7fbe7b7fe640 1 -- 172.21.15.52:0/3844462418 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16570 (secure 0 0 0) 0x7fbe6c054880 con 0x7fbe841584d0 2023-09-30T16:50:01.982 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:01.982 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:59.618635+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe64066160 msgr2=0x7fbe64068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe64066160 0x7fbe64068620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe840b42b0 tx=0x7fbe74008040 comp rx=0 tx=0).stop 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 msgr2=0x7fbe840c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 0x7fbe840c5660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c006f90 tx=0x7fbe6c011a60 comp rx=0 tx=0).stop 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 shutdown_connections 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe64066160 0x7fbe64068620 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe840c5ba0 0x7fbe840cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe841588b0 0x7fbe840cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 --2- 172.21.15.52:0/3844462418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe841584d0 0x7fbe840c5660 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 >> 172.21.15.52:0/3844462418 conn(0x7fbe8406a5f0 msgr2=0x7fbe840af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 shutdown_connections 2023-09-30T16:50:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:01.982+0000 7fbe890ad640 1 -- 172.21.15.52:0/3844462418 wait complete. 2023-09-30T16:50:02.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:49:07.642562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:49:08.922981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:50:02.002 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:50:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 Processor -- start 2023-09-30T16:50:02.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 -- start start 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 0x7faa5c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c0aded0 con 0x7faa5c159080 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c159460 con 0x7faa5c06d060 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa6432b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c06d510 con 0x7faa5c0c9460 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa618c6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 0x7faa5c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa628c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa618c6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 0x7faa5c0b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:53618/0 (socket says 172.21.15.52:53618) 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa620c7640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7faa5c159080 0x7faa5c06c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39672/0 (socket says 172.21.15.52:39672) 2023-09-30T16:50:02.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa628c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:34852/0 (socket says 172.21.15.52:34852) 2023-09-30T16:50:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa618c6640 1 -- 172.21.15.52:0/3933533026 learned_addr learned my addr 172.21.15.52:0/3933533026 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa628c8640 1 -- 172.21.15.52:0/3933533026 >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 msgr2=0x7faa5c0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa628c8640 1 --2- 172.21.15.52:0/3933533026 >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 0x7faa5c0b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa628c8640 1 -- 172.21.15.52:0/3933533026 >> v1:172.21.15.186:6789/0 conn(0x7faa5c159080 legacy=0x7faa5c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa628c8640 1 -- 172.21.15.52:0/3933533026 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c06d7f0 con 0x7faa5c0c9460 2023-09-30T16:50:02.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.130+0000 7faa618c6640 1 --2- 172.21.15.52:0/3933533026 >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 0x7faa5c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:50:02.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa628c8640 1 --2- 172.21.15.52:0/3933533026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0b05e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d90 tx=0x7faa5401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153d40ac7bcd4ecd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa610c5640 1 -- 172.21.15.52:0/3933533026 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540a5960 con 0x7faa5c0c9460 2023-09-30T16:50:02.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa610c5640 1 -- 172.21.15.52:0/3933533026 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa540a5ac0 con 0x7faa5c0c9460 2023-09-30T16:50:02.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa610c5640 1 -- 172.21.15.52:0/3933533026 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540a5e50 con 0x7faa5c0c9460 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 -- 172.21.15.52:0/3933533026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 msgr2=0x7faa5c0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 --2- 172.21.15.52:0/3933533026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0b05e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d90 tx=0x7faa5401c920 comp rx=0 tx=0).stop 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 -- 172.21.15.52:0/3933533026 shutdown_connections 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 --2- 172.21.15.52:0/3933533026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0b05e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 --2- 172.21.15.52:0/3933533026 >> v2:172.21.15.186:3300/0 conn(0x7faa5c06d060 0x7faa5c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 -- 172.21.15.52:0/3933533026 >> 172.21.15.52:0/3933533026 conn(0x7faa5c06a5c0 msgr2=0x7faa5c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 -- 172.21.15.52:0/3933533026 shutdown_connections 2023-09-30T16:50:02.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.134+0000 7faa6432b640 1 -- 172.21.15.52:0/3933533026 wait complete. 2023-09-30T16:50:02.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 Processor -- start 2023-09-30T16:50:02.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- start start 2023-09-30T16:50:02.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa5c06d060 0x7faa5c148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 0x7faa5c0af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c1492b0 con 0x7faa5c159080 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c150d80 con 0x7faa5c06d060 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c3040 con 0x7faa5c0c9460 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 0x7faa5c0af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 0x7faa5c0af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38680/0 (socket says 172.21.15.52:38680) 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 -- 172.21.15.52:0/15622105 learned_addr learned my addr 172.21.15.52:0/15622105 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa620c7640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa5c06d060 0x7faa5c148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa618c6640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 -- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 msgr2=0x7faa5c0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 -- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa5c06d060 msgr2=0x7faa5c148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa5c06d060 0x7faa5c148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 -- 172.21.15.52:0/15622105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0094d0 con 0x7faa5c159080 2023-09-30T16:50:02.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa628c8640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 0x7faa5c0af610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faa5401a550 tx=0x7faa540196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540aed60 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa54009450 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa54009a70 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540b7630 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c151020 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.138+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c164e80 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.142+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7faa540b4050 con 0x7faa5c159080 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.142+0000 7faa52ffd640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa40066190 0x7faa40068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.142+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faa5411eba0 con 0x7faa5c159080 2023-09-30T16:50:02.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.142+0000 7faa620c7640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa40066190 0x7faa40068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.142+0000 7faa620c7640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa40066190 0x7faa40068650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa58000f70 tx=0x7faa58007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.146+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7faa540ec2c0 con 0x7faa5c159080 2023-09-30T16:50:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.298+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa5c151210 con 0x7faa5c159080 2023-09-30T16:50:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.298+0000 7faa52ffd640 1 -- 172.21.15.52:0/15622105 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa540b20a0 con 0x7faa5c159080 2023-09-30T16:50:02.301 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:50:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa40066190 msgr2=0x7faa40068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa40066190 0x7faa40068650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa58000f70 tx=0x7faa58007e90 comp rx=0 tx=0).stop 2023-09-30T16:50:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 msgr2=0x7faa5c0af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 0x7faa5c0af610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faa5401a550 tx=0x7faa540196c0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 shutdown_connections 2023-09-30T16:50:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7faa40066190 0x7faa40068650 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa5c159080 0x7faa5c0af610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa5c0c9460 0x7faa5c0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 --2- 172.21.15.52:0/15622105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa5c06d060 0x7faa5c148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 >> 172.21.15.52:0/15622105 conn(0x7faa5c06a5c0 msgr2=0x7faa5c158100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 shutdown_connections 2023-09-30T16:50:02.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.302+0000 7faa6432b640 1 -- 172.21.15.52:0/15622105 wait complete. 2023-09-30T16:50:02.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T16:50:02.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.430+0000 7ffba2e05640 1 Processor -- start 2023-09-30T16:50:02.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 -- start start 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb9c15a8b0 0x7ffb9c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb9c15e4b0 0x7ffb9c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c0b00a0 0x7ffb9c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c0b0a10 con 0x7ffb9c15e4b0 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c06db90 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba2e05640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c15ea50 con 0x7ffb9c0b00a0 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb9c15e4b0 0x7ffb9c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb9c15e4b0 0x7ffb9c0b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38684/0 (socket says 172.21.15.52:38684) 2023-09-30T16:50:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 -- 172.21.15.52:0/2805220184 learned_addr learned my addr 172.21.15.52:0/2805220184 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba0ba1640 1 --2- 172.21.15.52:0/2805220184 >> v2:172.21.15.186:3300/0 conn(0x7ffb9c15a8b0 0x7ffb9c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba13a2640 1 --2- 172.21.15.52:0/2805220184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c0b00a0 0x7ffb9c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 -- 172.21.15.52:0/2805220184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c0b00a0 msgr2=0x7ffb9c0b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 --2- 172.21.15.52:0/2805220184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c0b00a0 0x7ffb9c0b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 -- 172.21.15.52:0/2805220184 >> v2:172.21.15.186:3300/0 conn(0x7ffb9c15a8b0 msgr2=0x7ffb9c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 --2- 172.21.15.52:0/2805220184 >> v2:172.21.15.186:3300/0 conn(0x7ffb9c15a8b0 0x7ffb9c06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 -- 172.21.15.52:0/2805220184 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c15ed30 con 0x7ffb9c15e4b0 2023-09-30T16:50:02.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffba0ba1640 1 --2- 172.21.15.52:0/2805220184 >> v2:172.21.15.186:3300/0 conn(0x7ffb9c15a8b0 0x7ffb9c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:02.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9bfff640 1 --2- 172.21.15.52:0/2805220184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c06e2e0 tx=0x7ffb8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d19b571116d15e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9b7fe640 1 -- 172.21.15.52:0/2805220184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0aa5f0 con 0x7ffb9c15e4b0 2023-09-30T16:50:02.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9b7fe640 1 -- 172.21.15.52:0/2805220184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0aa750 con 0x7ffb9c15e4b0 2023-09-30T16:50:02.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.434+0000 7ffb9b7fe640 1 -- 172.21.15.52:0/2805220184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0aaae0 con 0x7ffb9c15e4b0 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/2805220184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15e4b0 msgr2=0x7ffb9c0b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- 172.21.15.52:0/2805220184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c06e2e0 tx=0x7ffb8c01c4d0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/2805220184 shutdown_connections 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- 172.21.15.52:0/2805220184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c0b00a0 0x7ffb9c0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- 172.21.15.52:0/2805220184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1470 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- 172.21.15.52:0/2805220184 >> v2:172.21.15.186:3300/0 conn(0x7ffb9c15a8b0 0x7ffb9c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/2805220184 >> 172.21.15.52:0/2805220184 conn(0x7ffb9c06a5c0 msgr2=0x7ffb9c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:02.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/2805220184 shutdown_connections 2023-09-30T16:50:02.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/2805220184 wait complete. 2023-09-30T16:50:02.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 Processor -- start 2023-09-30T16:50:02.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- start start 2023-09-30T16:50:02.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb9c0b00a0 0x7ffb9c13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 0x7ffb9c15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c1520c0 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c152550 con 0x7ffb9c0b00a0 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c140050 con 0x7ffb9c15e4b0 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 0x7ffb9c15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 0x7ffb9c15d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38694/0 (socket says 172.21.15.52:38694) 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 -- 172.21.15.52:0/1342715364 learned_addr learned my addr 172.21.15.52:0/1342715364 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba13a2640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba0ba1640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb9c0b00a0 0x7ffb9c13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 -- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c15e4b0 msgr2=0x7ffb9c0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 -- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb9c0b00a0 msgr2=0x7ffb9c13fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb9c0b00a0 0x7ffb9c13fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 -- 172.21.15.52:0/1342715364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0094d0 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba13a2640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb9bfff640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 0x7ffb9c15d730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0ac040 tx=0x7ffb8c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0b4810 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0b49b0 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c1511d0 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0b4d60 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.438+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c151790 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.442+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c06c090 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.442+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ffb8c0be410 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.442+0000 7ffb997fa640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb88066160 0x7ffb88068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.442+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffb8c0a7070 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.442+0000 7ffba0ba1640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb88066160 0x7ffb88068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.442+0000 7ffba0ba1640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb88066160 0x7ffb88068620 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006fd0 tx=0x7ffb90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.446+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ffb8c0ebf70 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.598+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb9c0740a0 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.598+0000 7ffb997fa640 1 -- 172.21.15.52:0/1342715364 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb8c0ef590 con 0x7ffb9c15a8b0 2023-09-30T16:50:02.600 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.598+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb88066160 msgr2=0x7ffb88068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.598+0000 7ffba2e05640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb88066160 0x7ffb88068620 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffb90006fd0 tx=0x7ffb90008040 comp rx=0 tx=0).stop 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 msgr2=0x7ffb9c15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 0x7ffb9c15d730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0ac040 tx=0x7ffb8c019270 comp rx=0 tx=0).stop 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 shutdown_connections 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb88066160 0x7ffb88068620 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb9c15e4b0 0x7ffb9c0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9c15a8b0 0x7ffb9c15d730 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 --2- 172.21.15.52:0/1342715364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb9c0b00a0 0x7ffb9c13fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 >> 172.21.15.52:0/1342715364 conn(0x7ffb9c06a5c0 msgr2=0x7ffb9c153d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:02.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 shutdown_connections 2023-09-30T16:50:02.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.602+0000 7ffba2e05640 1 -- 172.21.15.52:0/1342715364 wait complete. 2023-09-30T16:50:02.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T16:50:02.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 Processor -- start 2023-09-30T16:50:02.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 -- start start 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f4c0b63e0 0x7f0f4c0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c0ce770 con 0x7f0f4c0b2310 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c0cea10 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f546da640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0cecf0 con 0x7f0f4c15a9e0 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f52c77640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0f4c0b2310 0x7f0f4c0cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56952/0 (socket says 172.21.15.52:56952) 2023-09-30T16:50:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f52c77640 1 -- 172.21.15.52:0/1935684893 learned_addr learned my addr 172.21.15.52:0/1935684893 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f51c75640 1 --2- 172.21.15.52:0/1935684893 >> v2:172.21.15.52:3300/0 conn(0x7f0f4c0b63e0 0x7f0f4c0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f52476640 1 --2- 172.21.15.52:0/1935684893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f51c75640 1 -- 172.21.15.52:0/1935684893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 msgr2=0x7f0f4c070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f51c75640 1 --2- 172.21.15.52:0/1935684893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f51c75640 1 -- 172.21.15.52:0/1935684893 >> v1:172.21.15.52:6789/0 conn(0x7f0f4c0b2310 legacy=0x7f0f4c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f51c75640 1 -- 172.21.15.52:0/1935684893 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0cefd0 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.730+0000 7f0f51474640 1 -- 172.21.15.52:0/1935684893 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502154740 0 0) 0x7f0f4c0ce770 con 0x7f0f4c0b2310 2023-09-30T16:50:02.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f51c75640 1 --2- 172.21.15.52:0/1935684893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c0b37e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f480097c0 tx=0x7f0f4801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45ab26b2b87add4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f51474640 1 -- 172.21.15.52:0/1935684893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480ab600 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f51474640 1 -- 172.21.15.52:0/1935684893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f480a7050 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f51474640 1 -- 172.21.15.52:0/1935684893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480ab980 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 -- 172.21.15.52:0/1935684893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 msgr2=0x7f0f4c0b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 --2- 172.21.15.52:0/1935684893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c0b37e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f480097c0 tx=0x7f0f4801c3c0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 -- 172.21.15.52:0/1935684893 shutdown_connections 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 --2- 172.21.15.52:0/1935684893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c0b37e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 --2- 172.21.15.52:0/1935684893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 -- 172.21.15.52:0/1935684893 >> 172.21.15.52:0/1935684893 conn(0x7f0f4c0cd310 msgr2=0x7f0f4c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 -- 172.21.15.52:0/1935684893 shutdown_connections 2023-09-30T16:50:02.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 -- 172.21.15.52:0/1935684893 wait complete. 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 Processor -- start 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.734+0000 7f0f546da640 1 -- start start 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f4c0b2310 0x7f0f4c141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c142050 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1452b0 con 0x7f0f4c0b2310 2023-09-30T16:50:02.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c15d230 con 0x7f0f4c15a9e0 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38714/0 (socket says 172.21.15.52:38714) 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 -- 172.21.15.52:0/929683219 learned_addr learned my addr 172.21.15.52:0/929683219 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 -- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 msgr2=0x7f0f4c0d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f52c77640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f52476640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f4c0b2310 0x7f0f4c141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c0d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 -- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f4c0b2310 msgr2=0x7f0f4c141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f4c0b2310 0x7f0f4c141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 -- 172.21.15.52:0/929683219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48009420 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f51c75640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c144d70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f480ae040 tx=0x7f0f48019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480b4840 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f480b49c0 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4c15d510 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480b4d70 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c15dad0 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c066750 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f0f480b2040 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f42ffd640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0f30066160 0x7f0f30068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:02.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0f4811de80 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f52476640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0f30066160 0x7f0f30068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:02.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.738+0000 7f0f52476640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0f30066160 0x7f0f30068620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0096f0 tx=0x7f0f3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:02.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.742+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f0f480eb3e0 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.898+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f4c0740a0 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.898+0000 7f0f42ffd640 1 -- 172.21.15.52:0/929683219 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f480b0020 con 0x7f0f4c0b63e0 2023-09-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-09-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.898+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0f30066160 msgr2=0x7f0f30068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.898+0000 7f0f546da640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0f30066160 0x7f0f30068620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0096f0 tx=0x7f0f3c008040 comp rx=0 tx=0).stop 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.898+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 msgr2=0x7f0f4c144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.898+0000 7f0f546da640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c144d70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f480ae040 tx=0x7f0f48019160 comp rx=0 tx=0).stop 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 shutdown_connections 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0f30066160 0x7f0f30068620 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f4c15a9e0 0x7f0f4c0d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f4c0b63e0 0x7f0f4c144d70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 --2- 172.21.15.52:0/929683219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f4c0b2310 0x7f0f4c141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 >> 172.21.15.52:0/929683219 conn(0x7f0f4c0cd310 msgr2=0x7f0f4c0b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 shutdown_connections 2023-09-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:02.902+0000 7f0f546da640 1 -- 172.21.15.52:0/929683219 wait complete. 2023-09-30T16:50:02.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.038+0000 7fdd0444c640 1 Processor -- start 2023-09-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.038+0000 7fdd0444c640 1 -- start start 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd0444c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 0x7fdcfc070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd0444c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdcfc0b2310 0x7fdcfc0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd0444c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc0b2cb0 con 0x7fdcfc0b63e0 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd0444c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b3ef0 con 0x7fdcfc0b2310 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd0444c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0ce770 con 0x7fdcfc15a9e0 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 0x7fdcfc070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 0x7fdcfc070850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:34910/0 (socket says 172.21.15.52:34910) 2023-09-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd019e7640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fdcfc0b63e0 0x7fdcfc0b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39682/0 (socket says 172.21.15.52:39682) 2023-09-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 -- 172.21.15.52:0/3491437853 learned_addr learned my addr 172.21.15.52:0/3491437853 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd029e9640 1 --2- 172.21.15.52:0/3491437853 >> v2:172.21.15.186:3300/0 conn(0x7fdcfc0b2310 0x7fdcfc0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 -- 172.21.15.52:0/3491437853 >> v2:172.21.15.186:3300/0 conn(0x7fdcfc0b2310 msgr2=0x7fdcfc0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 --2- 172.21.15.52:0/3491437853 >> v2:172.21.15.186:3300/0 conn(0x7fdcfc0b2310 0x7fdcfc0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 -- 172.21.15.52:0/3491437853 >> v1:172.21.15.186:6789/0 conn(0x7fdcfc0b63e0 legacy=0x7fdcfc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.042+0000 7fdd021e8640 1 -- 172.21.15.52:0/3491437853 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0cea10 con 0x7fdcfc15a9e0 2023-09-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd021e8640 1 --2- 172.21.15.52:0/3491437853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 0x7fdcfc070850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009870 tx=0x7fdcf801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39537fffcca3be1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd011e6640 1 -- 172.21.15.52:0/3491437853 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80ab680 con 0x7fdcfc15a9e0 2023-09-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd011e6640 1 -- 172.21.15.52:0/3491437853 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf80ab7e0 con 0x7fdcfc15a9e0 2023-09-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd011e6640 1 -- 172.21.15.52:0/3491437853 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80abb70 con 0x7fdcfc15a9e0 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 -- 172.21.15.52:0/3491437853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 msgr2=0x7fdcfc070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 --2- 172.21.15.52:0/3491437853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 0x7fdcfc070850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009870 tx=0x7fdcf801c480 comp rx=0 tx=0).stop 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 -- 172.21.15.52:0/3491437853 shutdown_connections 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 --2- 172.21.15.52:0/3491437853 >> v2:172.21.15.186:3300/0 conn(0x7fdcfc0b2310 0x7fdcfc0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 --2- 172.21.15.52:0/3491437853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc15a9e0 0x7fdcfc070850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 -- 172.21.15.52:0/3491437853 >> 172.21.15.52:0/3491437853 conn(0x7fdcfc0cd310 msgr2=0x7fdcfc0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 -- 172.21.15.52:0/3491437853 shutdown_connections 2023-09-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 -- 172.21.15.52:0/3491437853 wait complete. 2023-09-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.046+0000 7fdd0444c640 1 Processor -- start 2023-09-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- start start 2023-09-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 0x7fdcfc155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0b63e0 0x7fdcfc14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc15a9e0 0x7fdcfc0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc156820 con 0x7fdcfc0b2310 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc156540 con 0x7fdcfc15a9e0 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1511a0 con 0x7fdcfc0b63e0 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 0x7fdcfc155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 0x7fdcfc155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38722/0 (socket says 172.21.15.52:38722) 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 -- 172.21.15.52:0/1134604768 learned_addr learned my addr 172.21.15.52:0/1134604768 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd019e7640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0b63e0 0x7fdcfc14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd029e9640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc15a9e0 0x7fdcfc0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 -- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0b63e0 msgr2=0x7fdcfc14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0b63e0 0x7fdcfc14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 -- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc15a9e0 msgr2=0x7fdcfc0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc15a9e0 0x7fdcfc0d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 -- 172.21.15.52:0/1134604768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80094d0 con 0x7fdcfc0b2310 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd029e9640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc15a9e0 0x7fdcfc0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd021e8640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 0x7fdcfc155ed0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80ad040 tx=0x7fdcf8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80b5810 con 0x7fdcfc0b2310 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf80b59b0 con 0x7fdcfc0b2310 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80b5d60 con 0x7fdcfc0b2310 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc151480 con 0x7fdcfc0b2310 2023-09-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc14e0a0 con 0x7fdcfc0b2310 2023-09-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc066750 con 0x7fdcfc0b2310 2023-09-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.050+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fdcf80c93f0 con 0x7fdcfc0b2310 2023-09-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.054+0000 7fdcf2ffd640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdce0066160 0x7fdce0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.054+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdcf811eb00 con 0x7fdcfc0b2310 2023-09-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.054+0000 7fdd019e7640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdce0066160 0x7fdce0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.054+0000 7fdd019e7640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdce0066160 0x7fdce0068620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc1527a0 tx=0x7fdcec007cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.058+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fdcf80ec110 con 0x7fdcfc0b2310 2023-09-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.246+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcfc0740a0 con 0x7fdcfc0b2310 2023-09-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdcf2ffd640 1 -- 172.21.15.52:0/1134604768 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fdcf80ef730 con 0x7fdcfc0b2310 2023-09-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdce0066160 msgr2=0x7fdce0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdce0066160 0x7fdce0068620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc1527a0 tx=0x7fdcec007cd0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 msgr2=0x7fdcfc155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 0x7fdcfc155ed0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80ad040 tx=0x7fdcf8019220 comp rx=0 tx=0).stop 2023-09-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 shutdown_connections 2023-09-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdce0066160 0x7fdce0068620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc15a9e0 0x7fdcfc0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0b63e0 0x7fdcfc14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 --2- 172.21.15.52:0/1134604768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc0b2310 0x7fdcfc155ed0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 >> 172.21.15.52:0/1134604768 conn(0x7fdcfc0cd310 msgr2=0x7fdcfc159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 shutdown_connections 2023-09-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.250+0000 7fdd0444c640 1 -- 172.21.15.52:0/1134604768 wait complete. 2023-09-30T16:50:03.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:03.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.386+0000 7f3a84686640 1 Processor -- start 2023-09-30T16:50:03.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.386+0000 7f3a84686640 1 -- start start 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a84686640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3a7c158ff0 0x7f3a7c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a84686640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a7c0b05e0 0x7f3a7c06c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a84686640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c06cb40 0x7f3a7c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a84686640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c0b0a40 con 0x7f3a7c0b05e0 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a84686640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c0cc320 con 0x7f3a7c158ff0 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a84686640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c06cfd0 con 0x7f3a7c06cb40 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a7c0b05e0 0x7f3a7c06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a7c0b05e0 0x7f3a7c06c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38738/0 (socket says 172.21.15.52:38738) 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 -- 172.21.15.52:0/1532013244 learned_addr learned my addr 172.21.15.52:0/1532013244 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:03.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a82c23640 1 --2- 172.21.15.52:0/1532013244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c06cb40 0x7f3a7c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a82422640 1 --2- 172.21.15.52:0/1532013244 >> v2:172.21.15.186:3300/0 conn(0x7f3a7c158ff0 0x7f3a7c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 -- 172.21.15.52:0/1532013244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c06cb40 msgr2=0x7f3a7c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 --2- 172.21.15.52:0/1532013244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c06cb40 0x7f3a7c0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 -- 172.21.15.52:0/1532013244 >> v2:172.21.15.186:3300/0 conn(0x7f3a7c158ff0 msgr2=0x7f3a7c0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 --2- 172.21.15.52:0/1532013244 >> v2:172.21.15.186:3300/0 conn(0x7f3a7c158ff0 0x7f3a7c0b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 -- 172.21.15.52:0/1532013244 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c06d2a0 con 0x7f3a7c0b05e0 2023-09-30T16:50:03.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a82422640 1 --2- 172.21.15.52:0/1532013244 >> v2:172.21.15.186:3300/0 conn(0x7f3a7c158ff0 0x7f3a7c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:03.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81c21640 1 --2- 172.21.15.52:0/1532013244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c0b05e0 0x7f3a7c06c600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c071270 tx=0x7f3a7801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73af878c431c566 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81420640 1 -- 172.21.15.52:0/1532013244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780ab600 con 0x7f3a7c0b05e0 2023-09-30T16:50:03.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81420640 1 -- 172.21.15.52:0/1532013244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a780ab760 con 0x7f3a7c0b05e0 2023-09-30T16:50:03.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.390+0000 7f3a81420640 1 -- 172.21.15.52:0/1532013244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780abaf0 con 0x7f3a7c0b05e0 2023-09-30T16:50:03.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/1532013244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c0b05e0 msgr2=0x7f3a7c06c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- 172.21.15.52:0/1532013244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c0b05e0 0x7f3a7c06c600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c071270 tx=0x7f3a7801c440 comp rx=0 tx=0).stop 2023-09-30T16:50:03.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/1532013244 shutdown_connections 2023-09-30T16:50:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- 172.21.15.52:0/1532013244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c06cb40 0x7f3a7c0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- 172.21.15.52:0/1532013244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c0b05e0 0x7f3a7c06c600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- 172.21.15.52:0/1532013244 >> v2:172.21.15.186:3300/0 conn(0x7f3a7c158ff0 0x7f3a7c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/1532013244 >> 172.21.15.52:0/1532013244 conn(0x7f3a7c06a5f0 msgr2=0x7f3a7c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/1532013244 shutdown_connections 2023-09-30T16:50:03.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/1532013244 wait complete. 2023-09-30T16:50:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 Processor -- start 2023-09-30T16:50:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- start start 2023-09-30T16:50:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a7c06cb40 0x7f3a7c14c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c0b05e0 0x7f3a7c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 0x7f3a7c0c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c4290 con 0x7f3a7c158ff0 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0ae450 con 0x7f3a7c06cb40 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0ae730 con 0x7f3a7c0b05e0 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 0x7f3a7c0c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 0x7f3a7c0c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38754/0 (socket says 172.21.15.52:38754) 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 -- 172.21.15.52:0/2804712700 learned_addr learned my addr 172.21.15.52:0/2804712700 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a81c21640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c0b05e0 0x7f3a7c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 -- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c0b05e0 msgr2=0x7f3a7c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82422640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a7c06cb40 0x7f3a7c14c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c0b05e0 0x7f3a7c151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 -- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a7c06cb40 msgr2=0x7f3a7c14c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a7c06cb40 0x7f3a7c14c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 -- 172.21.15.52:0/2804712700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780094d0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a81c21640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c0b05e0 0x7f3a7c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a82c23640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 0x7f3a7c0c1ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a74007d20 tx=0x7f3a7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74014420 con 0x7f3a7c158ff0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a740145a0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74014950 con 0x7f3a7c158ff0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c0aea10 con 0x7f3a7c158ff0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.394+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c0aefd0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.398+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c0af1c0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.398+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f3a74014ab0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.398+0000 7f3a72ffd640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3a60066160 0x7f3a60068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.398+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3a74084380 con 0x7f3a7c158ff0 2023-09-30T16:50:03.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.398+0000 7f3a82422640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3a60066160 0x7f3a60068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.398+0000 7f3a82422640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3a60066160 0x7f3a60068620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c006fd0 tx=0x7f3a6c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.402+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f3a74051980 con 0x7f3a7c158ff0 2023-09-30T16:50:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.562+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a7c0740a0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.562+0000 7f3a72ffd640 1 -- 172.21.15.52:0/2804712700 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16570 (secure 0 0 0) 0x7f3a74054fa0 con 0x7f3a7c158ff0 2023-09-30T16:50:03.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:03.566 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:59.618635+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3a60066160 msgr2=0x7f3a60068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3a60066160 0x7f3a60068620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c006fd0 tx=0x7f3a6c008040 comp rx=0 tx=0).stop 2023-09-30T16:50:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 msgr2=0x7f3a7c0c1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 0x7f3a7c0c1ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a74007d20 tx=0x7f3a7400e4b0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 shutdown_connections 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f3a60066160 0x7f3a60068620 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c158ff0 0x7f3a7c0c1ef0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a7c0b05e0 0x7f3a7c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 --2- 172.21.15.52:0/2804712700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a7c06cb40 0x7f3a7c14c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 >> 172.21.15.52:0/2804712700 conn(0x7f3a7c06a5f0 msgr2=0x7f3a7c14f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 shutdown_connections 2023-09-30T16:50:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.566+0000 7f3a84686640 1 -- 172.21.15.52:0/2804712700 wait complete. 2023-09-30T16:50:03.586 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T16:50:03.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:50:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.710+0000 7fe9a43ba640 1 Processor -- start 2023-09-30T16:50:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.710+0000 7fe9a43ba640 1 -- start start 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a43ba640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe99c15ce10 0x7fe99c0b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a43ba640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe99c0cd870 0x7fe99c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a43ba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c0d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a43ba640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c0b7570 con 0x7fe99c15ce10 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a43ba640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c0b7850 con 0x7fe99c0cd870 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a43ba640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0b7b30 con 0x7fe99c0d0fa0 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe99c15ce10 0x7fe99c0b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe99c15ce10 0x7fe99c0b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38756/0 (socket says 172.21.15.52:38756) 2023-09-30T16:50:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 -- 172.21.15.52:0/3290866023 learned_addr learned my addr 172.21.15.52:0/3290866023 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2957640 1 --2- 172.21.15.52:0/3290866023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c0d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a1955640 1 --2- 172.21.15.52:0/3290866023 >> v2:172.21.15.186:3300/0 conn(0x7fe99c0cd870 0x7fe99c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 -- 172.21.15.52:0/3290866023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 msgr2=0x7fe99c0d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 --2- 172.21.15.52:0/3290866023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c0d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 -- 172.21.15.52:0/3290866023 >> v2:172.21.15.186:3300/0 conn(0x7fe99c0cd870 msgr2=0x7fe99c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 --2- 172.21.15.52:0/3290866023 >> v2:172.21.15.186:3300/0 conn(0x7fe99c0cd870 0x7fe99c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 -- 172.21.15.52:0/3290866023 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0b7e10 con 0x7fe99c15ce10 2023-09-30T16:50:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a1955640 1 --2- 172.21.15.52:0/3290866023 >> v2:172.21.15.186:3300/0 conn(0x7fe99c0cd870 0x7fe99c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.714+0000 7fe9a2156640 1 --2- 172.21.15.52:0/3290866023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c15ce10 0x7fe99c0b8800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0c64f0 tx=0x7fe99801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b1f7a1ad2bef4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a1154640 1 -- 172.21.15.52:0/3290866023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980ab610 con 0x7fe99c15ce10 2023-09-30T16:50:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a1154640 1 -- 172.21.15.52:0/3290866023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9980ab770 con 0x7fe99c15ce10 2023-09-30T16:50:03.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a1154640 1 -- 172.21.15.52:0/3290866023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980abb00 con 0x7fe99c15ce10 2023-09-30T16:50:03.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- 172.21.15.52:0/3290866023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c15ce10 msgr2=0x7fe99c0b8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/3290866023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c15ce10 0x7fe99c0b8800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0c64f0 tx=0x7fe99801c470 comp rx=0 tx=0).stop 2023-09-30T16:50:03.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- 172.21.15.52:0/3290866023 shutdown_connections 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/3290866023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c0d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/3290866023 >> v2:172.21.15.186:3300/0 conn(0x7fe99c0cd870 0x7fe99c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/3290866023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c15ce10 0x7fe99c0b8800 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- 172.21.15.52:0/3290866023 >> 172.21.15.52:0/3290866023 conn(0x7fe99c071930 msgr2=0x7fe99c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- 172.21.15.52:0/3290866023 shutdown_connections 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- 172.21.15.52:0/3290866023 wait complete. 2023-09-30T16:50:03.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 Processor -- start 2023-09-30T16:50:03.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- start start 2023-09-30T16:50:03.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 0x7fe99c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe99c14e750 0x7fe99c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1583e0 con 0x7fe99c0cd870 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c14da60 con 0x7fe99c14e750 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a43ba640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c14dd40 con 0x7fe99c0d0fa0 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 0x7fe99c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 0x7fe99c14c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38768/0 (socket says 172.21.15.52:38768) 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 -- 172.21.15.52:0/639830047 learned_addr learned my addr 172.21.15.52:0/639830047 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a1955640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2957640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe99c14e750 0x7fe99c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 -- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 msgr2=0x7fe99c14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 -- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe99c14e750 msgr2=0x7fe99c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe99c14e750 0x7fe99c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 -- 172.21.15.52:0/639830047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980094d0 con 0x7fe99c0cd870 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a1955640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe9a2156640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 0x7fe99c14c9b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe998000c10 tx=0x7fe99801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980b4800 con 0x7fe99c0cd870 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.718+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9980b4980 con 0x7fe99c0cd870 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c14e020 con 0x7fe99c0cd870 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980b4d30 con 0x7fe99c0cd870 2023-09-30T16:50:03.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c14cef0 con 0x7fe99c0cd870 2023-09-30T16:50:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c0740a0 con 0x7fe99c0cd870 2023-09-30T16:50:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe9980c7390 con 0x7fe99c0cd870 2023-09-30T16:50:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe98effd640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe980066160 0x7fe980068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe99811e700 con 0x7fe99c0cd870 2023-09-30T16:50:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe9a1955640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe980066160 0x7fe980068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.722+0000 7fe9a1955640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe980066160 0x7fe980068620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe99c1f8a80 tx=0x7fe990008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.726+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe9980ebc70 con 0x7fe99c0cd870 2023-09-30T16:50:03.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe99c14de80 con 0x7fe99c0cd870 2023-09-30T16:50:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe98effd640 1 -- 172.21.15.52:0/639830047 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fe99c14de80 con 0x7fe99c0cd870 2023-09-30T16:50:03.915 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:03.916 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:50:03.916 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe980066160 msgr2=0x7fe980068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe980066160 0x7fe980068620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe99c1f8a80 tx=0x7fe990008040 comp rx=0 tx=0).stop 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 msgr2=0x7fe99c14c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 0x7fe99c14c9b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe998000c10 tx=0x7fe99801acb0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 shutdown_connections 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe980066160 0x7fe980068620 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe99c14e750 0x7fe99c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe99c0d0fa0 0x7fe99c14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 --2- 172.21.15.52:0/639830047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe99c0cd870 0x7fe99c14c9b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 >> 172.21.15.52:0/639830047 conn(0x7fe99c071930 msgr2=0x7fe99c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:03.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 shutdown_connections 2023-09-30T16:50:03.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:03.914+0000 7fe9a43ba640 1 -- 172.21.15.52:0/639830047 wait complete. 2023-09-30T16:50:03.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:50:04.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 Processor -- start 2023-09-30T16:50:04.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 -- start start 2023-09-30T16:50:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 0x7fb1800b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb1800b19b0 0x7fb1800b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18006c240 con 0x7fb18015a9d0 2023-09-30T16:50:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18015adb0 con 0x7fb1800b19b0 2023-09-30T16:50:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb186cdb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18015ea90 con 0x7fb18015e4b0 2023-09-30T16:50:04.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 0x7fb1800b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb184a77640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fb18015a9d0 0x7fb18006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39688/0 (socket says 172.21.15.52:39688) 2023-09-30T16:50:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 0x7fb1800b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:34976/0 (socket says 172.21.15.52:34976) 2023-09-30T16:50:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb184a77640 1 -- 172.21.15.52:0/1640013727 learned_addr learned my addr 172.21.15.52:0/1640013727 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.042+0000 7fb185278640 1 --2- 172.21.15.52:0/1640013727 >> v2:172.21.15.186:3300/0 conn(0x7fb1800b19b0 0x7fb1800b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17ffff640 1 -- 172.21.15.52:0/1640013727 >> v2:172.21.15.186:3300/0 conn(0x7fb1800b19b0 msgr2=0x7fb1800b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:04.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17ffff640 1 --2- 172.21.15.52:0/1640013727 >> v2:172.21.15.186:3300/0 conn(0x7fb1800b19b0 0x7fb1800b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17ffff640 1 -- 172.21.15.52:0/1640013727 >> v1:172.21.15.186:6789/0 conn(0x7fb18015a9d0 legacy=0x7fb18006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17ffff640 1 -- 172.21.15.52:0/1640013727 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18015ed70 con 0x7fb18015e4b0 2023-09-30T16:50:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17ffff640 1 --2- 172.21.15.52:0/1640013727 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 0x7fb1800b1470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb168009d90 tx=0x7fb16801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=278ede528b112739 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17f7fe640 1 -- 172.21.15.52:0/1640013727 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680a5810 con 0x7fb18015e4b0 2023-09-30T16:50:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17f7fe640 1 -- 172.21.15.52:0/1640013727 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1680a5970 con 0x7fb18015e4b0 2023-09-30T16:50:04.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb17f7fe640 1 -- 172.21.15.52:0/1640013727 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680a5d00 con 0x7fb18015e4b0 2023-09-30T16:50:04.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 -- 172.21.15.52:0/1640013727 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 msgr2=0x7fb1800b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 --2- 172.21.15.52:0/1640013727 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 0x7fb1800b1470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb168009d90 tx=0x7fb16801c950 comp rx=0 tx=0).stop 2023-09-30T16:50:04.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 -- 172.21.15.52:0/1640013727 shutdown_connections 2023-09-30T16:50:04.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 --2- 172.21.15.52:0/1640013727 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb18015e4b0 0x7fb1800b1470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 --2- 172.21.15.52:0/1640013727 >> v2:172.21.15.186:3300/0 conn(0x7fb1800b19b0 0x7fb1800b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 -- 172.21.15.52:0/1640013727 >> 172.21.15.52:0/1640013727 conn(0x7fb18006a5f0 msgr2=0x7fb1800ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:04.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 -- 172.21.15.52:0/1640013727 shutdown_connections 2023-09-30T16:50:04.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.046+0000 7fb186cdb640 1 -- 172.21.15.52:0/1640013727 wait complete. 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 Processor -- start 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- start start 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1800b19b0 0x7fb180159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb18015a9d0 0x7fb1801487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 0x7fb180148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801f7760 con 0x7fb18015e4b0 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801f7a40 con 0x7fb18015a9d0 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801f7d20 con 0x7fb1800b19b0 2023-09-30T16:50:04.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 0x7fb180148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 0x7fb180148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38772/0 (socket says 172.21.15.52:38772) 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 -- 172.21.15.52:0/33581820 learned_addr learned my addr 172.21.15.52:0/33581820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb184a77640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1800b19b0 0x7fb180159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb17ffff640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb18015a9d0 0x7fb1801487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 -- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1800b19b0 msgr2=0x7fb180159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1800b19b0 0x7fb180159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 -- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb18015a9d0 msgr2=0x7fb1801487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb18015a9d0 0x7fb1801487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 -- 172.21.15.52:0/33581820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168009a70 con 0x7fb18015e4b0 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb17ffff640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb18015a9d0 0x7fb1801487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb185278640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 0x7fb180148d30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb17000e850 tx=0x7fb17000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170009650 con 0x7fb18015e4b0 2023-09-30T16:50:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17000c940 con 0x7fb18015e4b0 2023-09-30T16:50:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1801f8000 con 0x7fb18015e4b0 2023-09-30T16:50:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17000ccd0 con 0x7fb18015e4b0 2023-09-30T16:50:04.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1801f85c0 con 0x7fb18015e4b0 2023-09-30T16:50:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800740a0 con 0x7fb18015e4b0 2023-09-30T16:50:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.050+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb170013470 con 0x7fb18015e4b0 2023-09-30T16:50:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.054+0000 7fb17d7fa640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb160066160 0x7fb160068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.054+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb170083c10 con 0x7fb18015e4b0 2023-09-30T16:50:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.054+0000 7fb184a77640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb160066160 0x7fb160068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.054+0000 7fb184a77640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb160066160 0x7fb160068620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb178005890 tx=0x7fb178009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.058+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb1700512c0 con 0x7fb18015e4b0 2023-09-30T16:50:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.246+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1800cede0 con 0x7fb18015e4b0 2023-09-30T16:50:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb17d7fa640 1 -- 172.21.15.52:0/33581820 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb1700548e0 con 0x7fb18015e4b0 2023-09-30T16:50:04.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:04.251 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3673302426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":3673302426},{"type":"v1","addr":"172.21.15.186:6837","nonce":3673302426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3354516342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3354516342},{"type":"v1","addr":"172.21.15.52:6833","nonce":3354516342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1812556164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1812556164},{"type":"v1","addr":"172.21.15.52:6835","nonce":1812556164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:49:09.938337+0000","modified":"2023-09-30T16:49:13.002923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/2416621285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2416621285},{"type":"v1","addr":"172.21.15.186:6835","nonce":2416621285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T16:50:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-09-30T16:50:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb160066160 msgr2=0x7fb160068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb160066160 0x7fb160068620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb178005890 tx=0x7fb178009040 comp rx=0 tx=0).stop 2023-09-30T16:50:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 msgr2=0x7fb180148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 0x7fb180148d30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb17000e850 tx=0x7fb17000ed10 comp rx=0 tx=0).stop 2023-09-30T16:50:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 shutdown_connections 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb160066160 0x7fb160068620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb18015e4b0 0x7fb180148d30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb18015a9d0 0x7fb1801487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 --2- 172.21.15.52:0/33581820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1800b19b0 0x7fb180159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 >> 172.21.15.52:0/33581820 conn(0x7fb18006a5f0 msgr2=0x7fb18015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 shutdown_connections 2023-09-30T16:50:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.250+0000 7fb186cdb640 1 -- 172.21.15.52:0/33581820 wait complete. 2023-09-30T16:50:04.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:04.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.390+0000 7f8f8ddde640 1 Processor -- start 2023-09-30T16:50:04.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.390+0000 7f8f8ddde640 1 -- start start 2023-09-30T16:50:04.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f8ddde640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8f880cdf80 0x7f8f880b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f8ddde640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880b7330 con 0x7f8f8815ce10 2023-09-30T16:50:04.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f8ddde640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880b7570 con 0x7f8f880d1fb0 2023-09-30T16:50:04.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f8ddde640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880b7850 con 0x7f8f880cdf80 2023-09-30T16:50:04.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f877fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8f8815ce10 0x7f8f880cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56956/0 (socket says 172.21.15.52:56956) 2023-09-30T16:50:04.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f877fe640 1 -- 172.21.15.52:0/3998383508 learned_addr learned my addr 172.21.15.52:0/3998383508 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:04.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 --2- 172.21.15.52:0/3998383508 >> v2:172.21.15.186:3300/0 conn(0x7f8f880cdf80 0x7f8f880b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628061302 0 0) 0x7f8f78001120 con 0x7f8f8815ce10 2023-09-30T16:50:04.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f70003530 con 0x7f8f8815ce10 2023-09-30T16:50:04.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537763597 0 0) 0x7f8f70003530 con 0x7f8f8815ce10 2023-09-30T16:50:04.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 >> v2:172.21.15.186:3300/0 conn(0x7f8f880cdf80 msgr2=0x7f8f880b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:04.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 --2- 172.21.15.52:0/3998383508 >> v2:172.21.15.186:3300/0 conn(0x7f8f880cdf80 0x7f8f880b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 >> v1:172.21.15.186:6789/0 conn(0x7f8f880d1fb0 legacy=0x7f8f880b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880b7b30 con 0x7f8f8815ce10 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f8f78001810 con 0x7f8f8815ce10 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 >> v1:172.21.15.52:6789/0 conn(0x7f8f8815ce10 legacy=0x7f8f880cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f700039f0 0x7f8f70003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f700047d0 0x7f8f70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880b7850 con 0x7f8f70005200 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7000c160 con 0x7f8f700047d0 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7000c320 con 0x7f8f700039f0 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f877fe640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f700039f0 0x7f8f70003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f86ffd640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f700047d0 0x7f8f70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 -- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f700039f0 msgr2=0x7f8f70003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:04.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f700039f0 0x7f8f70003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 -- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f700047d0 msgr2=0x7f8f70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:04.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f700047d0 0x7f8f70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 -- 172.21.15.52:0/3998383508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70003530 con 0x7f8f70005200 2023-09-30T16:50:04.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f877fe640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f700039f0 0x7f8f70003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:04.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 -- 172.21.15.52:0/3998383508 reap_dead start 2023-09-30T16:50:04.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.394+0000 7f8f87fff640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f7000b990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009ae0 tx=0x7f8f8001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0bc311603b25a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004020 con 0x7f8f70005200 2023-09-30T16:50:04.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f800041c0 con 0x7f8f70005200 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f867fc640 1 -- 172.21.15.52:0/3998383508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80003620 con 0x7f8f70005200 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3998383508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 msgr2=0x7f8f7000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f7000b990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009ae0 tx=0x7f8f8001c9d0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3998383508 shutdown_connections 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3998383508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f7000b990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3998383508 >> 172.21.15.52:0/3998383508 conn(0x7f8f88071930 msgr2=0x7f8f88071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3998383508 shutdown_connections 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3998383508 wait complete. 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 Processor -- start 2023-09-30T16:50:04.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- start start 2023-09-30T16:50:04.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f880cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f8815b960 0x7f8f8815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f881f1e50 0x7f8f880b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815fde0 con 0x7f8f70005200 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815bdf0 con 0x7f8f881f1e50 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880cb3f0 con 0x7f8f8815b960 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f880cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f880cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38784/0 (socket says 172.21.15.52:38784) 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 -- 172.21.15.52:0/3242675989 learned_addr learned my addr 172.21.15.52:0/3242675989 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f87fff640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f881f1e50 0x7f8f880b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f86ffd640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f8815b960 0x7f8f8815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 -- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f8815b960 msgr2=0x7f8f8815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f8815b960 0x7f8f8815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 -- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f881f1e50 msgr2=0x7f8f880b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f881f1e50 0x7f8f880b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 -- 172.21.15.52:0/3242675989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880cb6d0 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f877fe640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f880cbed0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f780115c0 tx=0x7f8f78011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7801a030 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7800f820 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880cb9b0 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800fb90 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.398+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881f2300 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.402+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f880cbbd0 con 0x7f8f70005200 2023-09-30T16:50:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.402+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8f7801d070 con 0x7f8f70005200 2023-09-30T16:50:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.402+0000 7f8f6ffff640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f74066160 0x7f8f74068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.402+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8f7801b070 con 0x7f8f70005200 2023-09-30T16:50:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.402+0000 7f8f86ffd640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f74066160 0x7f8f74068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.402+0000 7f8f86ffd640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f74066160 0x7f8f74068620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f8815b820 tx=0x7f8f7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.406+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f8f78053be0 con 0x7f8f70005200 2023-09-30T16:50:04.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.562+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f880b7330 con 0x7f8f70005200 2023-09-30T16:50:04.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f6ffff640 1 -- 172.21.15.52:0/3242675989 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16570 (secure 0 0 0) 0x7f8f880b7330 con 0x7f8f70005200 2023-09-30T16:50:04.567 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:04.567 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:49:59.618635+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:49:07.642562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T16:49:08.922981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f74066160 msgr2=0x7f8f74068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f74066160 0x7f8f74068620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f8815b820 tx=0x7f8f7c009040 comp rx=0 tx=0).stop 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 msgr2=0x7f8f880cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f880cbed0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f780115c0 tx=0x7f8f78011a80 comp rx=0 tx=0).stop 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 shutdown_connections 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8f74066160 0x7f8f74068620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f881f1e50 0x7f8f880b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8f8815b960 0x7f8f8815ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 --2- 172.21.15.52:0/3242675989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f70005200 0x7f8f880cbed0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 >> 172.21.15.52:0/3242675989 conn(0x7f8f88071930 msgr2=0x7f8f8814fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:04.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 shutdown_connections 2023-09-30T16:50:04.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.566+0000 7f8f8ddde640 1 -- 172.21.15.52:0/3242675989 wait complete. 2023-09-30T16:50:04.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T16:50:04.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 Processor -- start 2023-09-30T16:50:04.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 -- start start 2023-09-30T16:50:04.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f679806ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f679806b120 0x7f67980cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980c3f30 con 0x7f6798164580 2023-09-30T16:50:04.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679806b620 con 0x7f679806b120 2023-09-30T16:50:04.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679fbb3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679806b900 con 0x7f67980b2a20 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f679806ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679e150640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f679806b120 0x7f67980cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f679806ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:35024/0 (socket says 172.21.15.52:35024) 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679e150640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f679806b120 0x7f67980cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:53744/0 (socket says 172.21.15.52:53744) 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d94f640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f6798164580 0x7f67980b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39704/0 (socket says 172.21.15.52:39704) 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 -- 172.21.15.52:0/453036824 learned_addr learned my addr 172.21.15.52:0/453036824 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 -- 172.21.15.52:0/453036824 >> v2:172.21.15.186:3300/0 conn(0x7f679806b120 msgr2=0x7f67980cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:04.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 --2- 172.21.15.52:0/453036824 >> v2:172.21.15.186:3300/0 conn(0x7f679806b120 0x7f67980cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 -- 172.21.15.52:0/453036824 >> v1:172.21.15.186:6789/0 conn(0x7f6798164580 legacy=0x7f67980b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.710+0000 7f679d14e640 1 -- 172.21.15.52:0/453036824 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679806bbe0 con 0x7f67980b2a20 2023-09-30T16:50:04.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679d14e640 1 --2- 172.21.15.52:0/453036824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f679806ca20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6788009870 tx=0x7f678801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae28ae3728eb40bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679c94d640 1 -- 172.21.15.52:0/453036824 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880ac630 con 0x7f67980b2a20 2023-09-30T16:50:04.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679c94d640 1 -- 172.21.15.52:0/453036824 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880ac790 con 0x7f67980b2a20 2023-09-30T16:50:04.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679c94d640 1 -- 172.21.15.52:0/453036824 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880acb20 con 0x7f67980b2a20 2023-09-30T16:50:04.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- 172.21.15.52:0/453036824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 msgr2=0x7f679806ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 --2- 172.21.15.52:0/453036824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f679806ca20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6788009870 tx=0x7f678801c540 comp rx=0 tx=0).stop 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- 172.21.15.52:0/453036824 shutdown_connections 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 --2- 172.21.15.52:0/453036824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f679806ca20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 --2- 172.21.15.52:0/453036824 >> v2:172.21.15.186:3300/0 conn(0x7f679806b120 0x7f67980cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- 172.21.15.52:0/453036824 >> 172.21.15.52:0/453036824 conn(0x7f67980cd310 msgr2=0x7f67980cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- 172.21.15.52:0/453036824 shutdown_connections 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- 172.21.15.52:0/453036824 wait complete. 2023-09-30T16:50:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 Processor -- start 2023-09-30T16:50:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- start start 2023-09-30T16:50:04.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f679806b120 0x7f679815f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f67981fc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 0x7f6798159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679815eea0 con 0x7f6798164580 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67981fd4a0 con 0x7f679806b120 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.714+0000 7f679fbb3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67981fd780 con 0x7f67980b2a20 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 0x7f6798159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 0x7f6798159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38786/0 (socket says 172.21.15.52:38786) 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 -- 172.21.15.52:0/1211796389 learned_addr learned my addr 172.21.15.52:0/1211796389 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679d14e640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f67981fc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679d94f640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f679806b120 0x7f679815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 -- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 msgr2=0x7f67981fc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f67981fc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 -- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f679806b120 msgr2=0x7f679815f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f679806b120 0x7f679815f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 -- 172.21.15.52:0/1211796389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880094d0 con 0x7f6798164580 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679d14e640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f67981fc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679e150640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 0x7f6798159a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f679400e7f0 tx=0x7f679400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794009420 con 0x7f6798164580 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679400c730 con 0x7f6798164580 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679815f140 con 0x7f6798164580 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400cac0 con 0x7f6798164580 2023-09-30T16:50:04.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679815fe80 con 0x7f6798164580 2023-09-30T16:50:04.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6798066750 con 0x7f6798164580 2023-09-30T16:50:04.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f679400cc20 con 0x7f6798164580 2023-09-30T16:50:04.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f678e7fc640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f677c066190 0x7f677c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:04.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6794083a80 con 0x7f6798164580 2023-09-30T16:50:04.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679d94f640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f677c066190 0x7f677c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:04.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.718+0000 7f679d94f640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f677c066190 0x7f677c068650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6790005fd0 tx=0x7f6790005b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:04.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.722+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6794051080 con 0x7f6798164580 2023-09-30T16:50:04.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.910+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f67980740a0 con 0x7f6798164580 2023-09-30T16:50:04.914 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-09-30T16:50:04.914+0000 7f72aebe0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T16:50:04.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.914+0000 7f678e7fc640 1 -- 172.21.15.52:0/1211796389 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f67940546a0 con 0x7f6798164580 2023-09-30T16:50:04.917 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T16:50:04.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f677c066190 msgr2=0x7f677c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f677c066190 0x7f677c068650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6790005fd0 tx=0x7f6790005b80 comp rx=0 tx=0).stop 2023-09-30T16:50:04.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 msgr2=0x7f6798159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:04.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 0x7f6798159a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f679400e7f0 tx=0x7f679400ecb0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 shutdown_connections 2023-09-30T16:50:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f677c066190 0x7f677c068650 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6798164580 0x7f6798159a90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67980b2a20 0x7f67981fc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 --2- 172.21.15.52:0/1211796389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f679806b120 0x7f679815f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 >> 172.21.15.52:0/1211796389 conn(0x7f67980cd310 msgr2=0x7f67980cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 shutdown_connections 2023-09-30T16:50:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:04.918+0000 7f679fbb3640 1 -- 172.21.15.52:0/1211796389 wait complete. 2023-09-30T16:50:04.932 INFO:tasks.ceph.mds.d.smithi186.stderr: -2888> 2023-09-30T16:49:16.543+0000 7fcad8c6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T16:50:04.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T16:50:04.976 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2023-09-30T16:50:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.054+0000 7f23c3da8640 1 Processor -- start 2023-09-30T16:50:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.054+0000 7f23c3da8640 1 -- start start 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c3da8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c3da8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23bc0d0040 0x7f23bc0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c3da8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0d04a0 con 0x7f23bc0d25b0 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c3da8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0d39b0 con 0x7f23bc0d0040 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c3da8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc15d040 con 0x7f23bc15cc60 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23bc0d0040 0x7f23bc0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23bc0d0040 0x7f23bc0d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38790/0 (socket says 172.21.15.52:38790) 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 -- 172.21.15.52:0/774451417 learned_addr learned my addr 172.21.15.52:0/774451417 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1b44640 1 --2- 172.21.15.52:0/774451417 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 -- 172.21.15.52:0/774451417 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 msgr2=0x7f23bc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 --2- 172.21.15.52:0/774451417 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 -- 172.21.15.52:0/774451417 >> v1:172.21.15.186:6789/0 conn(0x7f23bc0d25b0 legacy=0x7f23bc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 -- 172.21.15.52:0/774451417 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0d2da0 con 0x7f23bc0d0040 2023-09-30T16:50:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c1343640 1 --2- 172.21.15.52:0/774451417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc0d2070 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009870 tx=0x7f23ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd789dbc1d982f98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c0b42640 1 -- 172.21.15.52:0/774451417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac0aa5f0 con 0x7f23bc0d0040 2023-09-30T16:50:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.058+0000 7f23c0b42640 1 -- 172.21.15.52:0/774451417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac0aa750 con 0x7f23bc0d0040 2023-09-30T16:50:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c0b42640 1 -- 172.21.15.52:0/774451417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac0aaae0 con 0x7f23bc0d0040 2023-09-30T16:50:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/774451417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 msgr2=0x7f23bc0d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 --2- 172.21.15.52:0/774451417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc0d2070 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009870 tx=0x7f23ac01c4d0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/774451417 shutdown_connections 2023-09-30T16:50:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 --2- 172.21.15.52:0/774451417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc0d2070 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 --2- 172.21.15.52:0/774451417 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/774451417 >> 172.21.15.52:0/774451417 conn(0x7f23bc071930 msgr2=0x7f23bc071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/774451417 shutdown_connections 2023-09-30T16:50:05.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/774451417 wait complete. 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 Processor -- start 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- start start 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23bc0d25b0 0x7f23bc14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc152940 con 0x7f23bc0d0040 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc14b3f0 con 0x7f23bc0d25b0 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc14a790 con 0x7f23bc15cc60 2023-09-30T16:50:05.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc14b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38792/0 (socket says 172.21.15.52:38792) 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 -- 172.21.15.52:0/381066208 learned_addr learned my addr 172.21.15.52:0/381066208 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c2345640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1343640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23bc0d25b0 0x7f23bc14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 -- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 msgr2=0x7f23bc151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 -- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23bc0d25b0 msgr2=0x7f23bc14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23bc0d25b0 0x7f23bc14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 -- 172.21.15.52:0/381066208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0094d0 con 0x7f23bc0d0040 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c1b44640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc14b880 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007e70 tx=0x7f23b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8014420 con 0x7f23bc0d0040 2023-09-30T16:50:05.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8014580 con 0x7f23bc0d0040 2023-09-30T16:50:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8014930 con 0x7f23bc0d0040 2023-09-30T16:50:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc14c180 con 0x7f23bc0d0040 2023-09-30T16:50:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.062+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc14ada0 con 0x7f23bc0d0040 2023-09-30T16:50:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.066+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc073b00 con 0x7f23bc0d0040 2023-09-30T16:50:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.066+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f23b8014a90 con 0x7f23bc0d0040 2023-09-30T16:50:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.066+0000 7f23b27fc640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f23a0066160 0x7f23a0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.066+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f23b80844c0 con 0x7f23bc0d0040 2023-09-30T16:50:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.066+0000 7f23c1343640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f23a0066160 0x7f23a0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.066+0000 7f23c1343640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f23a0066160 0x7f23a0068620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0ae000 tx=0x7f23ac0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.070+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f23b8051960 con 0x7f23bc0d0040 2023-09-30T16:50:05.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.254+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f23bc0740a0 con 0x7f23bc0d0040 2023-09-30T16:50:05.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.918+0000 7f23b27fc640 1 -- 172.21.15.52:0/381066208 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f23b8054f80 con 0x7f23bc0d0040 2023-09-30T16:50:05.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f23a0066160 msgr2=0x7f23a0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:05.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f23a0066160 0x7f23a0068620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0ae000 tx=0x7f23ac0a7000 comp rx=0 tx=0).stop 2023-09-30T16:50:05.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 msgr2=0x7f23bc14b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:05.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc14b880 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007e70 tx=0x7f23b800e4b0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 shutdown_connections 2023-09-30T16:50:05.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f23a0066160 0x7f23a0068620 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23bc15cc60 0x7f23bc151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23bc0d25b0 0x7f23bc14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 --2- 172.21.15.52:0/381066208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23bc0d0040 0x7f23bc14b880 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:05.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 >> 172.21.15.52:0/381066208 conn(0x7f23bc071930 msgr2=0x7f23bc1531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:05.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 shutdown_connections 2023-09-30T16:50:05.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:05.922+0000 7f23c3da8640 1 -- 172.21.15.52:0/381066208 wait complete. 2023-09-30T16:50:05.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T16:50:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 Processor -- start 2023-09-30T16:50:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 -- start start 2023-09-30T16:50:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd81815a8b0 0x7fd81806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd81815e4b0 0x7fd8180b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81806db90 con 0x7fd8180b00a0 2023-09-30T16:50:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81815ea50 con 0x7fd81815a8b0 2023-09-30T16:50:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81e664640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81815ed30 con 0x7fd81815e4b0 2023-09-30T16:50:06.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd817fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd81815a8b0 0x7fd81806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81cc01640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd8180b00a0 0x7fd8180b0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60744/0 (socket says 172.21.15.52:60744) 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd817fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd81815a8b0 0x7fd81806d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43046/0 (socket says 172.21.15.52:43046) 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd81cc01640 1 -- 172.21.15.52:0/653430675 learned_addr learned my addr 172.21.15.52:0/653430675 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd8177fe640 1 --2- 172.21.15.52:0/653430675 >> v2:172.21.15.186:3300/0 conn(0x7fd81815e4b0 0x7fd8180b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd817fff640 1 -- 172.21.15.52:0/653430675 >> v2:172.21.15.186:3300/0 conn(0x7fd81815e4b0 msgr2=0x7fd8180b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd817fff640 1 --2- 172.21.15.52:0/653430675 >> v2:172.21.15.186:3300/0 conn(0x7fd81815e4b0 0x7fd8180b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd817fff640 1 -- 172.21.15.52:0/653430675 >> v1:172.21.15.52:6789/0 conn(0x7fd8180b00a0 legacy=0x7fd8180b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.074+0000 7fd817fff640 1 -- 172.21.15.52:0/653430675 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81815f010 con 0x7fd81815a8b0 2023-09-30T16:50:06.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd817fff640 1 --2- 172.21.15.52:0/653430675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81815a8b0 0x7fd81806d650 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd818071110 tx=0x7fd80801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f684ea7d4680c9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:06.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd816ffd640 1 -- 172.21.15.52:0/653430675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080a59a0 con 0x7fd81815a8b0 2023-09-30T16:50:06.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd816ffd640 1 -- 172.21.15.52:0/653430675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8080a5b00 con 0x7fd81815a8b0 2023-09-30T16:50:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd816ffd640 1 -- 172.21.15.52:0/653430675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080a5e90 con 0x7fd81815a8b0 2023-09-30T16:50:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 -- 172.21.15.52:0/653430675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81815a8b0 msgr2=0x7fd81806d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 --2- 172.21.15.52:0/653430675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81815a8b0 0x7fd81806d650 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd818071110 tx=0x7fd80801c8e0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 -- 172.21.15.52:0/653430675 shutdown_connections 2023-09-30T16:50:06.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 --2- 172.21.15.52:0/653430675 >> v2:172.21.15.186:3300/0 conn(0x7fd81815e4b0 0x7fd8180b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 --2- 172.21.15.52:0/653430675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81815a8b0 0x7fd81806d650 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 -- 172.21.15.52:0/653430675 >> 172.21.15.52:0/653430675 conn(0x7fd81806a5c0 msgr2=0x7fd8180ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:06.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 -- 172.21.15.52:0/653430675 shutdown_connections 2023-09-30T16:50:06.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.078+0000 7fd81e664640 1 -- 172.21.15.52:0/653430675 wait complete. 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 Processor -- start 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- start start 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 0x7fd81814fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd81815a8b0 0x7fd81814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd81815e4b0 0x7fd8180cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180cd540 con 0x7fd8180b00a0 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd818157c00 con 0x7fd81815a8b0 2023-09-30T16:50:06.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8181508b0 con 0x7fd81815e4b0 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 0x7fd81814fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 0x7fd81814fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43058/0 (socket says 172.21.15.52:43058) 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 -- 172.21.15.52:0/819078642 learned_addr learned my addr 172.21.15.52:0/819078642 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81cc01640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd81815e4b0 0x7fd8180cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 -- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd81815e4b0 msgr2=0x7fd8180cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd81815e4b0 0x7fd8180cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 -- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd81815a8b0 msgr2=0x7fd81814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd81815a8b0 0x7fd81814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 -- 172.21.15.52:0/819078642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808009a70 con 0x7fd8180b00a0 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd817fff640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 0x7fd81814fcf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd8080b0040 tx=0x7fd808019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080adea0 con 0x7fd8180b00a0 2023-09-30T16:50:06.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd808009450 con 0x7fd8180b00a0 2023-09-30T16:50:06.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080b9670 con 0x7fd8180b00a0 2023-09-30T16:50:06.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8181502f0 con 0x7fd8180b00a0 2023-09-30T16:50:06.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd818163a70 con 0x7fd8180b00a0 2023-09-30T16:50:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8180740a0 con 0x7fd8180b00a0 2023-09-30T16:50:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd8080b97d0 con 0x7fd8180b00a0 2023-09-30T16:50:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd814ff9640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd804066160 0x7fd804068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd80811f300 con 0x7fd8180b00a0 2023-09-30T16:50:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.082+0000 7fd8177fe640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd804066160 0x7fd804068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:06.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.086+0000 7fd8177fe640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd804066160 0x7fd804068620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd81814e520 tx=0x7fd80c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.086+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd8080eca00 con 0x7fd8180b00a0 2023-09-30T16:50:06.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.238+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8180cf0b0 con 0x7fd8180b00a0 2023-09-30T16:50:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.930+0000 7fd814ff9640 1 -- 172.21.15.52:0/819078642 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd8080f0020 con 0x7fd8180b00a0 2023-09-30T16:50:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd804066160 msgr2=0x7fd804068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd804066160 0x7fd804068620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd81814e520 tx=0x7fd80c008040 comp rx=0 tx=0).stop 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 msgr2=0x7fd81814fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 0x7fd81814fcf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd8080b0040 tx=0x7fd808019680 comp rx=0 tx=0).stop 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 shutdown_connections 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd804066160 0x7fd804068620 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd81815e4b0 0x7fd8180cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd81815a8b0 0x7fd81814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 --2- 172.21.15.52:0/819078642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8180b00a0 0x7fd81814fcf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:06.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 >> 172.21.15.52:0/819078642 conn(0x7fd81806a5c0 msgr2=0x7fd81815b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:06.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 shutdown_connections 2023-09-30T16:50:06.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:06.934+0000 7fd81e664640 1 -- 172.21.15.52:0/819078642 wait complete. 2023-09-30T16:50:06.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T16:50:07.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 Processor -- start 2023-09-30T16:50:07.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 -- start start 2023-09-30T16:50:07.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c815a8b0 0x7f85c806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:07.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85c80b00a0 0x7f85c80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:07.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c806db90 con 0x7f85c815e4b0 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c80b1b80 con 0x7f85c80b00a0 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cf671640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80b0a50 con 0x7f85c815a8b0 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85c80b00a0 0x7f85c80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f85c80b00a0 0x7f85c80b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43068/0 (socket says 172.21.15.52:43068) 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 -- 172.21.15.52:0/2250203393 learned_addr learned my addr 172.21.15.52:0/2250203393 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cd40d640 1 --2- 172.21.15.52:0/2250203393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c815a8b0 0x7f85c806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 -- 172.21.15.52:0/2250203393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c815a8b0 msgr2=0x7f85c806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 --2- 172.21.15.52:0/2250203393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c815a8b0 0x7f85c806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 -- 172.21.15.52:0/2250203393 >> v1:172.21.15.186:6789/0 conn(0x7f85c815e4b0 legacy=0x7f85c80b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:07.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.086+0000 7f85cdc0e640 1 -- 172.21.15.52:0/2250203393 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c815ea50 con 0x7f85c80b00a0 2023-09-30T16:50:07.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cdc0e640 1 --2- 172.21.15.52:0/2250203393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c80b00a0 0x7f85c80b0510 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009e80 tx=0x7f85c001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8188c0f46c73502 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:07.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85bffff640 1 -- 172.21.15.52:0/2250203393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00a5880 con 0x7f85c80b00a0 2023-09-30T16:50:07.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85bffff640 1 -- 172.21.15.52:0/2250203393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00a59e0 con 0x7f85c80b00a0 2023-09-30T16:50:07.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85bffff640 1 -- 172.21.15.52:0/2250203393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00a5d70 con 0x7f85c80b00a0 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- 172.21.15.52:0/2250203393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c80b00a0 msgr2=0x7f85c80b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 --2- 172.21.15.52:0/2250203393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c80b00a0 0x7f85c80b0510 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009e80 tx=0x7f85c001c9c0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- 172.21.15.52:0/2250203393 shutdown_connections 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 --2- 172.21.15.52:0/2250203393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c80b00a0 0x7f85c80b0510 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 --2- 172.21.15.52:0/2250203393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c815a8b0 0x7f85c806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- 172.21.15.52:0/2250203393 >> 172.21.15.52:0/2250203393 conn(0x7f85c806a5c0 msgr2=0x7f85c80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- 172.21.15.52:0/2250203393 shutdown_connections 2023-09-30T16:50:07.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- 172.21.15.52:0/2250203393 wait complete. 2023-09-30T16:50:07.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 Processor -- start 2023-09-30T16:50:07.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- start start 2023-09-30T16:50:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c80b00a0 0x7f85c80c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85c815a8b0 0x7f85c80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 0x7f85c8146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:07.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8146a60 con 0x7f85c815e4b0 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80c8410 con 0x7f85c815a8b0 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cf671640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80c86f0 con 0x7f85c80b00a0 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cdc0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 0x7f85c8146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cdc0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 0x7f85c8146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43074/0 (socket says 172.21.15.52:43074) 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.090+0000 7f85cdc0e640 1 -- 172.21.15.52:0/1399864204 learned_addr learned my addr 172.21.15.52:0/1399864204 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cd40d640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c80b00a0 0x7f85c80c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85ccc0c640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85c815a8b0 0x7f85c80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cdc0e640 1 -- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c80b00a0 msgr2=0x7f85c80c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cdc0e640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c80b00a0 0x7f85c80c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cdc0e640 1 -- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85c815a8b0 msgr2=0x7f85c80c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cdc0e640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85c815a8b0 0x7f85c80c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cdc0e640 1 -- 172.21.15.52:0/1399864204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009b30 con 0x7f85c815e4b0 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85ccc0c640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85c815a8b0 0x7f85c80c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cdc0e640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 0x7f85c8146150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f85c00af040 tx=0x7f85c0019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00b8670 con 0x7f85c815e4b0 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00b87f0 con 0x7f85c815e4b0 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c80c89d0 con 0x7f85c815e4b0 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00b8ba0 con 0x7f85c815e4b0 2023-09-30T16:50:07.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c80c5d90 con 0x7f85c815e4b0 2023-09-30T16:50:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8146ef0 con 0x7f85c815e4b0 2023-09-30T16:50:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f85c00b8d00 con 0x7f85c815e4b0 2023-09-30T16:50:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85bdffb640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85ac066190 0x7f85ac068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f85c011ee20 con 0x7f85c815e4b0 2023-09-30T16:50:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cd40d640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85ac066190 0x7f85ac068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:07.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.094+0000 7f85cd40d640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85ac066190 0x7f85ac068650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f85c40096f0 tx=0x7f85c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:07.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.098+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f85c00ec610 con 0x7f85c815e4b0 2023-09-30T16:50:07.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.254+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85c806c090 con 0x7f85c815e4b0 2023-09-30T16:50:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.934+0000 7f85bdffb640 1 -- 172.21.15.52:0/1399864204 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f85c00efc30 con 0x7f85c815e4b0 2023-09-30T16:50:07.936 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-09-30T16:50:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85ac066190 msgr2=0x7f85ac068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85ac066190 0x7f85ac068650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f85c40096f0 tx=0x7f85c4008040 comp rx=0 tx=0).stop 2023-09-30T16:50:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 msgr2=0x7f85c8146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:07.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 0x7f85c8146150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f85c00af040 tx=0x7f85c0019760 comp rx=0 tx=0).stop 2023-09-30T16:50:07.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 shutdown_connections 2023-09-30T16:50:07.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f85ac066190 0x7f85ac068650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85c815e4b0 0x7f85c8146150 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85c815a8b0 0x7f85c80c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 --2- 172.21.15.52:0/1399864204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f85c80b00a0 0x7f85c80c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:07.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 >> 172.21.15.52:0/1399864204 conn(0x7f85c806a5c0 msgr2=0x7f85c80ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:07.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 shutdown_connections 2023-09-30T16:50:07.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:07.938+0000 7f85cf671640 1 -- 172.21.15.52:0/1399864204 wait complete. 2023-09-30T16:50:07.970 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T16:50:07.970 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T16:50:07.970 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T16:50:07.970 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:50:07.970 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T16:50:07.970 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T16:50:07.971 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T16:50:07.971 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:50:07.971 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T16:50:07.971 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T16:50:07.971 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T16:50:07.971 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:50:07.971 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T16:50:07.972 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T16:50:07.972 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T16:50:07.972 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T16:50:07.983 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T16:50:07.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T16:50:07.985 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T16:50:07.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T16:50:07.988 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T16:50:07.988 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T16:50:07.992 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T16:50:07.992 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T16:50:08.027 INFO:tasks.ceph.mds.a:Started 2023-09-30T16:50:08.028 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:08.029 INFO:tasks.ceph.mds.c:Started 2023-09-30T16:50:08.029 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:08.035 INFO:tasks.ceph.mds.d:Started 2023-09-30T16:50:08.035 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:08.036 INFO:tasks.ceph.mds.b:Started 2023-09-30T16:50:08.036 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:08.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T16:50:08.097 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2023-09-30T16:50:08.099 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2023-09-30T16:50:08.105 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-09-30T16:50:08.111 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-09-30T16:50:08.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 Processor -- start 2023-09-30T16:50:08.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 -- start start 2023-09-30T16:50:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a415a9e0 0x7f67a4070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f67a40b63e0 0x7f67a40b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a40ce770 con 0x7f67a40b2310 2023-09-30T16:50:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a40cea10 con 0x7f67a40b63e0 2023-09-30T16:50:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a90e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40cecf0 con 0x7f67a415a9e0 2023-09-30T16:50:08.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a359e640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f67a40b2310 0x7f67a40cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:38990/0 (socket says 172.21.15.52:38990) 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a359e640 1 -- 172.21.15.52:0/72889544 learned_addr learned my addr 172.21.15.52:0/72889544 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a2d9d640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a415a9e0 0x7f67a4070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a259c640 1 --2- 172.21.15.52:0/72889544 >> v2:172.21.15.186:3300/0 conn(0x7f67a40b63e0 0x7f67a40b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a1d9b640 1 -- 172.21.15.52:0/72889544 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029597663 0 0) 0x7f67a40ce770 con 0x7f67a40b2310 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.178+0000 7f67a1d9b640 1 -- 172.21.15.52:0/72889544 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f678c003530 con 0x7f67a40b2310 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a259c640 1 -- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a415a9e0 msgr2=0x7f67a4070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a259c640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a415a9e0 0x7f67a4070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a259c640 1 -- 172.21.15.52:0/72889544 >> v1:172.21.15.186:6789/0 conn(0x7f67a40b2310 legacy=0x7f67a40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a259c640 1 -- 172.21.15.52:0/72889544 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a40cefd0 con 0x7f67a40b63e0 2023-09-30T16:50:08.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a2d9d640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a415a9e0 0x7f67a4070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:50:08.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a259c640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a40b63e0 0x7f67a40b37e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f67980097c0 tx=0x7f679801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fafac9a361b0c757 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:08.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a1d9b640 1 -- 172.21.15.52:0/72889544 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980ab600 con 0x7f67a40b63e0 2023-09-30T16:50:08.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a1d9b640 1 -- 172.21.15.52:0/72889544 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67980a7050 con 0x7f67a40b63e0 2023-09-30T16:50:08.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a1d9b640 1 -- 172.21.15.52:0/72889544 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980ab960 con 0x7f67a40b63e0 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 -- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a40b63e0 msgr2=0x7f67a40b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a40b63e0 0x7f67a40b37e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f67980097c0 tx=0x7f679801c3c0 comp rx=0 tx=0).stop 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 -- 172.21.15.52:0/72889544 shutdown_connections 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a40b63e0 0x7f67a40b37e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 --2- 172.21.15.52:0/72889544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a415a9e0 0x7f67a4070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 -- 172.21.15.52:0/72889544 >> 172.21.15.52:0/72889544 conn(0x7f67a40cd310 msgr2=0x7f67a40cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 -- 172.21.15.52:0/72889544 shutdown_connections 2023-09-30T16:50:08.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.182+0000 7f67a90e1640 1 -- 172.21.15.52:0/72889544 wait complete. 2023-09-30T16:50:08.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 Processor -- start 2023-09-30T16:50:08.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- start start 2023-09-30T16:50:08.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 0x7f67a41628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a40b63e0 0x7f67a415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a415a9e0 0x7f67a415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41f9e30 con 0x7f67a40b2310 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41f92b0 con 0x7f67a415a9e0 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41f9590 con 0x7f67a40b63e0 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 0x7f67a41628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 0x7f67a41628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43114/0 (socket says 172.21.15.52:43114) 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 -- 172.21.15.52:0/3962401794 learned_addr learned my addr 172.21.15.52:0/3962401794 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a259c640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a40b63e0 0x7f67a415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:08.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a359e640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a415a9e0 0x7f67a415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 -- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a40b63e0 msgr2=0x7f67a415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a40b63e0 0x7f67a415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 -- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a415a9e0 msgr2=0x7f67a415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a415a9e0 0x7f67a415bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 -- 172.21.15.52:0/3962401794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794009a70 con 0x7f67a40b2310 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a359e640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a415a9e0 0x7f67a415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a2d9d640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 0x7f67a41628d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f679400efc0 tx=0x7f679400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794014680 con 0x7f67a40b2310 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679400f040 con 0x7f67a40b2310 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6798009420 con 0x7f67a40b2310 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794014a00 con 0x7f67a40b2310 2023-09-30T16:50:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a415af40 con 0x7f67a40b2310 2023-09-30T16:50:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4066750 con 0x7f67a40b2310 2023-09-30T16:50:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.186+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f6794014b60 con 0x7f67a40b2310 2023-09-30T16:50:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.190+0000 7f678b7fe640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6790066160 0x7f6790068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.190+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6794084870 con 0x7f67a40b2310 2023-09-30T16:50:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.190+0000 7f67a259c640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6790066160 0x7f6790068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.190+0000 7f67a259c640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6790066160 0x7f6790068620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67980ad000 tx=0x7f67980a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.194+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f67940520f0 con 0x7f67a40b2310 2023-09-30T16:50:08.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:08.362+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f67a40740a0 con 0x7f67a40b2310 2023-09-30T16:50:09.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.422+0000 7f678b7fe640 1 -- 172.21.15.52:0/3962401794 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6794055710 con 0x7f67a40b2310 2023-09-30T16:50:09.425 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-09-30T16:50:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6790066160 msgr2=0x7f6790068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6790066160 0x7f6790068620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67980ad000 tx=0x7f67980a6000 comp rx=0 tx=0).stop 2023-09-30T16:50:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 msgr2=0x7f67a41628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 0x7f67a41628d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f679400efc0 tx=0x7f679400c490 comp rx=0 tx=0).stop 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 shutdown_connections 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6790066160 0x7f6790068620 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67a415a9e0 0x7f67a415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67a40b63e0 0x7f67a415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 --2- 172.21.15.52:0/3962401794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a40b2310 0x7f67a41628d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 >> 172.21.15.52:0/3962401794 conn(0x7f67a40cd310 msgr2=0x7f67a40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 shutdown_connections 2023-09-30T16:50:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.426+0000 7f67a90e1640 1 -- 172.21.15.52:0/3962401794 wait complete. 2023-09-30T16:50:09.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T16:50:09.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f847842b640 1 Processor -- start 2023-09-30T16:50:09.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f847842b640 1 -- start start 2023-09-30T16:50:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f847842b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84701574c0 0x7f84700cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f847842b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700ce2f0 con 0x7f8470159df0 2023-09-30T16:50:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f847842b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700c9dd0 con 0x7f84700ca590 2023-09-30T16:50:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f847842b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847015ae50 con 0x7f84701574c0 2023-09-30T16:50:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84759c6640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8470159df0 0x7f847006bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60766/0 (socket says 172.21.15.52:60766) 2023-09-30T16:50:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84759c6640 1 -- 172.21.15.52:0/1344499792 learned_addr learned my addr 172.21.15.52:0/1344499792 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84761c7640 1 --2- 172.21.15.52:0/1344499792 >> v2:172.21.15.52:3300/0 conn(0x7f84701574c0 0x7f84700cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84751c5640 1 -- 172.21.15.52:0/1344499792 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734056653 0 0) 0x7f84700ce2f0 con 0x7f8470159df0 2023-09-30T16:50:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84751c5640 1 -- 172.21.15.52:0/1344499792 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845c003530 con 0x7f8470159df0 2023-09-30T16:50:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84761c7640 1 -- 172.21.15.52:0/1344499792 >> v1:172.21.15.186:6789/0 conn(0x7f84700ca590 legacy=0x7f8470070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84761c7640 1 -- 172.21.15.52:0/1344499792 >> v1:172.21.15.52:6789/0 conn(0x7f8470159df0 legacy=0x7f847006bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.578+0000 7f84761c7640 1 -- 172.21.15.52:0/1344499792 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847015a5b0 con 0x7f84701574c0 2023-09-30T16:50:09.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f84761c7640 1 --2- 172.21.15.52:0/1344499792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f84700cddb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f846c009d90 tx=0x7f846c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fe78b755573e47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:09.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f84751c5640 1 -- 172.21.15.52:0/1344499792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0a5900 con 0x7f84701574c0 2023-09-30T16:50:09.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f84751c5640 1 -- 172.21.15.52:0/1344499792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c0a5a60 con 0x7f84701574c0 2023-09-30T16:50:09.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f84751c5640 1 -- 172.21.15.52:0/1344499792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0a5df0 con 0x7f84701574c0 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 -- 172.21.15.52:0/1344499792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 msgr2=0x7f84700cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 --2- 172.21.15.52:0/1344499792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f84700cddb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f846c009d90 tx=0x7f846c01c950 comp rx=0 tx=0).stop 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 -- 172.21.15.52:0/1344499792 shutdown_connections 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 --2- 172.21.15.52:0/1344499792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f84700cddb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 -- 172.21.15.52:0/1344499792 >> 172.21.15.52:0/1344499792 conn(0x7f847006a5f0 msgr2=0x7f84700ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 -- 172.21.15.52:0/1344499792 shutdown_connections 2023-09-30T16:50:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 -- 172.21.15.52:0/1344499792 wait complete. 2023-09-30T16:50:09.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 Processor -- start 2023-09-30T16:50:09.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.582+0000 7f847842b640 1 -- start start 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84700ca590 0x7f847014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f847014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8470159df0 0x7f84701511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470150b50 con 0x7f84701574c0 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847014ecc0 con 0x7f8470159df0 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8470150590 con 0x7f84700ca590 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f847014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f847014e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43122/0 (socket says 172.21.15.52:43122) 2023-09-30T16:50:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 -- 172.21.15.52:0/1652939294 learned_addr learned my addr 172.21.15.52:0/1652939294 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84761c7640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84700ca590 0x7f847014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 -- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84700ca590 msgr2=0x7f847014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84700ca590 0x7f847014ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 -- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8470159df0 msgr2=0x7f84701511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84769c8640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8470159df0 0x7f84701511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8470159df0 0x7f84701511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 -- 172.21.15.52:0/1652939294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009a70 con 0x7f84701574c0 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84769c8640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8470159df0 0x7f84701511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84759c6640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f847014e780 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f846400c420 tx=0x7f846400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464005cf0 con 0x7f84701574c0 2023-09-30T16:50:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464005e50 con 0x7f84701574c0 2023-09-30T16:50:09.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847006c4d0 con 0x7f84701574c0 2023-09-30T16:50:09.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640072d0 con 0x7f84701574c0 2023-09-30T16:50:09.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84700c2260 con 0x7f84701574c0 2023-09-30T16:50:09.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84700c20c0 con 0x7f84701574c0 2023-09-30T16:50:09.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8464007430 con 0x7f84701574c0 2023-09-30T16:50:09.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f8462ffd640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8454066160 0x7f8454068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8464082c70 con 0x7f84701574c0 2023-09-30T16:50:09.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.586+0000 7f84761c7640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8454066160 0x7f8454068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.590+0000 7f84761c7640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8454066160 0x7f8454068620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f846c0af000 tx=0x7f846c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:09.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.590+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f84700c20c0 con 0x7f84701574c0 2023-09-30T16:50:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.802+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f84700c20c0 con 0x7f84701574c0 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.802+0000 7f8462ffd640 1 -- 172.21.15.52:0/1652939294 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f84700c20c0 con 0x7f84701574c0 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-09-30T16:50:09.806 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBTURhlXRaoOBAA4OsdcwfzQ6TRgKnkPFw8fg==", 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-09-30T16:50:09.807 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlLSkJCxAAekDf4/3rIF068rsj4bAQBQ==", 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-09-30T16:50:09.808 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlYhQ6BRAAjcxNocgMeO2At3dDSmHoJA==", 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2023-09-30T16:50:09.809 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlYxGUExAAmDxOY0ir/1zk8GkVuTx5RA==", 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-09-30T16:50:09.810 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBVURhliVpuKhAAhqJT0C8OjiFRXJ3WHLdj8g==", 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBYURhlB/2ZMBAAFR0D+2WKjvpnnk8/t91Afg==", 2023-09-30T16:50:09.811 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBbURhlah56OhAA7myUoXVTQuAjLRcVKNv6TA==", 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.812 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBfURhlmapXBxAADalkrnvqRAuZoB7PZofd7g==", 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.813 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBlURhl4S+QCBAASbBYsh8ah+NLx8Y8/r9s/g==", 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.814 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBoURhlmzH0DhAANPlmSxwwPWBPV51OCp2gAA==", 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.815 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBrURhlgHmNFxAAoAo/AtD5BOEigPk0bBy4Tw==", 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBuURhlXwMpIBAANy3nHQkGr5uM5NyhEThJtg==", 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.817 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlmBlVGRAAbcs+tyuczQOq3IgP2hhLGQ==", 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.818 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlnpc1IRAAnHCP3xCaYWs2EbcChdHl7A==", 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.819 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlwX+CHhAA8F7r+ECFV7p57Y5HITGhlw==", 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2023-09-30T16:50:09.820 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBUURhlukCBJhAANMDGVTlYTvMDcJ6dbYgSDg==", 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-09-30T16:50:09.821 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBTURhlaOAwIRAAZ6oGuyw+IHMDUngsifd1Bg==", 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mds", 2023-09-30T16:50:09.822 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB0URhl5ZPvJxAAkCJj9SdY9JfP1kUf2pZnrQ==", 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mds" 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mgr", 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB0URhlKK7vJxAAWGgiMKCi0/McHalVZY4SSw==", 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-30T16:50:09.823 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-osd", 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB0URhlssTvJxAA8bCugx191lwknLG/vGCRbw==", 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-osd" 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd", 2023-09-30T16:50:09.824 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB0URhlm9rvJxAAV2G5z4FuBvI0hCevT6hk4A==", 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB0URhlhvHvJxAAGez6fh50nimsSCHmuAn9hA==", 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-30T16:50:09.825 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rgw", 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQB0URhlwwjwJxAArSsff/WRs2JDwXd1vU6oVQ==", 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.826 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBTURhlCT9mNRAAVG0MiOh7eFxk2dzgAqmK7A==", 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-09-30T16:50:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQBTURhl3LKvMhAAaPbgkLUy0hbxMYBmQzNvLw==", 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-09-30T16:50:09.828 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8454066160 msgr2=0x7f8454068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8454066160 0x7f8454068620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f846c0af000 tx=0x7f846c0a7070 comp rx=0 tx=0).stop 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 msgr2=0x7f847014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f847014e780 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f846400c420 tx=0x7f846400c8e0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 shutdown_connections 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8454066160 0x7f8454068620 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8470159df0 0x7f84701511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84701574c0 0x7f847014e780 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 --2- 172.21.15.52:0/1652939294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84700ca590 0x7f847014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 >> 172.21.15.52:0/1652939294 conn(0x7f847006a5f0 msgr2=0x7f8470156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 shutdown_connections 2023-09-30T16:50:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.806+0000 7f847842b640 1 -- 172.21.15.52:0/1652939294 wait complete. 2023-09-30T16:50:09.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-30T16:50:09.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff3479c7640 1 Processor -- start 2023-09-30T16:50:09.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff3479c7640 1 -- start start 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff3479c7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff34006d730 0x7ff340070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff3479c7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff340070f10 con 0x7ff34015cb50 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff3479c7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff340070670 con 0x7ff340160d30 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff3479c7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff340070950 con 0x7ff34006d730 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff344f62640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff34006d730 0x7ff340070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff345763640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff34015cb50 0x7ff3400c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60778/0 (socket says 172.21.15.52:60778) 2023-09-30T16:50:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff345763640 1 -- 172.21.15.52:0/1987651981 learned_addr learned my addr 172.21.15.52:0/1987651981 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:09.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff344f62640 1 -- 172.21.15.52:0/1987651981 >> v1:172.21.15.186:6789/0 conn(0x7ff340160d30 legacy=0x7ff3400b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:09.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff344f62640 1 -- 172.21.15.52:0/1987651981 >> v1:172.21.15.52:6789/0 conn(0x7ff34015cb50 legacy=0x7ff3400c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.958+0000 7ff344f62640 1 -- 172.21.15.52:0/1987651981 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340070c30 con 0x7ff34006d730 2023-09-30T16:50:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff344f62640 1 --2- 172.21.15.52:0/1987651981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff34006d730 0x7ff340070070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff340071100 tx=0x7ff33c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f541ad21833e88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff337fff640 1 -- 172.21.15.52:0/1987651981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a8930 con 0x7ff34006d730 2023-09-30T16:50:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff337fff640 1 -- 172.21.15.52:0/1987651981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0a8a90 con 0x7ff34006d730 2023-09-30T16:50:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff337fff640 1 -- 172.21.15.52:0/1987651981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a8e20 con 0x7ff34006d730 2023-09-30T16:50:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- 172.21.15.52:0/1987651981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff34006d730 msgr2=0x7ff340070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 --2- 172.21.15.52:0/1987651981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff34006d730 0x7ff340070070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff340071100 tx=0x7ff33c01ec30 comp rx=0 tx=0).stop 2023-09-30T16:50:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- 172.21.15.52:0/1987651981 shutdown_connections 2023-09-30T16:50:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 --2- 172.21.15.52:0/1987651981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff34006d730 0x7ff340070070 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- 172.21.15.52:0/1987651981 >> 172.21.15.52:0/1987651981 conn(0x7ff34006a5c0 msgr2=0x7ff3400ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- 172.21.15.52:0/1987651981 shutdown_connections 2023-09-30T16:50:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- 172.21.15.52:0/1987651981 wait complete. 2023-09-30T16:50:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 Processor -- start 2023-09-30T16:50:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- start start 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff34006d730 0x7ff34015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff34015cb50 0x7ff34015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 0x7ff34015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34015ba20 con 0x7ff340160d30 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34015d7f0 con 0x7ff34015cb50 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff3479c7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34015dad0 con 0x7ff34006d730 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff345f64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 0x7ff34015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff345f64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 0x7ff34015e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43138/0 (socket says 172.21.15.52:43138) 2023-09-30T16:50:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.962+0000 7ff345f64640 1 -- 172.21.15.52:0/2107688915 learned_addr learned my addr 172.21.15.52:0/2107688915 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff344f62640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff34015cb50 0x7ff34015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345763640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff34006d730 0x7ff34015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345f64640 1 -- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff34006d730 msgr2=0x7ff34015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345f64640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff34006d730 0x7ff34015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345f64640 1 -- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff34015cb50 msgr2=0x7ff34015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345f64640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff34015cb50 0x7ff34015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345f64640 1 -- 172.21.15.52:0/2107688915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c009420 con 0x7ff340160d30 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff344f62640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff34015cb50 0x7ff34015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345f64640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 0x7ff34015e890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff33800b990 tx=0x7ff33800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800cba0 con 0x7ff340160d30 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800cd00 con 0x7ff340160d30 2023-09-30T16:50:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338014680 con 0x7ff340160d30 2023-09-30T16:50:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34015ddb0 con 0x7ff340160d30 2023-09-30T16:50:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34015e370 con 0x7ff340160d30 2023-09-30T16:50:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34015e560 con 0x7ff340160d30 2023-09-30T16:50:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff33801d3b0 con 0x7ff340160d30 2023-09-30T16:50:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff335ffb640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff324066160 0x7ff324068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff338083710 con 0x7ff340160d30 2023-09-30T16:50:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.966+0000 7ff345763640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff324066160 0x7ff324068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.970+0000 7ff345763640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff324066160 0x7ff324068620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff330005890 tx=0x7ff330009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:09.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:09.970+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff338051080 con 0x7ff340160d30 2023-09-30T16:50:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.186+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff3400740a0 con 0x7ff340160d30 2023-09-30T16:50:10.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff335ffb640 1 -- 172.21.15.52:0/2107688915 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff3380546a0 con 0x7ff340160d30 2023-09-30T16:50:10.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff324066160 msgr2=0x7ff324068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff324066160 0x7ff324068620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff330005890 tx=0x7ff330009040 comp rx=0 tx=0).stop 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 msgr2=0x7ff34015e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 0x7ff34015e890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff33800b990 tx=0x7ff33800be50 comp rx=0 tx=0).stop 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 shutdown_connections 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff324066160 0x7ff324068620 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff340160d30 0x7ff34015e890 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff34015cb50 0x7ff34015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 --2- 172.21.15.52:0/2107688915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff34006d730 0x7ff34015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 >> 172.21.15.52:0/2107688915 conn(0x7ff34006a5c0 msgr2=0x7ff3400cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 shutdown_connections 2023-09-30T16:50:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.190+0000 7ff3479c7640 1 -- 172.21.15.52:0/2107688915 wait complete. 2023-09-30T16:50:10.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-30T16:50:10.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 Processor -- start 2023-09-30T16:50:10.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 -- start start 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fac6815a8b0 0x7fac6806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac6815e4b0 0x7fac680b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6806db90 con 0x7fac680b00a0 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6815ea50 con 0x7fac6815e4b0 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6cae1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6815ed30 con 0x7fac6815a8b0 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac65d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac6815e4b0 0x7fac680b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac66d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fac680b00a0 0x7fac680b0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60782/0 (socket says 172.21.15.52:60782) 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac66d9d640 1 -- 172.21.15.52:0/2372640071 learned_addr learned my addr 172.21.15.52:0/2372640071 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:10.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6559a640 1 -- 172.21.15.52:0/2372640071 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504803754 0 0) 0x7fac6806db90 con 0x7fac680b00a0 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6559a640 1 -- 172.21.15.52:0/2372640071 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac50003530 con 0x7fac680b00a0 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6659c640 1 --2- 172.21.15.52:0/2372640071 >> v2:172.21.15.186:3300/0 conn(0x7fac6815a8b0 0x7fac6806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac65d9b640 1 -- 172.21.15.52:0/2372640071 >> v2:172.21.15.186:3300/0 conn(0x7fac6815a8b0 msgr2=0x7fac6806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac65d9b640 1 --2- 172.21.15.52:0/2372640071 >> v2:172.21.15.186:3300/0 conn(0x7fac6815a8b0 0x7fac6806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac65d9b640 1 -- 172.21.15.52:0/2372640071 >> v1:172.21.15.52:6789/0 conn(0x7fac680b00a0 legacy=0x7fac680b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac65d9b640 1 -- 172.21.15.52:0/2372640071 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6815f010 con 0x7fac6815e4b0 2023-09-30T16:50:10.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.330+0000 7fac6659c640 1 --2- 172.21.15.52:0/2372640071 >> v2:172.21.15.186:3300/0 conn(0x7fac6815a8b0 0x7fac6806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac65d9b640 1 --2- 172.21.15.52:0/2372640071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac680b1470 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac6806e2e0 tx=0x7fac5c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf99319d66ea924 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6559a640 1 -- 172.21.15.52:0/2372640071 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0a7070 con 0x7fac6815e4b0 2023-09-30T16:50:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6559a640 1 -- 172.21.15.52:0/2372640071 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c0ab430 con 0x7fac6815e4b0 2023-09-30T16:50:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6559a640 1 -- 172.21.15.52:0/2372640071 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0ab7c0 con 0x7fac6815e4b0 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 -- 172.21.15.52:0/2372640071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 msgr2=0x7fac680b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 --2- 172.21.15.52:0/2372640071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac680b1470 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac6806e2e0 tx=0x7fac5c01c430 comp rx=0 tx=0).stop 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 -- 172.21.15.52:0/2372640071 shutdown_connections 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 --2- 172.21.15.52:0/2372640071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac680b1470 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 --2- 172.21.15.52:0/2372640071 >> v2:172.21.15.186:3300/0 conn(0x7fac6815a8b0 0x7fac6806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 -- 172.21.15.52:0/2372640071 >> 172.21.15.52:0/2372640071 conn(0x7fac6806a5c0 msgr2=0x7fac680ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:10.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 -- 172.21.15.52:0/2372640071 shutdown_connections 2023-09-30T16:50:10.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 -- 172.21.15.52:0/2372640071 wait complete. 2023-09-30T16:50:10.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 Processor -- start 2023-09-30T16:50:10.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.334+0000 7fac6cae1640 1 -- start start 2023-09-30T16:50:10.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac680b00a0 0x7fac680cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac6815a8b0 0x7fac6814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac6814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac68163940 con 0x7fac6815e4b0 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6815c4f0 con 0x7fac6815a8b0 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6815c7d0 con 0x7fac680b00a0 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac6814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac6814fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43152/0 (socket says 172.21.15.52:43152) 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 -- 172.21.15.52:0/3310006128 learned_addr learned my addr 172.21.15.52:0/3310006128 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6659c640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac680b00a0 0x7fac680cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac65d9b640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac6815a8b0 0x7fac6814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 -- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac680b00a0 msgr2=0x7fac680cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac680b00a0 0x7fac680cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 -- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac6815a8b0 msgr2=0x7fac6814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac6815a8b0 0x7fac6814f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 -- 172.21.15.52:0/3310006128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c009420 con 0x7fac6815e4b0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac65d9b640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac6815a8b0 0x7fac6814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac66d9d640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac6814fc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fac6000caa0 tx=0x7fac6000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6000ac00 con 0x7fac6815e4b0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6000ad60 con 0x7fac6815e4b0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60012620 con 0x7fac6815e4b0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6815cab0 con 0x7fac6815e4b0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac68152f20 con 0x7fac6815e4b0 2023-09-30T16:50:10.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac680740a0 con 0x7fac6815e4b0 2023-09-30T16:50:10.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fac60007070 con 0x7fac6815e4b0 2023-09-30T16:50:10.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac56ffd640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fac48066160 0x7fac48068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac60083850 con 0x7fac6815e4b0 2023-09-30T16:50:10.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.338+0000 7fac6659c640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fac48066160 0x7fac48068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.342+0000 7fac6659c640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fac48066160 0x7fac48068620 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac58006fd0 tx=0x7fac58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:10.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.342+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fac60051090 con 0x7fac6815e4b0 2023-09-30T16:50:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.558+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fac680ca130 con 0x7fac6815e4b0 2023-09-30T16:50:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac56ffd640 1 -- 172.21.15.52:0/3310006128 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fac600546b0 con 0x7fac6815e4b0 2023-09-30T16:50:10.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fac48066160 msgr2=0x7fac48068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fac48066160 0x7fac48068620 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac58006fd0 tx=0x7fac58008040 comp rx=0 tx=0).stop 2023-09-30T16:50:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 msgr2=0x7fac6814fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac6814fc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fac6000caa0 tx=0x7fac6000cf60 comp rx=0 tx=0).stop 2023-09-30T16:50:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 shutdown_connections 2023-09-30T16:50:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fac48066160 0x7fac48068620 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac6815e4b0 0x7fac6814fc00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac6815a8b0 0x7fac6814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 --2- 172.21.15.52:0/3310006128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac680b00a0 0x7fac680cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 >> 172.21.15.52:0/3310006128 conn(0x7fac6806a5c0 msgr2=0x7fac680cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 shutdown_connections 2023-09-30T16:50:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.562+0000 7fac6cae1640 1 -- 172.21.15.52:0/3310006128 wait complete. 2023-09-30T16:50:10.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-30T16:50:10.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 Processor -- start 2023-09-30T16:50:10.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 -- start start 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0140c9d20 0x7fe014070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe0140ca1a0 0x7fe0140705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01415d3a0 con 0x7fe014159780 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01406db80 con 0x7fe0140c9d20 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.706+0000 7fe019aec640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0140cd740 con 0x7fe0140ca1a0 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0140c9d20 0x7fe014070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0140c9d20 0x7fe014070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43166/0 (socket says 172.21.15.52:43166) 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 -- 172.21.15.52:0/2013482291 learned_addr learned my addr 172.21.15.52:0/2013482291 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe013fff640 1 --2- 172.21.15.52:0/2013482291 >> v2:172.21.15.186:3300/0 conn(0x7fe0140ca1a0 0x7fe0140705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 -- 172.21.15.52:0/2013482291 >> v2:172.21.15.186:3300/0 conn(0x7fe0140ca1a0 msgr2=0x7fe0140705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 --2- 172.21.15.52:0/2013482291 >> v2:172.21.15.186:3300/0 conn(0x7fe0140ca1a0 0x7fe0140705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 -- 172.21.15.52:0/2013482291 >> v1:172.21.15.186:6789/0 conn(0x7fe014159780 legacy=0x7fe01406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 -- 172.21.15.52:0/2013482291 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140cda20 con 0x7fe0140c9d20 2023-09-30T16:50:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe013fff640 1 --2- 172.21.15.52:0/2013482291 >> v2:172.21.15.186:3300/0 conn(0x7fe0140ca1a0 0x7fe0140705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:10.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe00bfff640 1 --2- 172.21.15.52:0/2013482291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0140c9d20 0x7fe014070070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe01406e520 tx=0x7fdffc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79687baf8fbacbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:10.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe012ffd640 1 -- 172.21.15.52:0/2013482291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0ab600 con 0x7fe0140c9d20 2023-09-30T16:50:10.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe012ffd640 1 -- 172.21.15.52:0/2013482291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc0ab760 con 0x7fe0140c9d20 2023-09-30T16:50:10.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe012ffd640 1 -- 172.21.15.52:0/2013482291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0abaf0 con 0x7fe0140c9d20 2023-09-30T16:50:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 -- 172.21.15.52:0/2013482291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0140c9d20 msgr2=0x7fe014070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 --2- 172.21.15.52:0/2013482291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0140c9d20 0x7fe014070070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe01406e520 tx=0x7fdffc01c400 comp rx=0 tx=0).stop 2023-09-30T16:50:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 -- 172.21.15.52:0/2013482291 shutdown_connections 2023-09-30T16:50:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 --2- 172.21.15.52:0/2013482291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0140c9d20 0x7fe014070070 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 --2- 172.21.15.52:0/2013482291 >> v2:172.21.15.186:3300/0 conn(0x7fe0140ca1a0 0x7fe0140705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 -- 172.21.15.52:0/2013482291 >> 172.21.15.52:0/2013482291 conn(0x7fe01406a5c0 msgr2=0x7fe0140ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 -- 172.21.15.52:0/2013482291 shutdown_connections 2023-09-30T16:50:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.710+0000 7fe019aec640 1 -- 172.21.15.52:0/2013482291 wait complete. 2023-09-30T16:50:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 Processor -- start 2023-09-30T16:50:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- start start 2023-09-30T16:50:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0140c9d20 0x7fe014157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0140ca1a0 0x7fe0140c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 0x7fe01414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014158330 con 0x7fe014159780 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014158050 con 0x7fe0140ca1a0 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140aba10 con 0x7fe0140c9d20 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 0x7fe01414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 0x7fe01414b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43182/0 (socket says 172.21.15.52:43182) 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 -- 172.21.15.52:0/4205272674 learned_addr learned my addr 172.21.15.52:0/4205272674 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe00bfff640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0140ca1a0 0x7fe0140c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe0137fe640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0140c9d20 0x7fe014157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 -- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0140c9d20 msgr2=0x7fe014157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0140c9d20 0x7fe014157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 -- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0140ca1a0 msgr2=0x7fe0140c0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0140ca1a0 0x7fe0140c0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 -- 172.21.15.52:0/4205272674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0094d0 con 0x7fe014159780 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe00bfff640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0140ca1a0 0x7fe0140c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe013fff640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 0x7fe01414b6b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00cd50 tx=0x7fe00c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00f680 con 0x7fe014159780 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c00f800 con 0x7fe014159780 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00fbb0 con 0x7fe014159780 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0140abcf0 con 0x7fe014159780 2023-09-30T16:50:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0140c1490 con 0x7fe014159780 2023-09-30T16:50:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.714+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0140740a0 con 0x7fe014159780 2023-09-30T16:50:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.718+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe00c00b040 con 0x7fe014159780 2023-09-30T16:50:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.718+0000 7fe010ff9640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdff4066160 0x7fdff4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.718+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe00c0841c0 con 0x7fe014159780 2023-09-30T16:50:10.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.718+0000 7fe0137fe640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdff4066160 0x7fdff4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:10.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.718+0000 7fe0137fe640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdff4066160 0x7fdff4068620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0140afc10 tx=0x7fe004008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.722+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe00c051ca0 con 0x7fe014159780 2023-09-30T16:50:10.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.930+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe0140713d0 con 0x7fe014159780 2023-09-30T16:50:10.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.934+0000 7fe010ff9640 1 -- 172.21.15.52:0/4205272674 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe00c0552c0 con 0x7fe014159780 2023-09-30T16:50:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdff4066160 msgr2=0x7fdff4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdff4066160 0x7fdff4068620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0140afc10 tx=0x7fe004008040 comp rx=0 tx=0).stop 2023-09-30T16:50:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 msgr2=0x7fe01414b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 0x7fe01414b6b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00cd50 tx=0x7fe00c00a650 comp rx=0 tx=0).stop 2023-09-30T16:50:10.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 shutdown_connections 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fdff4066160 0x7fdff4068620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe014159780 0x7fe01414b6b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0140ca1a0 0x7fe0140c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 --2- 172.21.15.52:0/4205272674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0140c9d20 0x7fe014157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 >> 172.21.15.52:0/4205272674 conn(0x7fe01406a5c0 msgr2=0x7fe0140cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 shutdown_connections 2023-09-30T16:50:10.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:10.938+0000 7fe019aec640 1 -- 172.21.15.52:0/4205272674 wait complete. 2023-09-30T16:50:10.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-30T16:50:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 Processor -- start 2023-09-30T16:50:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 -- start start 2023-09-30T16:50:11.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16ec15bee0 0x7f16ec0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15f260 0x7f16ec069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0cc790 con 0x7f16ec15ee20 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0ccfe0 con 0x7f16ec15bee0 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f318f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0cca20 con 0x7f16ec15f260 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16ec15bee0 0x7f16ec0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f16ec15bee0 0x7f16ec0ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43192/0 (socket says 172.21.15.52:43192) 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3848586105 learned_addr learned my addr 172.21.15.52:0/3848586105 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f172c640 1 --2- 172.21.15.52:0/3848586105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15f260 0x7f16ec069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3848586105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15f260 msgr2=0x7f16ec069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 --2- 172.21.15.52:0/3848586105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15f260 0x7f16ec069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3848586105 >> v1:172.21.15.186:6789/0 conn(0x7f16ec15ee20 legacy=0x7f16ec0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:11.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.078+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3848586105 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0ccd00 con 0x7f16ec15bee0 2023-09-30T16:50:11.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f0f2b640 1 --2- 172.21.15.52:0/3848586105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0ca860 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009e50 tx=0x7f16e401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8400816a6e2ead server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16eb7fe640 1 -- 172.21.15.52:0/3848586105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40a5650 con 0x7f16ec15bee0 2023-09-30T16:50:11.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16eb7fe640 1 -- 172.21.15.52:0/3848586105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40a57b0 con 0x7f16ec15bee0 2023-09-30T16:50:11.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16eb7fe640 1 -- 172.21.15.52:0/3848586105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40a5b40 con 0x7f16ec15bee0 2023-09-30T16:50:11.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 -- 172.21.15.52:0/3848586105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 msgr2=0x7f16ec0ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 --2- 172.21.15.52:0/3848586105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0ca860 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009e50 tx=0x7f16e401c9d0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 -- 172.21.15.52:0/3848586105 shutdown_connections 2023-09-30T16:50:11.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 --2- 172.21.15.52:0/3848586105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15f260 0x7f16ec069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 --2- 172.21.15.52:0/3848586105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0ca860 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 -- 172.21.15.52:0/3848586105 >> 172.21.15.52:0/3848586105 conn(0x7f16ec06d320 msgr2=0x7f16ec06d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:11.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 -- 172.21.15.52:0/3848586105 shutdown_connections 2023-09-30T16:50:11.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.082+0000 7f16f318f640 1 -- 172.21.15.52:0/3848586105 wait complete. 2023-09-30T16:50:11.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 Processor -- start 2023-09-30T16:50:11.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- start start 2023-09-30T16:50:11.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15ee20 0x7f16ec0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16ec15f260 0x7f16ec0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec156060 con 0x7f16ec15bee0 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec156340 con 0x7f16ec15f260 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec156620 con 0x7f16ec15ee20 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43206/0 (socket says 172.21.15.52:43206) 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3381461522 learned_addr learned my addr 172.21.15.52:0/3381461522 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16ebfff640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15ee20 0x7f16ec0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f172c640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16ec15f260 0x7f16ec0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15ee20 msgr2=0x7f16ec0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15ee20 0x7f16ec0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16ec15f260 msgr2=0x7f16ec0c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16ec15f260 0x7f16ec0c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 -- 172.21.15.52:0/3381461522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009b30 con 0x7f16ec15bee0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f0f2b640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0affb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f16e401b080 tx=0x7f16e4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40bd070 con 0x7f16ec15bee0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e4009510 con 0x7f16ec15bee0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec156900 con 0x7f16ec15bee0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40b86d0 con 0x7f16ec15bee0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec0b04f0 con 0x7f16ec15bee0 2023-09-30T16:50:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec0740a0 con 0x7f16ec15bee0 2023-09-30T16:50:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.086+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f16e40b8830 con 0x7f16ec15bee0 2023-09-30T16:50:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.090+0000 7f16e97fa640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f16cc066160 0x7f16cc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.090+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f16e411e5e0 con 0x7f16ec15bee0 2023-09-30T16:50:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.090+0000 7f16ebfff640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f16cc066160 0x7f16cc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.090+0000 7f16ebfff640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f16cc066160 0x7f16cc068620 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16ec1656d0 tx=0x7f16d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.094+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f16e40ebfd0 con 0x7f16ec15bee0 2023-09-30T16:50:11.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.306+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f16ec156db0 con 0x7f16ec15bee0 2023-09-30T16:50:11.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16e97fa640 1 -- 172.21.15.52:0/3381461522 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f16e40ef5f0 con 0x7f16ec15bee0 2023-09-30T16:50:11.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f16cc066160 msgr2=0x7f16cc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f16cc066160 0x7f16cc068620 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16ec1656d0 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 msgr2=0x7f16ec0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0affb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f16e401b080 tx=0x7f16e4019770 comp rx=0 tx=0).stop 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 shutdown_connections 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f16cc066160 0x7f16cc068620 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16ec1656d0 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16ec15f260 0x7f16ec0c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16ec15ee20 0x7f16ec0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 --2- 172.21.15.52:0/3381461522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16ec15bee0 0x7f16ec0affb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 >> 172.21.15.52:0/3381461522 conn(0x7f16ec06d320 msgr2=0x7f16ec071220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 shutdown_connections 2023-09-30T16:50:11.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.314+0000 7f16f318f640 1 -- 172.21.15.52:0/3381461522 wait complete. 2023-09-30T16:50:11.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-30T16:50:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 Processor -- start 2023-09-30T16:50:11.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 -- start start 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e88159080 0x7f4e8806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880c9460 0x7f4e8806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e880aded0 con 0x7f4e880b00a0 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e88159460 con 0x7f4e88159080 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e8d79c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8806d510 con 0x7f4e880c9460 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e88159080 0x7f4e8806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e88159080 0x7f4e8806c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43220/0 (socket says 172.21.15.52:43220) 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 -- 172.21.15.52:0/687082160 learned_addr learned my addr 172.21.15.52:0/687082160 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e867fc640 1 --2- 172.21.15.52:0/687082160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880c9460 0x7f4e8806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 -- 172.21.15.52:0/687082160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880c9460 msgr2=0x7f4e8806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:11.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 --2- 172.21.15.52:0/687082160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880c9460 0x7f4e8806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 -- 172.21.15.52:0/687082160 >> v1:172.21.15.186:6789/0 conn(0x7f4e880b00a0 legacy=0x7f4e88070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.462+0000 7f4e86ffd640 1 -- 172.21.15.52:0/687082160 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8806d7f0 con 0x7f4e88159080 2023-09-30T16:50:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e86ffd640 1 --2- 172.21.15.52:0/687082160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e8806c950 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4e78009870 tx=0x7f4e7801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b1f08ba98793c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e85ffb640 1 -- 172.21.15.52:0/687082160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780aa670 con 0x7f4e88159080 2023-09-30T16:50:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e85ffb640 1 -- 172.21.15.52:0/687082160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e780aa7d0 con 0x7f4e88159080 2023-09-30T16:50:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e85ffb640 1 -- 172.21.15.52:0/687082160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780aab60 con 0x7f4e88159080 2023-09-30T16:50:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 -- 172.21.15.52:0/687082160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 msgr2=0x7f4e8806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/687082160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e8806c950 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4e78009870 tx=0x7f4e7801c510 comp rx=0 tx=0).stop 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 -- 172.21.15.52:0/687082160 shutdown_connections 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/687082160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880c9460 0x7f4e8806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/687082160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e8806c950 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 -- 172.21.15.52:0/687082160 >> 172.21.15.52:0/687082160 conn(0x7f4e8806a5c0 msgr2=0x7f4e880ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 -- 172.21.15.52:0/687082160 shutdown_connections 2023-09-30T16:50:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.466+0000 7f4e8d79c640 1 -- 172.21.15.52:0/687082160 wait complete. 2023-09-30T16:50:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 Processor -- start 2023-09-30T16:50:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- start start 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880b00a0 0x7f4e8815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e880c9460 0x7f4e88149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e880c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8815a580 con 0x7f4e88159080 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8814af30 con 0x7f4e880c9460 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8814b180 con 0x7f4e880b00a0 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e880c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e880c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43224/0 (socket says 172.21.15.52:43224) 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 -- 172.21.15.52:0/698374896 learned_addr learned my addr 172.21.15.52:0/698374896 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e86ffd640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880b00a0 0x7f4e8815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e867fc640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e880c9460 0x7f4e88149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 -- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880b00a0 msgr2=0x7f4e8815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880b00a0 0x7f4e8815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 -- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e880c9460 msgr2=0x7f4e88149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e880c9460 0x7f4e88149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 -- 172.21.15.52:0/698374896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780094d0 con 0x7f4e88159080 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e877fe640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e880c7670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c770 tx=0x7f4e8000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80003b80 con 0x7f4e88159080 2023-09-30T16:50:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80003ce0 con 0x7f4e88159080 2023-09-30T16:50:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e880b0a40 con 0x7f4e88159080 2023-09-30T16:50:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000aa90 con 0x7f4e88159080 2023-09-30T16:50:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8814b740 con 0x7f4e88159080 2023-09-30T16:50:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.470+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e880740a0 con 0x7f4e88159080 2023-09-30T16:50:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.474+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f4e8000abf0 con 0x7f4e88159080 2023-09-30T16:50:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.474+0000 7f4e6f7fe640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4e74066160 0x7f4e74068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.474+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e800835b0 con 0x7f4e88159080 2023-09-30T16:50:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.474+0000 7f4e86ffd640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4e74066160 0x7f4e74068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.474+0000 7f4e86ffd640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4e74066160 0x7f4e74068620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ae000 tx=0x7f4e780a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.478+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f4e80050f20 con 0x7f4e88159080 2023-09-30T16:50:11.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.690+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4e881588b0 con 0x7f4e88159080 2023-09-30T16:50:11.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.694+0000 7f4e6f7fe640 1 -- 172.21.15.52:0/698374896 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e80054540 con 0x7f4e88159080 2023-09-30T16:50:11.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4e74066160 msgr2=0x7f4e74068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4e74066160 0x7f4e74068620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ae000 tx=0x7f4e780a7000 comp rx=0 tx=0).stop 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 msgr2=0x7f4e880c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e880c7670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c770 tx=0x7f4e8000cc30 comp rx=0 tx=0).stop 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 shutdown_connections 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4e74066160 0x7f4e74068620 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e88159080 0x7f4e880c7670 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e880c9460 0x7f4e88149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 --2- 172.21.15.52:0/698374896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e880b00a0 0x7f4e8815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 >> 172.21.15.52:0/698374896 conn(0x7f4e8806a5c0 msgr2=0x7f4e8814e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 shutdown_connections 2023-09-30T16:50:11.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.698+0000 7f4e8d79c640 1 -- 172.21.15.52:0/698374896 wait complete. 2023-09-30T16:50:11.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-30T16:50:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 Processor -- start 2023-09-30T16:50:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 -- start start 2023-09-30T16:50:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f98300ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f983015ee20 0x7f98300cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f983015f260 0x7f9830069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300ccfe0 con 0x7f983015ee20 2023-09-30T16:50:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300cca20 con 0x7f983015f260 2023-09-30T16:50:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f983561e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300ccd00 con 0x7f983015bee0 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f983015ee20 0x7f98300cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f983015ee20 0x7f98300cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43232/0 (socket says 172.21.15.52:43232) 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 -- 172.21.15.52:0/3455970439 learned_addr learned my addr 172.21.15.52:0/3455970439 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982effd640 1 --2- 172.21.15.52:0/3455970439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f98300ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982f7fe640 1 --2- 172.21.15.52:0/3455970439 >> v2:172.21.15.186:3300/0 conn(0x7f983015f260 0x7f9830069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 -- 172.21.15.52:0/3455970439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 msgr2=0x7f98300ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 --2- 172.21.15.52:0/3455970439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f98300ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 -- 172.21.15.52:0/3455970439 >> v2:172.21.15.186:3300/0 conn(0x7f983015f260 msgr2=0x7f9830069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 --2- 172.21.15.52:0/3455970439 >> v2:172.21.15.186:3300/0 conn(0x7f983015f260 0x7f9830069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.846+0000 7f982e7fc640 1 -- 172.21.15.52:0/3455970439 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983015e620 con 0x7f983015ee20 2023-09-30T16:50:11.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f982e7fc640 1 --2- 172.21.15.52:0/3455970439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300cc080 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f983006e030 tx=0x7f982401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec5d86ba2f241a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f982dffb640 1 -- 172.21.15.52:0/3455970439 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240ab600 con 0x7f983015ee20 2023-09-30T16:50:11.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f982dffb640 1 -- 172.21.15.52:0/3455970439 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98240a7050 con 0x7f983015ee20 2023-09-30T16:50:11.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f982dffb640 1 -- 172.21.15.52:0/3455970439 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240ab980 con 0x7f983015ee20 2023-09-30T16:50:11.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 -- 172.21.15.52:0/3455970439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 msgr2=0x7f98300cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 --2- 172.21.15.52:0/3455970439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300cc080 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f983006e030 tx=0x7f982401c500 comp rx=0 tx=0).stop 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 -- 172.21.15.52:0/3455970439 shutdown_connections 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 --2- 172.21.15.52:0/3455970439 >> v2:172.21.15.186:3300/0 conn(0x7f983015f260 0x7f9830069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 --2- 172.21.15.52:0/3455970439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300cc080 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 --2- 172.21.15.52:0/3455970439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f98300ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 -- 172.21.15.52:0/3455970439 >> 172.21.15.52:0/3455970439 conn(0x7f983006d320 msgr2=0x7f983006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 -- 172.21.15.52:0/3455970439 shutdown_connections 2023-09-30T16:50:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 -- 172.21.15.52:0/3455970439 wait complete. 2023-09-30T16:50:11.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 Processor -- start 2023-09-30T16:50:11.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.850+0000 7f983561e640 1 -- start start 2023-09-30T16:50:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f9830147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983015f260 0x7f983015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300b3e20 con 0x7f983015ee20 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300b40a0 con 0x7f983015f260 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300b4380 con 0x7f983015bee0 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43238/0 (socket says 172.21.15.52:43238) 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 -- 172.21.15.52:0/3844617340 learned_addr learned my addr 172.21.15.52:0/3844617340 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982effd640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f9830147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982f7fe640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983015f260 0x7f983015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 -- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 msgr2=0x7f9830147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f9830147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 -- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983015f260 msgr2=0x7f983015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983015f260 0x7f983015a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 -- 172.21.15.52:0/3844617340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240094d0 con 0x7f983015ee20 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982f7fe640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983015f260 0x7f983015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982e7fc640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300b38e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f982401abb0 tx=0x7f98240192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240b4420 con 0x7f983015ee20 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98240b4580 con 0x7f983015ee20 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98300b4660 con 0x7f983015ee20 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240b4930 con 0x7f983015ee20 2023-09-30T16:50:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98300b4c20 con 0x7f983015ee20 2023-09-30T16:50:11.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98300b4e10 con 0x7f983015ee20 2023-09-30T16:50:11.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f98240b2070 con 0x7f983015ee20 2023-09-30T16:50:11.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f98177fe640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f981c066160 0x7f981c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:11.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f982411cc30 con 0x7f983015ee20 2023-09-30T16:50:11.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.854+0000 7f982effd640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f981c066160 0x7f981c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:11.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.858+0000 7f982effd640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f981c066160 0x7f981c068620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9828004470 tx=0x7f9828003a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:11.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:11.858+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f98240ea610 con 0x7f983015ee20 2023-09-30T16:50:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.070+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f98300740a0 con 0x7f983015ee20 2023-09-30T16:50:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f98177fe640 1 -- 172.21.15.52:0/3844617340 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f98240edc30 con 0x7f983015ee20 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f981c066160 msgr2=0x7f981c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f981c066160 0x7f981c068620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9828004470 tx=0x7f9828003a40 comp rx=0 tx=0).stop 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 msgr2=0x7f98300b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300b38e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f982401abb0 tx=0x7f98240192a0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 shutdown_connections 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f981c066160 0x7f981c068620 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983015f260 0x7f983015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f983015ee20 0x7f98300b38e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 --2- 172.21.15.52:0/3844617340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f983015bee0 0x7f9830147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 >> 172.21.15.52:0/3844617340 conn(0x7f983006d320 msgr2=0x7f983015d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 shutdown_connections 2023-09-30T16:50:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.074+0000 7f983561e640 1 -- 172.21.15.52:0/3844617340 wait complete. 2023-09-30T16:50:12.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.214+0000 7fd21ef76640 1 Processor -- start 2023-09-30T16:50:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.214+0000 7fd21ef76640 1 -- start start 2023-09-30T16:50:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21ef76640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd2180b6290 0x7fd218167800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21ef76640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180d3400 con 0x7fd2180b87b0 2023-09-30T16:50:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21ef76640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180d1350 con 0x7fd21815cdd0 2023-09-30T16:50:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21ef76640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180d1630 con 0x7fd2180b6290 2023-09-30T16:50:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd217fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd2180b87b0 0x7fd2180b5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60784/0 (socket says 172.21.15.52:60784) 2023-09-30T16:50:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd217fff640 1 -- 172.21.15.52:0/3836297838 learned_addr learned my addr 172.21.15.52:0/3836297838 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:12.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 --2- 172.21.15.52:0/3836297838 >> v2:172.21.15.186:3300/0 conn(0x7fd2180b6290 0x7fd218167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586793947 0 0) 0x7fd2180d3400 con 0x7fd2180b87b0 2023-09-30T16:50:12.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f8003530 con 0x7fd2180b87b0 2023-09-30T16:50:12.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054825746 0 0) 0x7fd1f8003530 con 0x7fd2180b87b0 2023-09-30T16:50:12.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 >> v2:172.21.15.186:3300/0 conn(0x7fd2180b6290 msgr2=0x7fd218167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 --2- 172.21.15.52:0/3836297838 >> v2:172.21.15.186:3300/0 conn(0x7fd2180b6290 0x7fd218167800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 >> v1:172.21.15.186:6789/0 conn(0x7fd21815cdd0 legacy=0x7fd2180d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180d1910 con 0x7fd2180b87b0 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fd200001680 con 0x7fd2180b87b0 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 >> v1:172.21.15.52:6789/0 conn(0x7fd2180b87b0 legacy=0x7fd2180b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f80039f0 0x7fd1f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f80047d0 0x7fd1f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f8005190 0x7fd1f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180d1630 con 0x7fd1f8005190 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f800c0a0 con 0x7fd1f80047d0 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f800c260 con 0x7fd1f80039f0 2023-09-30T16:50:12.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f8005190 0x7fd1f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd217fff640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f80047d0 0x7fd1f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21cd12640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f80039f0 0x7fd1f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 -- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f80039f0 msgr2=0x7fd1f8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f80039f0 0x7fd1f8003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 -- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f80047d0 msgr2=0x7fd1f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f80047d0 0x7fd1f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.218+0000 7fd21d513640 1 -- 172.21.15.52:0/3836297838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8003530 con 0x7fd1f8005190 2023-09-30T16:50:12.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21d513640 1 -- 172.21.15.52:0/3836297838 reap_dead start 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21d513640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f8005190 0x7fd1f800b990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ae0 tx=0x7fd20801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a384aa37a7764f76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208004020 con 0x7fd1f8005190 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2080041c0 con 0x7fd1f8005190 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd2177fe640 1 -- 172.21.15.52:0/3836297838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080a5680 con 0x7fd1f8005190 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- 172.21.15.52:0/3836297838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f8005190 msgr2=0x7fd1f800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f8005190 0x7fd1f800b990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ae0 tx=0x7fd20801ca90 comp rx=0 tx=0).stop 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- 172.21.15.52:0/3836297838 shutdown_connections 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3836297838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1f8005190 0x7fd1f800b990 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- 172.21.15.52:0/3836297838 >> 172.21.15.52:0/3836297838 conn(0x7fd218071930 msgr2=0x7fd218071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- 172.21.15.52:0/3836297838 shutdown_connections 2023-09-30T16:50:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- 172.21.15.52:0/3836297838 wait complete. 2023-09-30T16:50:12.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 Processor -- start 2023-09-30T16:50:12.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- start start 2023-09-30T16:50:12.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f8005190 0x7fd218159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 0x7fd21815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2180d22f0 0x7fd2180d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181f2240 con 0x7fd2180cbe50 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180d2cc0 con 0x7fd2180d22f0 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815e510 con 0x7fd1f8005190 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 0x7fd21815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 0x7fd21815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43256/0 (socket says 172.21.15.52:43256) 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 -- 172.21.15.52:0/3926489664 learned_addr learned my addr 172.21.15.52:0/3926489664 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21d513640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2180d22f0 0x7fd2180d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21cd12640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f8005190 0x7fd218159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 -- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f8005190 msgr2=0x7fd218159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f8005190 0x7fd218159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 -- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2180d22f0 msgr2=0x7fd2180d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2180d22f0 0x7fd2180d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 -- 172.21.15.52:0/3926489664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21815e7f0 con 0x7fd2180cbe50 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21d513640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2180d22f0 0x7fd2180d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd217fff640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 0x7fd21815dbc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd20000e760 tx=0x7fd20000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000ee70 con 0x7fd2180cbe50 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000c8d0 con 0x7fd2180cbe50 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21815ead0 con 0x7fd2180cbe50 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.222+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000cc80 con 0x7fd2180cbe50 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd218159780 con 0x7fd2180cbe50 2023-09-30T16:50:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2181f1fb0 con 0x7fd2180cbe50 2023-09-30T16:50:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd20001d460 con 0x7fd2180cbe50 2023-09-30T16:50:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd2157fa640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd1fc066160 0x7fd1fc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2000836a0 con 0x7fd2180cbe50 2023-09-30T16:50:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd21cd12640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd1fc066160 0x7fd1fc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.226+0000 7fd21cd12640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd1fc066160 0x7fd1fc068620 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd210000f90 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.230+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd2000510a0 con 0x7fd2180cbe50 2023-09-30T16:50:12.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.382+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2181f2380 con 0x7fd2180cbe50 2023-09-30T16:50:12.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.382+0000 7fd2157fa640 1 -- 172.21.15.52:0/3926489664 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12869 (secure 0 0 0) 0x7fd2181f2380 con 0x7fd2180cbe50 2023-09-30T16:50:12.385 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:12.385 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":31,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:50:09.422084+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd1fc066160 msgr2=0x7fd1fc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd1fc066160 0x7fd1fc068620 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd210000f90 tx=0x7fd210009040 comp rx=0 tx=0).stop 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 msgr2=0x7fd21815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 0x7fd21815dbc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd20000e760 tx=0x7fd20000ec20 comp rx=0 tx=0).stop 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 shutdown_connections 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd1fc066160 0x7fd1fc068620 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2180d22f0 0x7fd2180d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2180cbe50 0x7fd21815dbc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 --2- 172.21.15.52:0/3926489664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1f8005190 0x7fd218159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 >> 172.21.15.52:0/3926489664 conn(0x7fd218071930 msgr2=0x7fd2180c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:12.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 shutdown_connections 2023-09-30T16:50:12.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.386+0000 7fd21ef76640 1 -- 172.21.15.52:0/3926489664 wait complete. 2023-09-30T16:50:12.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T16:50:12.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T16:50:12.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72ac6a2640 1 Processor -- start 2023-09-30T16:50:12.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72ac6a2640 1 -- start start 2023-09-30T16:50:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72ac6a2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 0x7f72a4070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72ac6a2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a40ce770 con 0x7f72a415a9e0 2023-09-30T16:50:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72ac6a2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a40cea10 con 0x7f72a40b2310 2023-09-30T16:50:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72ac6a2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40b3ef0 con 0x7f72a40b63e0 2023-09-30T16:50:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aa43e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f72a415a9e0 0x7f72a40b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60792/0 (socket says 172.21.15.52:60792) 2023-09-30T16:50:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aa43e640 1 -- 172.21.15.52:0/3813894749 learned_addr learned my addr 172.21.15.52:0/3813894749 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a9c3d640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 0x7f72a4070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392274603 0 0) 0x7f72a40ce770 con 0x7f72a415a9e0 2023-09-30T16:50:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7290003530 con 0x7f72a415a9e0 2023-09-30T16:50:12.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375614852 0 0) 0x7f7290003530 con 0x7f72a415a9e0 2023-09-30T16:50:12.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 msgr2=0x7f72a4070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 0x7f72a4070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 >> v1:172.21.15.186:6789/0 conn(0x7f72a40b2310 legacy=0x7f72a40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40cecf0 con 0x7f72a415a9e0 2023-09-30T16:50:12.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f72a0001680 con 0x7f72a415a9e0 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 >> v1:172.21.15.52:6789/0 conn(0x7f72a415a9e0 legacy=0x7f72a40b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 0x7f72900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290003f30 0x7f72900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290004d10 0x7f7290005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40b3ef0 con 0x7f7290004d10 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729000bb20 con 0x7f7290003f30 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729000bce0 con 0x7f72a40b63e0 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290004d10 0x7f7290005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72a9c3d640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290003f30 0x7f72900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aa43e640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 0x7f72900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aac3f640 1 -- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 msgr2=0x7f72900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a40b63e0 0x7f72900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aac3f640 1 -- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290003f30 msgr2=0x7f72900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290003f30 0x7f72900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.530+0000 7f72aac3f640 1 -- 172.21.15.52:0/3813894749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290003530 con 0x7f7290004d10 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290004d10 0x7f7290005190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f729c001e70 tx=0x7f729c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4360ce5b03958304 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c003b80 con 0x7f7290004d10 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c003ce0 con 0x7f7290004d10 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72a943c640 1 -- 172.21.15.52:0/3813894749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0052c0 con 0x7f7290004d10 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3813894749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290004d10 msgr2=0x7f7290005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3813894749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290004d10 0x7f7290005190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f729c001e70 tx=0x7f729c01c760 comp rx=0 tx=0).stop 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72aac3f640 1 -- 172.21.15.52:0/3813894749 reap_dead start 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3813894749 shutdown_connections 2023-09-30T16:50:12.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3813894749 >> 172.21.15.52:0/3813894749 conn(0x7f72a40cd310 msgr2=0x7f72a40cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:12.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3813894749 shutdown_connections 2023-09-30T16:50:12.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3813894749 wait complete. 2023-09-30T16:50:12.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 Processor -- start 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.534+0000 7f72ac6a2640 1 -- start start 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290004d10 0x7f72a415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a41f0f00 0x7f72a414be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 0x7f72a40cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a415c7a0 con 0x7f72a40c7960 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a414c3a0 con 0x7f7290004d10 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a41f13e0 con 0x7f72a41f0f00 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 0x7f72a40cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 0x7f72a40cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43284/0 (socket says 172.21.15.52:43284) 2023-09-30T16:50:12.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 -- 172.21.15.52:0/3417178638 learned_addr learned my addr 172.21.15.52:0/3417178638 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aa43e640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290004d10 0x7f72a415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72a9c3d640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a41f0f00 0x7f72a414be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 -- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a41f0f00 msgr2=0x7f72a414be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a41f0f00 0x7f72a414be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 -- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290004d10 msgr2=0x7f72a415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290004d10 0x7f72a415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 -- 172.21.15.52:0/3417178638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a41f16c0 con 0x7f72a40c7960 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aac3f640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 0x7f72a40cfb60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f729c098060 tx=0x7f7290005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c006d60 con 0x7f72a40c7960 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c005820 con 0x7f72a40c7960 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c007250 con 0x7f72a40c7960 2023-09-30T16:50:12.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a41f19a0 con 0x7f72a40c7960 2023-09-30T16:50:12.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a415adc0 con 0x7f72a40c7960 2023-09-30T16:50:12.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a4066750 con 0x7f72a40c7960 2023-09-30T16:50:12.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f729c0073b0 con 0x7f72a40c7960 2023-09-30T16:50:12.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f729affd640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7288066190 0x7f7288068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f729c11d8b0 con 0x7f72a40c7960 2023-09-30T16:50:12.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.538+0000 7f72aa43e640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7288066190 0x7f7288068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.542+0000 7f72aa43e640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7288066190 0x7f7288068650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72a0000c10 tx=0x7f72a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.542+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f729c0eb2d0 con 0x7f72a40c7960 2023-09-30T16:50:12.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72a415afb0 con 0x7f72a40c7960 2023-09-30T16:50:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f729affd640 1 -- 172.21.15.52:0/3417178638 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f729c0bc0a0 con 0x7f72a40c7960 2023-09-30T16:50:12.696 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-09-30T16:50:12.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7288066190 msgr2=0x7f7288068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7288066190 0x7f7288068650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72a0000c10 tx=0x7f72a0009040 comp rx=0 tx=0).stop 2023-09-30T16:50:12.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 msgr2=0x7f72a40cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 0x7f72a40cfb60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f729c098060 tx=0x7f7290005800 comp rx=0 tx=0).stop 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 shutdown_connections 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7288066190 0x7f7288068650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a40c7960 0x7f72a40cfb60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72a41f0f00 0x7f72a414be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 --2- 172.21.15.52:0/3417178638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7290004d10 0x7f72a415c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.694+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 >> 172.21.15.52:0/3417178638 conn(0x7f72a40cd310 msgr2=0x7f72a40c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.698+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 shutdown_connections 2023-09-30T16:50:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.698+0000 7f72ac6a2640 1 -- 172.21.15.52:0/3417178638 wait complete. 2023-09-30T16:50:12.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T16:50:12.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 Processor -- start 2023-09-30T16:50:12.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 -- start start 2023-09-30T16:50:12.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f014815ce10 0x7f01480b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 0x7f01480b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480b7570 con 0x7f01480cd870 2023-09-30T16:50:12.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480b7850 con 0x7f014815ce10 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014ed1c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480b7b30 con 0x7f01480d1fb0 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f01480cd870 0x7f01480cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60802/0 (socket says 172.21.15.52:60802) 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 -- 172.21.15.52:0/2851460751 learned_addr learned my addr 172.21.15.52:0/2851460751 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014cab8640 1 --2- 172.21.15.52:0/2851460751 >> v2:172.21.15.186:3300/0 conn(0x7f014815ce10 0x7f01480b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014d2b9640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 0x7f01480b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676242842 0 0) 0x7f01480b7570 con 0x7f01480cd870 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0134003530 con 0x7f01480cd870 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886002679 0 0) 0x7f0134003530 con 0x7f01480cd870 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 msgr2=0x7f01480b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 0x7f01480b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 >> v2:172.21.15.186:3300/0 conn(0x7f014815ce10 msgr2=0x7f01480b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 --2- 172.21.15.52:0/2851460751 >> v2:172.21.15.186:3300/0 conn(0x7f014815ce10 0x7f01480b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480b7e10 con 0x7f01480cd870 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f0130001680 con 0x7f01480cd870 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 >> v1:172.21.15.52:6789/0 conn(0x7f01480cd870 legacy=0x7f01480cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 0x7f01340039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134003fc0 0x7f01340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134004d10 0x7f0134005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480b7850 con 0x7f0134003fc0 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480b7b30 con 0x7f0134004d10 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013400bb50 con 0x7f01480d1fb0 2023-09-30T16:50:12.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134003fc0 0x7f01340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014cab8640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 0x7f01340039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f014d2b9640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134004d10 0x7f0134005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 -- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 msgr2=0x7f01340039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01480d1fb0 0x7f01340039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 -- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134004d10 msgr2=0x7f0134005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134004d10 0x7f0134005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.838+0000 7f0147fff640 1 -- 172.21.15.52:0/2851460751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134003530 con 0x7f0134003fc0 2023-09-30T16:50:12.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f0147fff640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134003fc0 0x7f01340047d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f013000c160 tx=0x7f013001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40212320fe8f1145 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300058e0 con 0x7f0134003fc0 2023-09-30T16:50:12.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130005a40 con 0x7f0134003fc0 2023-09-30T16:50:12.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f01477fe640 1 -- 172.21.15.52:0/2851460751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130005e30 con 0x7f0134003fc0 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 -- 172.21.15.52:0/2851460751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134003fc0 msgr2=0x7f01340047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 --2- 172.21.15.52:0/2851460751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134003fc0 0x7f01340047d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f013000c160 tx=0x7f013001cb80 comp rx=0 tx=0).stop 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014d2b9640 1 -- 172.21.15.52:0/2851460751 reap_dead start 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 -- 172.21.15.52:0/2851460751 shutdown_connections 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 -- 172.21.15.52:0/2851460751 >> 172.21.15.52:0/2851460751 conn(0x7f0148071930 msgr2=0x7f0148071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 -- 172.21.15.52:0/2851460751 shutdown_connections 2023-09-30T16:50:12.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 -- 172.21.15.52:0/2851460751 wait complete. 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 Processor -- start 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.842+0000 7f014ed1c640 1 -- start start 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134003fc0 0x7f014815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 0x7f01480c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0148150c20 0x7f01481510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014814f340 con 0x7f014815f490 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148151610 con 0x7f0134003fc0 2023-09-30T16:50:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014815daf0 con 0x7f0148150c20 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 0x7f01480c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 0x7f01480c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43300/0 (socket says 172.21.15.52:43300) 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 -- 172.21.15.52:0/646816987 learned_addr learned my addr 172.21.15.52:0/646816987 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014d2b9640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0148150c20 0x7f01481510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 -- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0148150c20 msgr2=0x7f01481510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0148150c20 0x7f01481510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014cab8640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134003fc0 0x7f014815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 -- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134003fc0 msgr2=0x7f014815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134003fc0 0x7f014815d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 -- 172.21.15.52:0/646816987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480c8630 con 0x7f014815f490 2023-09-30T16:50:12.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f0147fff640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 0x7f01480c80f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0130007040 tx=0x7f0134005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300a5a90 con 0x7f014815f490 2023-09-30T16:50:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300a5bf0 con 0x7f014815f490 2023-09-30T16:50:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300047f0 con 0x7f014815f490 2023-09-30T16:50:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014814e6c0 con 0x7f014815f490 2023-09-30T16:50:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014814ec80 con 0x7f014815f490 2023-09-30T16:50:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01480740a0 con 0x7f014815f490 2023-09-30T16:50:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f0130004950 con 0x7f014815f490 2023-09-30T16:50:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f01457fa640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0128066190 0x7f0128068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f013011d420 con 0x7f014815f490 2023-09-30T16:50:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.846+0000 7f014cab8640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0128066190 0x7f0128068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.850+0000 7f014cab8640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0128066190 0x7f0128068650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0148072420 tx=0x7f014000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:12.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:12.850+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f01300ead90 con 0x7f014815f490 2023-09-30T16:50:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.002+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0148071ee0 con 0x7f014815f490 2023-09-30T16:50:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.002+0000 7f01457fa640 1 -- 172.21.15.52:0/646816987 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f01300bd020 con 0x7f014815f490 2023-09-30T16:50:13.005 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:13.005 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-09-30T16:50:13.005 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-09-30T16:50:13.005 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-09-30T16:50:13.006 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2023-09-30T16:50:13.006 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:13.006 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-09-30T16:50:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0128066190 msgr2=0x7f0128068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0128066190 0x7f0128068650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0148072420 tx=0x7f014000b040 comp rx=0 tx=0).stop 2023-09-30T16:50:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 msgr2=0x7f01480c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 0x7f01480c80f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0130007040 tx=0x7f0134005800 comp rx=0 tx=0).stop 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 shutdown_connections 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0128066190 0x7f0128068650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0148150c20 0x7f01481510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815f490 0x7f01480c80f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 --2- 172.21.15.52:0/646816987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0134003fc0 0x7f014815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 >> 172.21.15.52:0/646816987 conn(0x7f0148071930 msgr2=0x7f014815b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 shutdown_connections 2023-09-30T16:50:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.006+0000 7f014ed1c640 1 -- 172.21.15.52:0/646816987 wait complete. 2023-09-30T16:50:13.023 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T16:50:13.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T16:50:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 Processor -- start 2023-09-30T16:50:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 -- start start 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa34006d060 0x7fa3400b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3400c9460 0x7fa3400b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3400aded0 con 0x7fa340159080 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa340159460 con 0x7fa3400c9460 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa345cf0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34006d510 con 0x7fa34006d060 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3400c9460 0x7fa3400b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3400c9460 0x7fa3400b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43316/0 (socket says 172.21.15.52:43316) 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 -- 172.21.15.52:0/1498586390 learned_addr learned my addr 172.21.15.52:0/1498586390 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33effd640 1 --2- 172.21.15.52:0/1498586390 >> v2:172.21.15.186:3300/0 conn(0x7fa34006d060 0x7fa3400b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 -- 172.21.15.52:0/1498586390 >> v2:172.21.15.186:3300/0 conn(0x7fa34006d060 msgr2=0x7fa3400b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 --2- 172.21.15.52:0/1498586390 >> v2:172.21.15.186:3300/0 conn(0x7fa34006d060 0x7fa3400b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 -- 172.21.15.52:0/1498586390 >> v1:172.21.15.186:6789/0 conn(0x7fa340159080 legacy=0x7fa34006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.138+0000 7fa33ffff640 1 -- 172.21.15.52:0/1498586390 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34006d7f0 con 0x7fa3400c9460 2023-09-30T16:50:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa33ffff640 1 --2- 172.21.15.52:0/1498586390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3400c9460 0x7fa3400b05e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa340071610 tx=0x7fa33001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1608b950d584acb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa33e7fc640 1 -- 172.21.15.52:0/1498586390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300a57a0 con 0x7fa3400c9460 2023-09-30T16:50:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa33e7fc640 1 -- 172.21.15.52:0/1498586390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3300a5900 con 0x7fa3400c9460 2023-09-30T16:50:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa33e7fc640 1 -- 172.21.15.52:0/1498586390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300a5c90 con 0x7fa3400c9460 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 -- 172.21.15.52:0/1498586390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3400c9460 msgr2=0x7fa3400b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 --2- 172.21.15.52:0/1498586390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3400c9460 0x7fa3400b05e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa340071610 tx=0x7fa33001c960 comp rx=0 tx=0).stop 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 -- 172.21.15.52:0/1498586390 shutdown_connections 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 --2- 172.21.15.52:0/1498586390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3400c9460 0x7fa3400b05e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 --2- 172.21.15.52:0/1498586390 >> v2:172.21.15.186:3300/0 conn(0x7fa34006d060 0x7fa3400b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 -- 172.21.15.52:0/1498586390 >> 172.21.15.52:0/1498586390 conn(0x7fa34006a5c0 msgr2=0x7fa3400ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 -- 172.21.15.52:0/1498586390 shutdown_connections 2023-09-30T16:50:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.142+0000 7fa345cf0640 1 -- 172.21.15.52:0/1498586390 wait complete. 2023-09-30T16:50:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 Processor -- start 2023-09-30T16:50:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- start start 2023-09-30T16:50:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 0x7fa3400cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3400c9460 0x7fa340150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa340159080 0x7fa340147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400cb300 con 0x7fa34006d060 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400cad30 con 0x7fa340159080 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa340150270 con 0x7fa3400c9460 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 0x7fa3400cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 0x7fa3400cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43318/0 (socket says 172.21.15.52:43318) 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 -- 172.21.15.52:0/3787741260 learned_addr learned my addr 172.21.15.52:0/3787741260 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 -- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3400c9460 msgr2=0x7fa340150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3400c9460 0x7fa340150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33ffff640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa340159080 0x7fa340147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 -- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa340159080 msgr2=0x7fa340147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa340159080 0x7fa340147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 -- 172.21.15.52:0/3787741260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009b30 con 0x7fa34006d060 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa33f7fe640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 0x7fa3400cb720 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa33800b410 tx=0x7fa33800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338004020 con 0x7fa34006d060 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa338004180 con 0x7fa34006d060 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34014fcb0 con 0x7fa34006d060 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338011630 con 0x7fa34006d060 2023-09-30T16:50:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3400caf20 con 0x7fa34006d060 2023-09-30T16:50:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3400cb440 con 0x7fa34006d060 2023-09-30T16:50:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa338011790 con 0x7fa34006d060 2023-09-30T16:50:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa337fff640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa320066160 0x7fa320068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.146+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3380833f0 con 0x7fa34006d060 2023-09-30T16:50:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.150+0000 7fa33effd640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa320066160 0x7fa320068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.150+0000 7fa33effd640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa320066160 0x7fa320068620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa3401544e0 tx=0x7fa328008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:13.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.150+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fa3400cb440 con 0x7fa34006d060 2023-09-30T16:50:13.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.298+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa3400cb440 con 0x7fa34006d060 2023-09-30T16:50:13.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.982+0000 7fa337fff640 1 -- 172.21.15.52:0/3787741260 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa3400cb440 con 0x7fa34006d060 2023-09-30T16:50:13.986 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa320066160 msgr2=0x7fa320068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa320066160 0x7fa320068620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa3401544e0 tx=0x7fa328008040 comp rx=0 tx=0).stop 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 msgr2=0x7fa3400cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 0x7fa3400cb720 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa33800b410 tx=0x7fa33800b8d0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 shutdown_connections 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa320066160 0x7fa320068620 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa340159080 0x7fa340147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3400c9460 0x7fa340150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 --2- 172.21.15.52:0/3787741260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa34006d060 0x7fa3400cb720 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 >> 172.21.15.52:0/3787741260 conn(0x7fa34006a5c0 msgr2=0x7fa3400ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:13.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 shutdown_connections 2023-09-30T16:50:13.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:13.986+0000 7fa345cf0640 1 -- 172.21.15.52:0/3787741260 wait complete. 2023-09-30T16:50:14.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T16:50:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba7e53640 1 Processor -- start 2023-09-30T16:50:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba7e53640 1 -- start start 2023-09-30T16:50:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba7e53640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4ba00c9d20 0x7f4ba0070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba7e53640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba015d3a0 con 0x7f4ba0159780 2023-09-30T16:50:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba7e53640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba006db80 con 0x7f4ba00ca1a0 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba7e53640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00cd740 con 0x7f4ba00c9d20 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba5bef640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4ba0159780 0x7f4ba006d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60816/0 (socket says 172.21.15.52:60816) 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba5bef640 1 -- 172.21.15.52:0/3597970699 learned_addr learned my addr 172.21.15.52:0/3597970699 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628490365 0 0) 0x7f4ba015d3a0 con 0x7f4ba0159780 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c005740 con 0x7f4ba0159780 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/3597970699 >> v2:172.21.15.186:3300/0 conn(0x7f4ba00c9d20 0x7f4ba0070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1523627474 0 0) 0x7f4b8c005740 con 0x7f4ba0159780 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 >> v2:172.21.15.186:3300/0 conn(0x7f4ba00c9d20 msgr2=0x7f4ba0070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 --2- 172.21.15.52:0/3597970699 >> v2:172.21.15.186:3300/0 conn(0x7f4ba00c9d20 0x7f4ba0070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 >> v1:172.21.15.186:6789/0 conn(0x7f4ba00ca1a0 legacy=0x7f4ba015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00cda20 con 0x7f4ba0159780 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/3597970699 >> v2:172.21.15.186:3300/0 conn(0x7f4ba00c9d20 0x7f4ba0070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f4b9c001680 con 0x7f4ba0159780 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 >> v1:172.21.15.52:6789/0 conn(0x7f4ba0159780 legacy=0x7f4ba006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8c005b90 0x7f4b8c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.154+0000 7f4ba4bed640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b8c0069e0 0x7f4b8c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0074c0 0x7f4b8c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00cd740 con 0x7f4b8c0069e0 2023-09-30T16:50:14.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c00e390 con 0x7f4b8c0074c0 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c00e550 con 0x7f4b8c005b90 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b8c0069e0 0x7f4b8c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba5bef640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8c005b90 0x7f4b8c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba63f0640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0074c0 0x7f4b8c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 -- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8c005b90 msgr2=0x7f4b8c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8c005b90 0x7f4b8c005fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 -- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0074c0 msgr2=0x7f4b8c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0074c0 0x7f4b8c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 -- 172.21.15.52:0/3597970699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c005740 con 0x7f4b8c0069e0 2023-09-30T16:50:14.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba63f0640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0074c0 0x7f4b8c00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba63f0640 1 -- 172.21.15.52:0/3597970699 reap_dead start 2023-09-30T16:50:14.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b8c0069e0 0x7f4b8c006e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b900098a0 tx=0x7f4b9001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2a458acfd10a68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900a9630 con 0x7f4b8c0069e0 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b900a9790 con 0x7f4b8c0069e0 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba4bed640 1 -- 172.21.15.52:0/3597970699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900a9b00 con 0x7f4b8c0069e0 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 -- 172.21.15.52:0/3597970699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b8c0069e0 msgr2=0x7f4b8c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b8c0069e0 0x7f4b8c006e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b900098a0 tx=0x7f4b9001c540 comp rx=0 tx=0).stop 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 -- 172.21.15.52:0/3597970699 shutdown_connections 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/3597970699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b8c0069e0 0x7f4b8c006e60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 -- 172.21.15.52:0/3597970699 >> 172.21.15.52:0/3597970699 conn(0x7f4ba006a5c0 msgr2=0x7f4ba00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 -- 172.21.15.52:0/3597970699 shutdown_connections 2023-09-30T16:50:14.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.158+0000 7f4ba7e53640 1 -- 172.21.15.52:0/3597970699 wait complete. 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 Processor -- start 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- start start 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0069e0 0x7f4ba00c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ba0159b60 0x7f4ba0152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 0x7f4ba00c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00ac2b0 con 0x7f4ba0152c50 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00ab980 con 0x7f4b8c0069e0 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00abc60 con 0x7f4ba0159b60 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 0x7f4ba00c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 0x7f4ba00c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43340/0 (socket says 172.21.15.52:43340) 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 -- 172.21.15.52:0/2670959902 learned_addr learned my addr 172.21.15.52:0/2670959902 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba5bef640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0069e0 0x7f4ba00c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba53ee640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ba0159b60 0x7f4ba0152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 -- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ba0159b60 msgr2=0x7f4ba0152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ba0159b60 0x7f4ba0152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 -- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0069e0 msgr2=0x7f4ba00c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0069e0 0x7f4ba00c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 -- 172.21.15.52:0/2670959902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00abf40 con 0x7f4ba0152c50 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba63f0640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 0x7f4ba00c6cb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00adaa0 tx=0x7f4b9800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98003b80 con 0x7f4ba0152c50 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98003d00 con 0x7f4ba0152c50 2023-09-30T16:50:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba01530d0 con 0x7f4ba0152c50 2023-09-30T16:50:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980052b0 con 0x7f4ba0152c50 2023-09-30T16:50:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba0159fe0 con 0x7f4ba0152c50 2023-09-30T16:50:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba00ac0d0 con 0x7f4ba0152c50 2023-09-30T16:50:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.162+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f4b98005410 con 0x7f4ba0152c50 2023-09-30T16:50:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.166+0000 7f4b967fc640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4b84066160 0x7f4b84068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.166+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4b98083670 con 0x7f4ba0152c50 2023-09-30T16:50:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.166+0000 7f4ba5bef640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4b84066160 0x7f4b84068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.166+0000 7f4ba5bef640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4b84066160 0x7f4b84068620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001210 tx=0x7f4b9c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:14.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.170+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f4b98050e50 con 0x7f4ba0152c50 2023-09-30T16:50:14.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.318+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4ba00740a0 con 0x7f4ba0152c50 2023-09-30T16:50:14.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.990+0000 7f4b967fc640 1 -- 172.21.15.52:0/2670959902 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b98018020 con 0x7f4ba0152c50 2023-09-30T16:50:14.991 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-09-30T16:50:14.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4b84066160 msgr2=0x7f4b84068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4b84066160 0x7f4b84068620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001210 tx=0x7f4b9c009040 comp rx=0 tx=0).stop 2023-09-30T16:50:14.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 msgr2=0x7f4ba00c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:14.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 0x7f4ba00c6cb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00adaa0 tx=0x7f4b9800db80 comp rx=0 tx=0).stop 2023-09-30T16:50:14.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 shutdown_connections 2023-09-30T16:50:14.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4b84066160 0x7f4b84068620 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba0152c50 0x7f4ba00c6cb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ba0159b60 0x7f4ba0152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 --2- 172.21.15.52:0/2670959902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8c0069e0 0x7f4ba00c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:14.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 >> 172.21.15.52:0/2670959902 conn(0x7f4ba006a5c0 msgr2=0x7f4ba014fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:14.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 shutdown_connections 2023-09-30T16:50:14.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:14.994+0000 7f4ba7e53640 1 -- 172.21.15.52:0/2670959902 wait complete. 2023-09-30T16:50:15.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T16:50:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 Processor -- start 2023-09-30T16:50:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 -- start start 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe588159780 0x7fe58806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe58806d9b0 0x7fe5880c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58815d3a0 con 0x7fe5880ca260 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880cd740 con 0x7fe58806d9b0 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58fd25640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880cda20 con 0x7fe588159780 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe58806d9b0 0x7fe5880c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe58806d9b0 0x7fe5880c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43344/0 (socket says 172.21.15.52:43344) 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 -- 172.21.15.52:0/3445583738 learned_addr learned my addr 172.21.15.52:0/3445583738 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58dac1640 1 --2- 172.21.15.52:0/3445583738 >> v2:172.21.15.186:3300/0 conn(0x7fe588159780 0x7fe58806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 -- 172.21.15.52:0/3445583738 >> v2:172.21.15.186:3300/0 conn(0x7fe588159780 msgr2=0x7fe58806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 --2- 172.21.15.52:0/3445583738 >> v2:172.21.15.186:3300/0 conn(0x7fe588159780 0x7fe58806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 -- 172.21.15.52:0/3445583738 >> v1:172.21.15.52:6789/0 conn(0x7fe5880ca260 legacy=0x7fe588070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 -- 172.21.15.52:0/3445583738 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880cdd00 con 0x7fe58806d9b0 2023-09-30T16:50:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58dac1640 1 --2- 172.21.15.52:0/3445583738 >> v2:172.21.15.186:3300/0 conn(0x7fe588159780 0x7fe58806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.154+0000 7fe58d2c0640 1 --2- 172.21.15.52:0/3445583738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806d9b0 0x7fe5880c9d20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe5880ce580 tx=0x7fe57801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9705ddf1a8476469 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58cabf640 1 -- 172.21.15.52:0/3445583738 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578004230 con 0x7fe58806d9b0 2023-09-30T16:50:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58cabf640 1 -- 172.21.15.52:0/3445583738 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5780a7050 con 0x7fe58806d9b0 2023-09-30T16:50:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58cabf640 1 -- 172.21.15.52:0/3445583738 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578003620 con 0x7fe58806d9b0 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- 172.21.15.52:0/3445583738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806d9b0 msgr2=0x7fe5880c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 --2- 172.21.15.52:0/3445583738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806d9b0 0x7fe5880c9d20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe5880ce580 tx=0x7fe57801c440 comp rx=0 tx=0).stop 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- 172.21.15.52:0/3445583738 shutdown_connections 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 --2- 172.21.15.52:0/3445583738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806d9b0 0x7fe5880c9d20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 --2- 172.21.15.52:0/3445583738 >> v2:172.21.15.186:3300/0 conn(0x7fe588159780 0x7fe58806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- 172.21.15.52:0/3445583738 >> 172.21.15.52:0/3445583738 conn(0x7fe58806a5c0 msgr2=0x7fe5880ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- 172.21.15.52:0/3445583738 shutdown_connections 2023-09-30T16:50:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- 172.21.15.52:0/3445583738 wait complete. 2023-09-30T16:50:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 Processor -- start 2023-09-30T16:50:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- start start 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 0x7fe588149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe588159780 0x7fe5881516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe588151c00 0x7fe5881520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58815ce90 con 0x7fe5880ca260 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5881525f0 con 0x7fe588159780 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58fd25640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe588152ad0 con 0x7fe588151c00 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58dac1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 0x7fe588149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58dac1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 0x7fe588149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43346/0 (socket says 172.21.15.52:43346) 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58dac1640 1 -- 172.21.15.52:0/1949516036 learned_addr learned my addr 172.21.15.52:0/1949516036 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58d2c0640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe588159780 0x7fe5881516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58e2c2640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe588151c00 0x7fe5881520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58dac1640 1 -- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe588151c00 msgr2=0x7fe5881520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.158+0000 7fe58dac1640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe588151c00 0x7fe5881520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58dac1640 1 -- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe588159780 msgr2=0x7fe5881516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58dac1640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe588159780 0x7fe5881516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58dac1640 1 -- 172.21.15.52:0/1949516036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780094d0 con 0x7fe5880ca260 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58dac1640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 0x7fe588149a60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe58400c7f0 tx=0x7fe58400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584007820 con 0x7fe5880ca260 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584007980 con 0x7fe5880ca260 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58815c210 con 0x7fe5880ca260 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584007d30 con 0x7fe5880ca260 2023-09-30T16:50:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58815c7d0 con 0x7fe5880ca260 2023-09-30T16:50:15.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe588153930 con 0x7fe5880ca260 2023-09-30T16:50:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe584024480 con 0x7fe5880ca260 2023-09-30T16:50:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe57e7fc640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe56c066160 0x7fe56c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe5840841d0 con 0x7fe5880ca260 2023-09-30T16:50:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.162+0000 7fe58d2c0640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe56c066160 0x7fe56c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.166+0000 7fe58d2c0640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe56c066160 0x7fe56c068620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe5780ad000 tx=0x7fe578009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.166+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe5840518c0 con 0x7fe5880ca260 2023-09-30T16:50:15.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:15.354+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe5880740a0 con 0x7fe5880ca260 2023-09-30T16:50:16.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.074+0000 7fe57e7fc640 1 -- 172.21.15.52:0/1949516036 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe584054ee0 con 0x7fe5880ca260 2023-09-30T16:50:16.078 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 4 and data pool 5 2023-09-30T16:50:16.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe56c066160 msgr2=0x7fe56c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe56c066160 0x7fe56c068620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe5780ad000 tx=0x7fe578009040 comp rx=0 tx=0).stop 2023-09-30T16:50:16.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 msgr2=0x7fe588149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 0x7fe588149a60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe58400c7f0 tx=0x7fe58400ccb0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 shutdown_connections 2023-09-30T16:50:16.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe56c066160 0x7fe56c068620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe588151c00 0x7fe5881520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe588159780 0x7fe5881516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 --2- 172.21.15.52:0/1949516036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5880ca260 0x7fe588149a60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 >> 172.21.15.52:0/1949516036 conn(0x7fe58806a5c0 msgr2=0x7fe5880af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:16.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 shutdown_connections 2023-09-30T16:50:16.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.086+0000 7fe58fd25640 1 -- 172.21.15.52:0/1949516036 wait complete. 2023-09-30T16:50:16.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:16.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 Processor -- start 2023-09-30T16:50:16.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 -- start start 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15e4b0 0x7ffb2c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb2c0b19b0 0x7ffb2c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c06c240 con 0x7ffb2c15a9d0 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c15adb0 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb315c7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15ea90 con 0x7ffb2c15e4b0 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb2c0b19b0 0x7ffb2c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb2c0b19b0 0x7ffb2c0b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44654/0 (socket says 172.21.15.52:44654) 2023-09-30T16:50:16.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 -- 172.21.15.52:0/3537089912 learned_addr learned my addr 172.21.15.52:0/3537089912 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:16.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 -- 172.21.15.52:0/3537089912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15e4b0 msgr2=0x7ffb2c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:16.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 --2- 172.21.15.52:0/3537089912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15e4b0 0x7ffb2c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 -- 172.21.15.52:0/3537089912 >> v1:172.21.15.186:6789/0 conn(0x7ffb2c15a9d0 legacy=0x7ffb2c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:16.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 -- 172.21.15.52:0/3537089912 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c15ed70 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.234+0000 7ffb2b7fe640 1 --2- 172.21.15.52:0/3537089912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c0b00a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009870 tx=0x7ffb2401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3a9698f802a38b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb29ffb640 1 -- 172.21.15.52:0/3537089912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240ab600 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb29ffb640 1 -- 172.21.15.52:0/3537089912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb240a7050 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb29ffb640 1 -- 172.21.15.52:0/3537089912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240ab980 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/3537089912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 msgr2=0x7ffb2c0b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 --2- 172.21.15.52:0/3537089912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c0b00a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009870 tx=0x7ffb2401c500 comp rx=0 tx=0).stop 2023-09-30T16:50:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/3537089912 shutdown_connections 2023-09-30T16:50:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 --2- 172.21.15.52:0/3537089912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c0b00a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 --2- 172.21.15.52:0/3537089912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15e4b0 0x7ffb2c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/3537089912 >> 172.21.15.52:0/3537089912 conn(0x7ffb2c06a5f0 msgr2=0x7ffb2c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/3537089912 shutdown_connections 2023-09-30T16:50:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/3537089912 wait complete. 2023-09-30T16:50:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 Processor -- start 2023-09-30T16:50:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- start start 2023-09-30T16:50:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15a9d0 0x7ffb2c15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb2c15e4b0 0x7ffb2c0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c153b30 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15d870 con 0x7ffb2c15e4b0 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c153470 con 0x7ffb2c15a9d0 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c1526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44664/0 (socket says 172.21.15.52:44664) 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 -- 172.21.15.52:0/1217924825 learned_addr learned my addr 172.21.15.52:0/1217924825 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2b7fe640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb2c15e4b0 0x7ffb2c0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 -- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15a9d0 msgr2=0x7ffb2c15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15a9d0 0x7ffb2c15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 -- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb2c15e4b0 msgr2=0x7ffb2c0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb2c15e4b0 0x7ffb2c0cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 -- 172.21.15.52:0/1217924825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240094d0 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2b7fe640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb2c15e4b0 0x7ffb2c0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb2affd640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c1526a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00c7a0 tx=0x7ffb1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c003d90 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c005070 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c153750 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c005460 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.238+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c15d4d0 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.242+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c0740a0 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.242+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ffb1c0055c0 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.242+0000 7ffb237fe640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb0c066190 0x7ffb0c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.242+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb1c082e70 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.242+0000 7ffb2a7fc640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb0c066190 0x7ffb0c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.242+0000 7ffb2a7fc640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb0c066190 0x7ffb0c068650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c1f9650 tx=0x7ffb14006c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.246+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ffb1c050520 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.402+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb2c1538e0 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.406+0000 7ffb237fe640 1 -- 172.21.15.52:0/1217924825 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16534 (secure 0 0 0) 0x7ffb1c053b40 con 0x7ffb2c0b19b0 2023-09-30T16:50:16.409 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:16.409 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:50:15.359436+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:50:13.342272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-30T16:50:14.359534+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb0c066190 msgr2=0x7ffb0c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb0c066190 0x7ffb0c068650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c1f9650 tx=0x7ffb14006c00 comp rx=0 tx=0).stop 2023-09-30T16:50:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 msgr2=0x7ffb2c1526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c1526a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00c7a0 tx=0x7ffb1c00cc60 comp rx=0 tx=0).stop 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 shutdown_connections 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ffb0c066190 0x7ffb0c068650 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb2c15e4b0 0x7ffb2c0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb2c15a9d0 0x7ffb2c15cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 --2- 172.21.15.52:0/1217924825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb2c0b19b0 0x7ffb2c1526a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 >> 172.21.15.52:0/1217924825 conn(0x7ffb2c06a5f0 msgr2=0x7ffb2c155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 shutdown_connections 2023-09-30T16:50:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.410+0000 7ffb315c7640 1 -- 172.21.15.52:0/1217924825 wait complete. 2023-09-30T16:50:16.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.542+0000 7fb7e9e0a640 1 Processor -- start 2023-09-30T16:50:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e9e0a640 1 -- start start 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e9e0a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7e41574c0 0x7fb7e40cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e9e0a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb7e4159df0 0x7fb7e406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e9e0a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e40ce2f0 con 0x7fb7e406c180 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e9e0a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e415ae50 con 0x7fb7e41574c0 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e9e0a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e41578a0 con 0x7fb7e4159df0 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e37fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7e41574c0 0x7fb7e40cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e3fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb7e406c180 0x7fb7e40ca590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40842/0 (socket says 172.21.15.52:40842) 2023-09-30T16:50:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e3fff640 1 -- 172.21.15.52:0/219303435 learned_addr learned my addr 172.21.15.52:0/219303435 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e2ffd640 1 --2- 172.21.15.52:0/219303435 >> v2:172.21.15.186:3300/0 conn(0x7fb7e4159df0 0x7fb7e406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e27fc640 1 -- 172.21.15.52:0/219303435 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248649624 0 0) 0x7fb7e40ce2f0 con 0x7fb7e406c180 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e27fc640 1 -- 172.21.15.52:0/219303435 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d0003530 con 0x7fb7e406c180 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e37fe640 1 -- 172.21.15.52:0/219303435 >> v2:172.21.15.186:3300/0 conn(0x7fb7e4159df0 msgr2=0x7fb7e406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e37fe640 1 --2- 172.21.15.52:0/219303435 >> v2:172.21.15.186:3300/0 conn(0x7fb7e4159df0 0x7fb7e406bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e37fe640 1 -- 172.21.15.52:0/219303435 >> v1:172.21.15.52:6789/0 conn(0x7fb7e406c180 legacy=0x7fb7e40ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e37fe640 1 -- 172.21.15.52:0/219303435 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40c9dd0 con 0x7fb7e41574c0 2023-09-30T16:50:16.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.546+0000 7fb7e2ffd640 1 --2- 172.21.15.52:0/219303435 >> v2:172.21.15.186:3300/0 conn(0x7fb7e4159df0 0x7fb7e406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:16.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e37fe640 1 --2- 172.21.15.52:0/219303435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e40cddb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb7e41579e0 tx=0x7fb7d401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2598e0b3992d7840 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e27fc640 1 -- 172.21.15.52:0/219303435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a59a0 con 0x7fb7e41574c0 2023-09-30T16:50:16.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e27fc640 1 -- 172.21.15.52:0/219303435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d40a5b00 con 0x7fb7e41574c0 2023-09-30T16:50:16.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e27fc640 1 -- 172.21.15.52:0/219303435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5e70 con 0x7fb7e41574c0 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/219303435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 msgr2=0x7fb7e40cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/219303435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e40cddb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb7e41579e0 tx=0x7fb7d401c8e0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/219303435 shutdown_connections 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/219303435 >> v2:172.21.15.186:3300/0 conn(0x7fb7e4159df0 0x7fb7e406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/219303435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e40cddb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/219303435 >> 172.21.15.52:0/219303435 conn(0x7fb7e406a5f0 msgr2=0x7fb7e40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/219303435 shutdown_connections 2023-09-30T16:50:16.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/219303435 wait complete. 2023-09-30T16:50:16.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 Processor -- start 2023-09-30T16:50:16.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- start start 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7e406c180 0x7fb7e40c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7e4159df0 0x7fb7e40c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4151960 con 0x7fb7e41574c0 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4167d40 con 0x7fb7e406c180 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e9e0a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4168020 con 0x7fb7e4159df0 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e4150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44678/0 (socket says 172.21.15.52:44678) 2023-09-30T16:50:16.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 -- 172.21.15.52:0/274922142 learned_addr learned my addr 172.21.15.52:0/274922142 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e3fff640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7e4159df0 0x7fb7e40c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e37fe640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7e406c180 0x7fb7e40c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 -- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7e4159df0 msgr2=0x7fb7e40c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7e4159df0 0x7fb7e40c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 -- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7e406c180 msgr2=0x7fb7e40c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.550+0000 7fb7e2ffd640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7e406c180 0x7fb7e40c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e2ffd640 1 -- 172.21.15.52:0/274922142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4009a70 con 0x7fb7e41574c0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e37fe640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7e406c180 0x7fb7e40c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e2ffd640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e4150dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00d800 tx=0x7fb7cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00b6c0 con 0x7fb7e41574c0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc00b820 con 0x7fb7e41574c0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e40c6a40 con 0x7fb7e41574c0 2023-09-30T16:50:16.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00bbd0 con 0x7fb7e41574c0 2023-09-30T16:50:16.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e40c88d0 con 0x7fb7e41574c0 2023-09-30T16:50:16.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e40740a0 con 0x7fb7e41574c0 2023-09-30T16:50:16.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fb7cc00bd30 con 0x7fb7e41574c0 2023-09-30T16:50:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7dbfff640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb7c4066160 0x7fb7c4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7cc083f80 con 0x7fb7e41574c0 2023-09-30T16:50:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e37fe640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb7c4066160 0x7fb7c4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.554+0000 7fb7e37fe640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb7c4066160 0x7fb7c4068620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40af000 tx=0x7fb7d40a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.558+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fb7cc0b4ed0 con 0x7fb7e41574c0 2023-09-30T16:50:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.714+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7e41640b0 con 0x7fb7e41574c0 2023-09-30T16:50:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7dbfff640 1 -- 172.21.15.52:0/274922142 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16534 (secure 0 0 0) 0x7fb7cc055030 con 0x7fb7e41574c0 2023-09-30T16:50:16.719 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:16.719 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:50:15.359436+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:50:13.342272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-30T16:50:14.359534+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb7c4066160 msgr2=0x7fb7c4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb7c4066160 0x7fb7c4068620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40af000 tx=0x7fb7d40a7070 comp rx=0 tx=0).stop 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 msgr2=0x7fb7e4150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e4150dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00d800 tx=0x7fb7cc00dcc0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 shutdown_connections 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fb7c4066160 0x7fb7c4068620 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7e4159df0 0x7fb7e40c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7e41574c0 0x7fb7e4150dd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 --2- 172.21.15.52:0/274922142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7e406c180 0x7fb7e40c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 >> 172.21.15.52:0/274922142 conn(0x7fb7e406a5f0 msgr2=0x7fb7e4156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 shutdown_connections 2023-09-30T16:50:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.718+0000 7fb7e9e0a640 1 -- 172.21.15.52:0/274922142 wait complete. 2023-09-30T16:50:16.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T16:50:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a526ab640 1 Processor -- start 2023-09-30T16:50:16.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a526ab640 1 -- start start 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a526ab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a4c070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a526ab640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c15d3a0 con 0x7f7a4c159780 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a526ab640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c06db80 con 0x7f7a4c0ca1a0 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a526ab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0cd740 con 0x7f7a4c0c9d20 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7a4c159780 0x7f7a4c06d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40850/0 (socket says 172.21.15.52:40850) 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4bfff640 1 -- 172.21.15.52:0/2434027244 learned_addr learned my addr 172.21.15.52:0/2434027244 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4b7fe640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a4c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614616874 0 0) 0x7f7a4c15d3a0 con 0x7f7a4c159780 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a34003530 con 0x7f7a4c159780 2023-09-30T16:50:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589720367 0 0) 0x7f7a34003530 con 0x7f7a4c159780 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 msgr2=0x7f7a4c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a4c070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 >> v1:172.21.15.186:6789/0 conn(0x7f7a4c0ca1a0 legacy=0x7f7a4c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0cda20 con 0x7f7a4c159780 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f7a3c001680 con 0x7f7a4c159780 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 >> v1:172.21.15.52:6789/0 conn(0x7f7a4c159780 legacy=0x7f7a4c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a34003ef0 0x7f7a340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0cd740 con 0x7f7a34004d10 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3400bad0 con 0x7f7a34003ef0 2023-09-30T16:50:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3400bc90 con 0x7f7a4c0c9d20 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a50c48640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4bfff640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4b7fe640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a34003ef0 0x7f7a340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a50c48640 1 -- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 msgr2=0x7f7a340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a50c48640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a50c48640 1 -- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a34003ef0 msgr2=0x7f7a340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a50c48640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a34003ef0 0x7f7a340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a50c48640 1 -- 172.21.15.52:0/2434027244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34003530 con 0x7f7a34004d10 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.850+0000 7f7a4bfff640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c9d20 0x7f7a340039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a50c48640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a34005190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7a44001f60 tx=0x7f7a4401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78c8820784ac45c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440a6620 con 0x7f7a34004d10 2023-09-30T16:50:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440a6780 con 0x7f7a34004d10 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a4affd640 1 -- 172.21.15.52:0/2434027244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440a6b70 con 0x7f7a34004d10 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- 172.21.15.52:0/2434027244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 msgr2=0x7f7a34005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 --2- 172.21.15.52:0/2434027244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a34005190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7a44001f60 tx=0x7f7a4401c830 comp rx=0 tx=0).stop 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a50c48640 1 -- 172.21.15.52:0/2434027244 reap_dead start 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- 172.21.15.52:0/2434027244 shutdown_connections 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- 172.21.15.52:0/2434027244 >> 172.21.15.52:0/2434027244 conn(0x7f7a4c06a5c0 msgr2=0x7f7a4c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- 172.21.15.52:0/2434027244 shutdown_connections 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- 172.21.15.52:0/2434027244 wait complete. 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 Processor -- start 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- start start 2023-09-30T16:50:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a4c0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c5660 0x7f7a4c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4c0c5ae0 0x7f7a4c15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0c17f0 con 0x7f7a34004d10 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0c8d20 con 0x7f7a4c0c5ae0 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a526ab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c1414e0 con 0x7f7a4c0c5660 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a4bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a4c0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a4bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a4c0c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44704/0 (socket says 172.21.15.52:44704) 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.854+0000 7f7a4bfff640 1 -- 172.21.15.52:0/1336701659 learned_addr learned my addr 172.21.15.52:0/1336701659 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a50c48640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4c0c5ae0 0x7f7a4c15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4b7fe640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c5660 0x7f7a4c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4bfff640 1 -- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c5660 msgr2=0x7f7a4c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4bfff640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c5660 0x7f7a4c15f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4bfff640 1 -- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4c0c5ae0 msgr2=0x7f7a4c15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4bfff640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4c0c5ae0 0x7f7a4c15fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4bfff640 1 -- 172.21.15.52:0/1336701659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c1417c0 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4bfff640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a4c0c12b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00e8c0 tx=0x7f7a3c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00c8d0 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c00ca30 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c15b8e0 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00cda0 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c15bea0 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c15c0c0 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7a3c027430 con 0x7f7a34004d10 2023-09-30T16:50:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a48ff9640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7a38066160 0x7f7a38068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a3c0845e0 con 0x7f7a34004d10 2023-09-30T16:50:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4b7fe640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7a38066160 0x7f7a38068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.858+0000 7f7a4b7fe640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7a38066160 0x7f7a38068620 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c160380 tx=0x7f7a40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:16.862+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7a3c051ce0 con 0x7f7a34004d10 2023-09-30T16:50:17.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.042+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a4c0740a0 con 0x7f7a34004d10 2023-09-30T16:50:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.074+0000 7f7a48ff9640 1 -- 172.21.15.52:0/1336701659 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a3c055300 con 0x7f7a34004d10 2023-09-30T16:50:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7a38066160 msgr2=0x7f7a38068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7a38066160 0x7f7a38068620 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c160380 tx=0x7f7a40008040 comp rx=0 tx=0).stop 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 msgr2=0x7f7a4c0c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a4c0c12b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00e8c0 tx=0x7f7a3c00ed80 comp rx=0 tx=0).stop 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 shutdown_connections 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7a38066160 0x7f7a38068620 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a4c0c5ae0 0x7f7a4c15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a4c0c5660 0x7f7a4c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 --2- 172.21.15.52:0/1336701659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a34004d10 0x7f7a4c0c12b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 >> 172.21.15.52:0/1336701659 conn(0x7f7a4c06a5c0 msgr2=0x7f7a4c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 shutdown_connections 2023-09-30T16:50:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.078+0000 7f7a526ab640 1 -- 172.21.15.52:0/1336701659 wait complete. 2023-09-30T16:50:17.094 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T16:50:17.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T16:50:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.206+0000 7f41d9aa4640 1 Processor -- start 2023-09-30T16:50:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.206+0000 7f41d9aa4640 1 -- start start 2023-09-30T16:50:17.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d9aa4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41d415cb50 0x7f41d4070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d9aa4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d4160d30 0x7f41d4161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d9aa4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d4070f10 con 0x7f41d406d730 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d9aa4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d4161680 con 0x7f41d415cb50 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d9aa4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4070670 con 0x7f41d4160d30 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d2ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f41d406d730 0x7f41d40c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40862/0 (socket says 172.21.15.52:40862) 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d2ffd640 1 -- 172.21.15.52:0/1795358947 learned_addr learned my addr 172.21.15.52:0/1795358947 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d37fe640 1 --2- 172.21.15.52:0/1795358947 >> v2:172.21.15.52:3300/0 conn(0x7f41d415cb50 0x7f41d4070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d27fc640 1 -- 172.21.15.52:0/1795358947 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493392648 0 0) 0x7f41d4070f10 con 0x7f41d406d730 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d27fc640 1 -- 172.21.15.52:0/1795358947 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41bc003530 con 0x7f41d406d730 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d3fff640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d4160d30 0x7f41d4161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d37fe640 1 -- 172.21.15.52:0/1795358947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d4160d30 msgr2=0x7f41d4161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d37fe640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d4160d30 0x7f41d4161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d37fe640 1 -- 172.21.15.52:0/1795358947 >> v1:172.21.15.52:6789/0 conn(0x7f41d406d730 legacy=0x7f41d40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d37fe640 1 -- 172.21.15.52:0/1795358947 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4070950 con 0x7f41d415cb50 2023-09-30T16:50:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d3fff640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d4160d30 0x7f41d4161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d37fe640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d415cb50 0x7f41d4070070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f41c80097c0 tx=0x7f41c801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b56af98a30e830 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d27fc640 1 -- 172.21.15.52:0/1795358947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80a8970 con 0x7f41d415cb50 2023-09-30T16:50:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d27fc640 1 -- 172.21.15.52:0/1795358947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80a8ad0 con 0x7f41d415cb50 2023-09-30T16:50:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.210+0000 7f41d27fc640 1 -- 172.21.15.52:0/1795358947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80a8e60 con 0x7f41d415cb50 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/1795358947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d415cb50 msgr2=0x7f41d4070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d415cb50 0x7f41d4070070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f41c80097c0 tx=0x7f41c801ec70 comp rx=0 tx=0).stop 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/1795358947 shutdown_connections 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d4160d30 0x7f41d4161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/1795358947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d415cb50 0x7f41d4070070 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/1795358947 >> 172.21.15.52:0/1795358947 conn(0x7f41d406a5c0 msgr2=0x7f41d40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/1795358947 shutdown_connections 2023-09-30T16:50:17.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/1795358947 wait complete. 2023-09-30T16:50:17.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 Processor -- start 2023-09-30T16:50:17.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- start start 2023-09-30T16:50:17.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 0x7f41d41f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:17.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d415cb50 0x7f41d406c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:17.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d4160d30 0x7f41d406c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40c87d0 con 0x7f41d406d730 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d415e080 con 0x7f41d4160d30 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d415d750 con 0x7f41d415cb50 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 0x7f41d41f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 0x7f41d41f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44720/0 (socket says 172.21.15.52:44720) 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 -- 172.21.15.52:0/2201591807 learned_addr learned my addr 172.21.15.52:0/2201591807 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 -- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d415cb50 msgr2=0x7f41d406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d415cb50 0x7f41d406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d3fff640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d4160d30 0x7f41d406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 -- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d4160d30 msgr2=0x7f41d406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d4160d30 0x7f41d406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:17.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 -- 172.21.15.52:0/2201591807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8009420 con 0x7f41d406d730 2023-09-30T16:50:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d37fe640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 0x7f41d41f1f20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41c801c8a0 tx=0x7f41c801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b9630 con 0x7f41d406d730 2023-09-30T16:50:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80b97b0 con 0x7f41d406d730 2023-09-30T16:50:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d415da30 con 0x7f41d406d730 2023-09-30T16:50:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b9b60 con 0x7f41d406d730 2023-09-30T16:50:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.214+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d40c7ae0 con 0x7f41d406d730 2023-09-30T16:50:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.218+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d4160810 con 0x7f41d406d730 2023-09-30T16:50:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.218+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f41c80b7040 con 0x7f41d406d730 2023-09-30T16:50:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.218+0000 7f41bbfff640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f41c0066190 0x7f41c0068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.218+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41c8121940 con 0x7f41d406d730 2023-09-30T16:50:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.218+0000 7f41d2ffd640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f41c0066190 0x7f41c0068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.218+0000 7f41d2ffd640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f41c0066190 0x7f41c0068650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41c4007fd0 tx=0x7f41c4007940 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.222+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f41d4160810 con 0x7f41d406d730 2023-09-30T16:50:17.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:17.410+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41d4160810 con 0x7f41d406d730 2023-09-30T16:50:17.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:50:17.901 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:50:18.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.390+0000 7f41bbfff640 1 -- 172.21.15.52:0/2201591807 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41d4160810 con 0x7f41d406d730 2023-09-30T16:50:18.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f41c0066190 msgr2=0x7f41c0068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f41c0066190 0x7f41c0068650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41c4007fd0 tx=0x7f41c4007940 comp rx=0 tx=0).stop 2023-09-30T16:50:18.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 msgr2=0x7f41d41f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 0x7f41d41f1f20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41c801c8a0 tx=0x7f41c801ba10 comp rx=0 tx=0).stop 2023-09-30T16:50:18.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 shutdown_connections 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f41c0066190 0x7f41c0068650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d4160d30 0x7f41d406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d415cb50 0x7f41d406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 --2- 172.21.15.52:0/2201591807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d406d730 0x7f41d41f1f20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 >> 172.21.15.52:0/2201591807 conn(0x7f41d406a5c0 msgr2=0x7f41d40ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 shutdown_connections 2023-09-30T16:50:18.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.394+0000 7f41d9aa4640 1 -- 172.21.15.52:0/2201591807 wait complete. 2023-09-30T16:50:18.420 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T16:50:18.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:50:18.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.546+0000 7f211accc640 1 Processor -- start 2023-09-30T16:50:18.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.546+0000 7f211accc640 1 -- start start 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f211accc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f211415ce10 0x7f21140b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f211accc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f21140cd870 0x7f21140cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f211accc640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21140b7570 con 0x7f21140d0fa0 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f211accc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140b7850 con 0x7f211415ce10 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f211accc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140b7b30 con 0x7f21140cd870 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2119269640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f21140d0fa0 0x7f21140d1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40868/0 (socket says 172.21.15.52:40868) 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2118a68640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f211415ce10 0x7f21140b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2119269640 1 -- 172.21.15.52:0/2180402633 learned_addr learned my addr 172.21.15.52:0/2180402633 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2113fff640 1 --2- 172.21.15.52:0/2180402633 >> v2:172.21.15.186:3300/0 conn(0x7f21140cd870 0x7f21140cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2118a68640 1 -- 172.21.15.52:0/2180402633 >> v2:172.21.15.186:3300/0 conn(0x7f21140cd870 msgr2=0x7f21140cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2118a68640 1 --2- 172.21.15.52:0/2180402633 >> v2:172.21.15.186:3300/0 conn(0x7f21140cd870 0x7f21140cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2118a68640 1 -- 172.21.15.52:0/2180402633 >> v1:172.21.15.52:6789/0 conn(0x7f21140d0fa0 legacy=0x7f21140d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2118a68640 1 -- 172.21.15.52:0/2180402633 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140b7e10 con 0x7f211415ce10 2023-09-30T16:50:18.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f21137fe640 1 -- 172.21.15.52:0/2180402633 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218946214 0 0) 0x7f21140b7570 con 0x7f21140d0fa0 2023-09-30T16:50:18.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f2118a68640 1 --2- 172.21.15.52:0/2180402633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f211415ce10 0x7f21140b8800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f21140c64f0 tx=0x7f210401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef3152b561ac911 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:18.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f21137fe640 1 -- 172.21.15.52:0/2180402633 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040ab5f0 con 0x7f211415ce10 2023-09-30T16:50:18.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f21137fe640 1 -- 172.21.15.52:0/2180402633 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040ab750 con 0x7f211415ce10 2023-09-30T16:50:18.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.550+0000 7f21137fe640 1 -- 172.21.15.52:0/2180402633 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040abae0 con 0x7f211415ce10 2023-09-30T16:50:18.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/2180402633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f211415ce10 msgr2=0x7f21140b8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 --2- 172.21.15.52:0/2180402633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f211415ce10 0x7f21140b8800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f21140c64f0 tx=0x7f210401c3d0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/2180402633 shutdown_connections 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 --2- 172.21.15.52:0/2180402633 >> v2:172.21.15.186:3300/0 conn(0x7f21140cd870 0x7f21140cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 --2- 172.21.15.52:0/2180402633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f211415ce10 0x7f21140b8800 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/2180402633 >> 172.21.15.52:0/2180402633 conn(0x7f2114071930 msgr2=0x7f2114071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/2180402633 shutdown_connections 2023-09-30T16:50:18.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/2180402633 wait complete. 2023-09-30T16:50:18.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 Processor -- start 2023-09-30T16:50:18.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- start start 2023-09-30T16:50:18.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 0x7f211414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21140d0fa0 0x7f21141591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21141596e0 0x7f21140c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140c66d0 con 0x7f21140cd870 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2114152820 con 0x7f21140d0fa0 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140c68b0 con 0x7f21141596e0 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 0x7f211414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 0x7f211414db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44750/0 (socket says 172.21.15.52:44750) 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 -- 172.21.15.52:0/1479152283 learned_addr learned my addr 172.21.15.52:0/1479152283 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2113fff640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21140d0fa0 0x7f21141591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2119269640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21141596e0 0x7f21140c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 -- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21141596e0 msgr2=0x7f21140c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21141596e0 0x7f21140c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 -- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21140d0fa0 msgr2=0x7f21141591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21140d0fa0 0x7f21141591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 -- 172.21.15.52:0/1479152283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104009420 con 0x7f21140cd870 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f2118a68640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 0x7f211414db00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f210401a000 tx=0x7f210401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104004220 con 0x7f21140cd870 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040b9070 con 0x7f21140cd870 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21140c6b90 con 0x7f21140cd870 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104003620 con 0x7f21140cd870 2023-09-30T16:50:18.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.554+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21140c7150 con 0x7f21140cd870 2023-09-30T16:50:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.558+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21140740a0 con 0x7f21140cd870 2023-09-30T16:50:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.558+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f2104003780 con 0x7f21140cd870 2023-09-30T16:50:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.558+0000 7f21117fa640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2100066160 0x7f2100068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.558+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21040bb070 con 0x7f21140cd870 2023-09-30T16:50:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.558+0000 7f2113fff640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2100066160 0x7f2100068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.558+0000 7f2113fff640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2100066160 0x7f2100068620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f211415b860 tx=0x7f2108008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:18.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.562+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f21040ebe20 con 0x7f21140cd870 2023-09-30T16:50:18.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.746+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f211406a120 con 0x7f21140cd870 2023-09-30T16:50:18.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f21117fa640 1 -- 172.21.15.52:0/1479152283 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f21040c4020 con 0x7f21140cd870 2023-09-30T16:50:18.751 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:18.751 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:50:15.359964+0000","modified":"2023-09-30T16:50:17.412644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4945":{"gid":4945,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.186:6837/2755050347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2755050347},{"type":"v1","addr":"172.21.15.186:6837","nonce":2755050347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T16:50:18.751 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 14 2023-09-30T16:50:18.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2100066160 msgr2=0x7f2100068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2100066160 0x7f2100068620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f211415b860 tx=0x7f2108008040 comp rx=0 tx=0).stop 2023-09-30T16:50:18.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 msgr2=0x7f211414db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 0x7f211414db00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f210401a000 tx=0x7f210401ac10 comp rx=0 tx=0).stop 2023-09-30T16:50:18.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 shutdown_connections 2023-09-30T16:50:18.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2100066160 0x7f2100068620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21141596e0 0x7f21140c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21140d0fa0 0x7f21141591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 --2- 172.21.15.52:0/1479152283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21140cd870 0x7f211414db00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 >> 172.21.15.52:0/1479152283 conn(0x7f2114071930 msgr2=0x7f211415ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:18.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 shutdown_connections 2023-09-30T16:50:18.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.750+0000 7f211accc640 1 -- 172.21.15.52:0/1479152283 wait complete. 2023-09-30T16:50:18.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T16:50:18.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.886+0000 7f1d794fa640 1 Processor -- start 2023-09-30T16:50:18.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.886+0000 7f1d794fa640 1 -- start start 2023-09-30T16:50:18.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d794fa640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d7406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d794fa640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 0x7f1d740ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d794fa640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740c9dd0 con 0x7f1d741574c0 2023-09-30T16:50:18.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d794fa640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7415ae50 con 0x7f1d7406c180 2023-09-30T16:50:18.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d794fa640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d741578a0 con 0x7f1d74159df0 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d737fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 0x7f1d740ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d72ffd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f1d741574c0 0x7f1d740cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39242/0 (socket says 172.21.15.52:39242) 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d72ffd640 1 -- 172.21.15.52:0/3839426890 learned_addr learned my addr 172.21.15.52:0/3839426890 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d727fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d7406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d737fe640 1 --2- 172.21.15.52:0/3839426890 >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 0x7f1d740ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:60960/0 (socket says 172.21.15.52:60960) 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d727fc640 1 -- 172.21.15.52:0/3839426890 >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 msgr2=0x7f1d740ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d727fc640 1 --2- 172.21.15.52:0/3839426890 >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 0x7f1d740ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d727fc640 1 -- 172.21.15.52:0/3839426890 >> v1:172.21.15.186:6789/0 conn(0x7f1d741574c0 legacy=0x7f1d740cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d727fc640 1 -- 172.21.15.52:0/3839426890 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7415a5b0 con 0x7f1d74159df0 2023-09-30T16:50:18.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d737fe640 1 --2- 172.21.15.52:0/3839426890 >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 0x7f1d740ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T16:50:18.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.890+0000 7f1d727fc640 1 --2- 172.21.15.52:0/3839426890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d7406bc40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d680097c0 tx=0x7f1d6801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b8db0387c251 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:18.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d71ffb640 1 -- 172.21.15.52:0/3839426890 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680ad660 con 0x7f1d74159df0 2023-09-30T16:50:18.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d71ffb640 1 -- 172.21.15.52:0/3839426890 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680ad7c0 con 0x7f1d74159df0 2023-09-30T16:50:18.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d71ffb640 1 -- 172.21.15.52:0/3839426890 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680adb50 con 0x7f1d74159df0 2023-09-30T16:50:18.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- 172.21.15.52:0/3839426890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 msgr2=0x7f1d7406bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 --2- 172.21.15.52:0/3839426890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d7406bc40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d680097c0 tx=0x7f1d6801c450 comp rx=0 tx=0).stop 2023-09-30T16:50:18.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- 172.21.15.52:0/3839426890 shutdown_connections 2023-09-30T16:50:18.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 --2- 172.21.15.52:0/3839426890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d7406bc40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 --2- 172.21.15.52:0/3839426890 >> v2:172.21.15.186:3300/0 conn(0x7f1d7406c180 0x7f1d740ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- 172.21.15.52:0/3839426890 >> 172.21.15.52:0/3839426890 conn(0x7f1d7406a5f0 msgr2=0x7f1d740ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:18.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- 172.21.15.52:0/3839426890 shutdown_connections 2023-09-30T16:50:18.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- 172.21.15.52:0/3839426890 wait complete. 2023-09-30T16:50:18.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 Processor -- start 2023-09-30T16:50:18.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- start start 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 0x7f1d741479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d741574c0 0x7f1d740c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d740c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d741502b0 con 0x7f1d7406c180 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740c8170 con 0x7f1d741574c0 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d794fa640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7414f4f0 con 0x7f1d74159df0 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d72ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 0x7f1d741479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d72ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 0x7f1d741479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44758/0 (socket says 172.21.15.52:44758) 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.894+0000 7f1d72ffd640 1 -- 172.21.15.52:0/4189882017 learned_addr learned my addr 172.21.15.52:0/4189882017 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d727fc640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d741574c0 0x7f1d740c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d737fe640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d740c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d72ffd640 1 -- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 msgr2=0x7f1d740c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d72ffd640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d740c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d72ffd640 1 -- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d741574c0 msgr2=0x7f1d740c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d72ffd640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d741574c0 0x7f1d740c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d72ffd640 1 -- 172.21.15.52:0/4189882017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009420 con 0x7f1d7406c180 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d72ffd640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 0x7f1d741479b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400cba0 tx=0x7f1d6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400ad40 con 0x7f1d7406c180 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64012400 con 0x7f1d7406c180 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400aea0 con 0x7f1d7406c180 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d68009420 con 0x7f1d7406c180 2023-09-30T16:50:18.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7414fab0 con 0x7f1d7406c180 2023-09-30T16:50:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d740740a0 con 0x7f1d7406c180 2023-09-30T16:50:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1d64007070 con 0x7f1d7406c180 2023-09-30T16:50:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d5b7fe640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d60066160 0x7f1d60068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d640839d0 con 0x7f1d7406c180 2023-09-30T16:50:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d727fc640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d60066160 0x7f1d60068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.898+0000 7f1d727fc640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d60066160 0x7f1d60068620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1d680af000 tx=0x7f1d680a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:18.902+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1d64051010 con 0x7f1d7406c180 2023-09-30T16:50:18.975 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T16:50:18.971+0000 7fddadb7f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T16:50:19.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.062+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d740c73e0 con 0x7f1d7406c180 2023-09-30T16:50:19.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d5b7fe640 1 -- 172.21.15.52:0/4189882017 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f1d64017070 con 0x7f1d7406c180 2023-09-30T16:50:19.067 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:19.068 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":35,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:50:17.029929+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:50:13.342272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-30T16:50:14.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d60066160 msgr2=0x7f1d60068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d60066160 0x7f1d60068620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1d680af000 tx=0x7f1d680a7000 comp rx=0 tx=0).stop 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 msgr2=0x7f1d741479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 0x7f1d741479b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400cba0 tx=0x7f1d6400a430 comp rx=0 tx=0).stop 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 shutdown_connections 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d60066160 0x7f1d60068620 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d74159df0 0x7f1d740c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d741574c0 0x7f1d740c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 --2- 172.21.15.52:0/4189882017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d7406c180 0x7f1d741479b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 >> 172.21.15.52:0/4189882017 conn(0x7f1d7406a5f0 msgr2=0x7f1d740cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:19.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 shutdown_connections 2023-09-30T16:50:19.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.066+0000 7f1d794fa640 1 -- 172.21.15.52:0/4189882017 wait complete. 2023-09-30T16:50:19.087 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T16:50:19.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:50:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 Processor -- start 2023-09-30T16:50:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 -- start start 2023-09-30T16:50:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f102415ce10 0x7f10240b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10240d1fb0 0x7f10240b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240b7570 con 0x7f10240cd870 2023-09-30T16:50:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240b7850 con 0x7f10240d1fb0 2023-09-30T16:50:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f102b768640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240b7b30 con 0x7f102415ce10 2023-09-30T16:50:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10240d1fb0 0x7f10240b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10240d1fb0 0x7f10240b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44766/0 (socket says 172.21.15.52:44766) 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 -- 172.21.15.52:0/2713743144 learned_addr learned my addr 172.21.15.52:0/2713743144 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029504640 1 --2- 172.21.15.52:0/2713743144 >> v2:172.21.15.186:3300/0 conn(0x7f102415ce10 0x7f10240b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 -- 172.21.15.52:0/2713743144 >> v2:172.21.15.186:3300/0 conn(0x7f102415ce10 msgr2=0x7f10240b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 --2- 172.21.15.52:0/2713743144 >> v2:172.21.15.186:3300/0 conn(0x7f102415ce10 0x7f10240b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 -- 172.21.15.52:0/2713743144 >> v1:172.21.15.186:6789/0 conn(0x7f10240cd870 legacy=0x7f10240cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.198+0000 7f1029d05640 1 -- 172.21.15.52:0/2713743144 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240b7e10 con 0x7f10240d1fb0 2023-09-30T16:50:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f1029d05640 1 --2- 172.21.15.52:0/2713743144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240d1fb0 0x7f10240b5c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f10240b4e30 tx=0x7f101c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c75dc70ea0485e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f101bfff640 1 -- 172.21.15.52:0/2713743144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c0a5790 con 0x7f10240d1fb0 2023-09-30T16:50:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f101bfff640 1 -- 172.21.15.52:0/2713743144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0a58f0 con 0x7f10240d1fb0 2023-09-30T16:50:19.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f101bfff640 1 -- 172.21.15.52:0/2713743144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c0a5c80 con 0x7f10240d1fb0 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- 172.21.15.52:0/2713743144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240d1fb0 msgr2=0x7f10240b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 --2- 172.21.15.52:0/2713743144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240d1fb0 0x7f10240b5c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f10240b4e30 tx=0x7f101c01c8b0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- 172.21.15.52:0/2713743144 shutdown_connections 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 --2- 172.21.15.52:0/2713743144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240d1fb0 0x7f10240b5c10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 --2- 172.21.15.52:0/2713743144 >> v2:172.21.15.186:3300/0 conn(0x7f102415ce10 0x7f10240b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- 172.21.15.52:0/2713743144 >> 172.21.15.52:0/2713743144 conn(0x7f1024071930 msgr2=0x7f1024071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:19.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- 172.21.15.52:0/2713743144 shutdown_connections 2023-09-30T16:50:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- 172.21.15.52:0/2713743144 wait complete. 2023-09-30T16:50:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 Processor -- start 2023-09-30T16:50:19.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- start start 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 0x7f1024159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10240d1fb0 0x7f102415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10240c8d60 0x7f1024157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024153140 con 0x7f10240cd870 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102415fb50 con 0x7f10240c8d60 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f102b768640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102415eab0 con 0x7f10240d1fb0 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f1029504640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 0x7f1024159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f1029504640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 0x7f1024159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44776/0 (socket says 172.21.15.52:44776) 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.202+0000 7f1029504640 1 -- 172.21.15.52:0/2178954835 learned_addr learned my addr 172.21.15.52:0/2178954835 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:19.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029d05640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10240c8d60 0x7f1024157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029504640 1 -- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10240d1fb0 msgr2=0x7f102415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029504640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10240d1fb0 0x7f102415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029504640 1 -- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10240c8d60 msgr2=0x7f1024157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029504640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10240c8d60 0x7f1024157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029504640 1 -- 172.21.15.52:0/2178954835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c009b30 con 0x7f10240cd870 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029d05640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10240c8d60 0x7f1024157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1029504640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 0x7f1024159ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f102000d620 tx=0x7f102000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000b620 con 0x7f10240cd870 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000b780 con 0x7f10240cd870 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102415ed90 con 0x7f10240cd870 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000bb10 con 0x7f10240cd870 2023-09-30T16:50:19.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102415f350 con 0x7f10240cd870 2023-09-30T16:50:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102415d2a0 con 0x7f10240cd870 2023-09-30T16:50:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f102000bc70 con 0x7f10240cd870 2023-09-30T16:50:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1019ffb640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1008066190 0x7f1008068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1020084060 con 0x7f10240cd870 2023-09-30T16:50:19.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1028d03640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1008066190 0x7f1008068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.206+0000 7f1028d03640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1008066190 0x7f1008068650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1014000f70 tx=0x7f10140079c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.210+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f10200b4ed0 con 0x7f10240cd870 2023-09-30T16:50:19.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.354+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10240cecb0 con 0x7f1008066190 2023-09-30T16:50:19.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.378+0000 7f1019ffb640 1 -- 172.21.15.52:0/2178954835 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272606 (secure 0 0 0) 0x7f10240cecb0 con 0x7f1008066190 2023-09-30T16:50:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:19.382 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1008066190 msgr2=0x7f1008068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1008066190 0x7f1008068650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1014000f70 tx=0x7f10140079c0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 msgr2=0x7f1024159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 0x7f1024159ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f102000d620 tx=0x7f102000dae0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 shutdown_connections 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1008066190 0x7f1008068650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10240c8d60 0x7f1024157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10240d1fb0 0x7f102415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 --2- 172.21.15.52:0/2178954835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10240cd870 0x7f1024159ee0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 >> 172.21.15.52:0/2178954835 conn(0x7f1024071930 msgr2=0x7f1024156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:19.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 shutdown_connections 2023-09-30T16:50:19.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.382+0000 7f102b768640 1 -- 172.21.15.52:0/2178954835 wait complete. 2023-09-30T16:50:19.398 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-09-30T16:50:17.479365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236696,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738024,"statfs":{"total":773094113280,"available":772851736576,"internally_reserved":0,"allocated":3940352,"data_stored":2218128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001160"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:14.985761+0000","last_change":"2023-09-30T16:50:14.985761+0000","last_active":"2023-09-30T16:50:14.985761+0000","last_peered":"2023-09-30T16:50:14.985761+0000","last_clean":"2023-09-30T16:50:14.985761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:14.985761+0000","last_undegraded":"2023-09-30T16:50:14.985761+0000","last_fullsized":"2023-09-30T16:50:14.985761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T16:50:13.981901+0000","last_change":"2023-09-30T16:50:13.981901+0000","last_active":"2023-09-30T16:50:13.981901+0000","last_peered":"2023-09-30T16:50:13.981901+0000","last_clean":"2023-09-30T16:50:13.981901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T16:50:13.981901+0000","last_undegraded":"2023-09-30T16:50:13.981901+0000","last_fullsized":"2023-09-30T16:50:13.981901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-30T16:50:08.657015+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:50:08.657015+0000","last_peered":"2023-09-30T16:50:08.657015+0000","last_clean":"2023-09-30T16:50:08.657015+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:50:08.657015+0000","last_undegraded":"2023-09-30T16:50:08.657015+0000","last_fullsized":"2023-09-30T16:50:08.657015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":129674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.99199999999999999}]},{"osd":1,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.92600000000000005}]},{"osd":4,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.085},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88600000000000001}]},{"osd":5,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.1839999999999999}]},{"osd":6,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.139}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27376,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":344064,"data_stored":129674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.177},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.628}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.083}]},{"osd":2,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.04}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.214},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.002}]},{"osd":4,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.341}]},{"osd":5,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.252}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0669999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":720042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.88500000000000001}]},{"osd":2,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.97199999999999998}]},{"osd":4,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.629},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0089999999999999}]},{"osd":6,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.099},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.745}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.05}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27376,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":344064,"data_stored":129674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.2},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.224}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.73099999999999998}]},{"osd":2,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.91200000000000003}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1759999999999999}]},{"osd":6,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.153}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.129},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.3180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":129674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1,"5min":1,"15min":1},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.871}]},{"osd":5,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.141}]},{"osd":6,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.95399999999999996}]},{"osd":7,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0029999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":129674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.61199999999999999}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.443}]},{"osd":4,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.78400000000000003}]},{"osd":6,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.88}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.82299999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":129674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.753}]},{"osd":3,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.626}]},{"osd":4,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.036},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.93200000000000005}]},{"osd":6,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":720042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":4,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.753},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:50:19.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T16:50:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.558+0000 7ff41a8a8640 1 Processor -- start 2023-09-30T16:50:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.558+0000 7ff41a8a8640 1 -- start start 2023-09-30T16:50:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff41a8a8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff4141574c0 0x7ff4140cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff41a8a8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4140ca590 0x7ff4140ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff41a8a8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140caf00 con 0x7ff414159df0 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff41a8a8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41415ae50 con 0x7ff4140ca590 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff41a8a8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4141578a0 con 0x7ff4141574c0 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4140ca590 0x7ff4140ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4140ca590 0x7ff4140ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44784/0 (socket says 172.21.15.52:44784) 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 -- 172.21.15.52:0/65198626 learned_addr learned my addr 172.21.15.52:0/65198626 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff413fff640 1 --2- 172.21.15.52:0/65198626 >> v2:172.21.15.186:3300/0 conn(0x7ff4141574c0 0x7ff4140cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 -- 172.21.15.52:0/65198626 >> v2:172.21.15.186:3300/0 conn(0x7ff4141574c0 msgr2=0x7ff4140cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 --2- 172.21.15.52:0/65198626 >> v2:172.21.15.186:3300/0 conn(0x7ff4141574c0 0x7ff4140cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 -- 172.21.15.52:0/65198626 >> v1:172.21.15.186:6789/0 conn(0x7ff414159df0 legacy=0x7ff41406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 -- 172.21.15.52:0/65198626 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140ce2f0 con 0x7ff4140ca590 2023-09-30T16:50:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff413fff640 1 --2- 172.21.15.52:0/65198626 >> v2:172.21.15.186:3300/0 conn(0x7ff4141574c0 0x7ff4140cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff418e45640 1 --2- 172.21.15.52:0/65198626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4140ca590 0x7ff4140ca9c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff4141579e0 tx=0x7ff40c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6c38d5e4614ffc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff412ffd640 1 -- 172.21.15.52:0/65198626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0a5740 con 0x7ff4140ca590 2023-09-30T16:50:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff412ffd640 1 -- 172.21.15.52:0/65198626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0a58a0 con 0x7ff4140ca590 2023-09-30T16:50:19.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.562+0000 7ff412ffd640 1 -- 172.21.15.52:0/65198626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0a5c30 con 0x7ff4140ca590 2023-09-30T16:50:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/65198626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4140ca590 msgr2=0x7ff4140ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/65198626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4140ca590 0x7ff4140ca9c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff4141579e0 tx=0x7ff40c01c990 comp rx=0 tx=0).stop 2023-09-30T16:50:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/65198626 shutdown_connections 2023-09-30T16:50:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/65198626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4140ca590 0x7ff4140ca9c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/65198626 >> v2:172.21.15.186:3300/0 conn(0x7ff4141574c0 0x7ff4140cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/65198626 >> 172.21.15.52:0/65198626 conn(0x7ff41406a5f0 msgr2=0x7ff4140ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/65198626 shutdown_connections 2023-09-30T16:50:19.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/65198626 wait complete. 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 Processor -- start 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- start start 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4140ca590 0x7ff414150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4141574c0 0x7ff4141564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 0x7ff414156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c6ed0 con 0x7ff414159df0 2023-09-30T16:50:19.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414153540 con 0x7ff4140ca590 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c6880 con 0x7ff4141574c0 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 0x7ff414156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 0x7ff414156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44796/0 (socket says 172.21.15.52:44796) 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 -- 172.21.15.52:0/415007756 learned_addr learned my addr 172.21.15.52:0/415007756 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff4137fe640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4141574c0 0x7ff4141564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 -- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4141574c0 msgr2=0x7ff4141564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff413fff640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4140ca590 0x7ff414150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4141574c0 0x7ff4141564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 -- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4140ca590 msgr2=0x7ff414150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4140ca590 0x7ff414150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 -- 172.21.15.52:0/415007756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c009b30 con 0x7ff414159df0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff4137fe640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4141574c0 0x7ff4141564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff413fff640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4140ca590 0x7ff414150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff418e45640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 0x7ff414156a30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff40c01a5c0 tx=0x7ff40c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0b8670 con 0x7ff414159df0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0b87f0 con 0x7ff414159df0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4140c6b60 con 0x7ff414159df0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0b8ba0 con 0x7ff414159df0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.566+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff414150b80 con 0x7ff414159df0 2023-09-30T16:50:19.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.570+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41415a260 con 0x7ff414159df0 2023-09-30T16:50:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.570+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff40c0b8d00 con 0x7ff414159df0 2023-09-30T16:50:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.570+0000 7ff410ff9640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff400066160 0x7ff400068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.570+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff40c11ee30 con 0x7ff414159df0 2023-09-30T16:50:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.570+0000 7ff413fff640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff400066160 0x7ff400068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.570+0000 7ff413fff640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff400066160 0x7ff400068620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff41406c0d0 tx=0x7ff408008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.574+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff41415a260 con 0x7ff414159df0 2023-09-30T16:50:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.726+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4140ca070 con 0x7ff400066160 2023-09-30T16:50:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.746+0000 7ff410ff9640 1 -- 172.21.15.52:0/415007756 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287353 (secure 0 0 0) 0x7ff40800c040 con 0x7ff400066160 2023-09-30T16:50:19.751 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-09-30T16:50:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff400066160 msgr2=0x7ff400068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff400066160 0x7ff400068620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff41406c0d0 tx=0x7ff408008040 comp rx=0 tx=0).stop 2023-09-30T16:50:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 msgr2=0x7ff414156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 0x7ff414156a30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff40c01a5c0 tx=0x7ff40c019730 comp rx=0 tx=0).stop 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 shutdown_connections 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff400066160 0x7ff400068620 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff414159df0 0x7ff414156a30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4141574c0 0x7ff4141564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 --2- 172.21.15.52:0/415007756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4140ca590 0x7ff414150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 >> 172.21.15.52:0/415007756 conn(0x7ff41406a5f0 msgr2=0x7ff4140b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 shutdown_connections 2023-09-30T16:50:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.754+0000 7ff41a8a8640 1 -- 172.21.15.52:0/415007756 wait complete. 2023-09-30T16:50:19.772 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-09-30T16:50:19.479944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237132,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737588,"statfs":{"total":773094113280,"available":772851290112,"internally_reserved":0,"allocated":4399104,"data_stored":2424284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12739,"internal_metadata":238276157},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.490984"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045548+0000","last_change":"2023-09-30T16:50:16.075196+0000","last_active":"2023-09-30T16:50:17.045548+0000","last_peered":"2023-09-30T16:50:17.045548+0000","last_clean":"2023-09-30T16:50:17.045548+0000","last_became_active":"2023-09-30T16:50:16.074347+0000","last_became_peered":"2023-09-30T16:50:16.074347+0000","last_unstale":"2023-09-30T16:50:17.045548+0000","last_undegraded":"2023-09-30T16:50:17.045548+0000","last_fullsized":"2023-09-30T16:50:17.045548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:53:49.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065664+0000","last_change":"2023-09-30T16:50:16.084521+0000","last_active":"2023-09-30T16:50:17.065664+0000","last_peered":"2023-09-30T16:50:17.065664+0000","last_clean":"2023-09-30T16:50:17.065664+0000","last_became_active":"2023-09-30T16:50:16.084162+0000","last_became_peered":"2023-09-30T16:50:16.084162+0000","last_unstale":"2023-09-30T16:50:17.065664+0000","last_undegraded":"2023-09-30T16:50:17.065664+0000","last_fullsized":"2023-09-30T16:50:17.065664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:04:38.600032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066268+0000","last_change":"2023-09-30T16:50:16.080583+0000","last_active":"2023-09-30T16:50:17.066268+0000","last_peered":"2023-09-30T16:50:17.066268+0000","last_clean":"2023-09-30T16:50:17.066268+0000","last_became_active":"2023-09-30T16:50:16.080228+0000","last_became_peered":"2023-09-30T16:50:16.080228+0000","last_unstale":"2023-09-30T16:50:17.066268+0000","last_undegraded":"2023-09-30T16:50:17.066268+0000","last_fullsized":"2023-09-30T16:50:17.066268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:20.435562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.052109+0000","last_change":"2023-09-30T16:50:16.081502+0000","last_active":"2023-09-30T16:50:17.052109+0000","last_peered":"2023-09-30T16:50:17.052109+0000","last_clean":"2023-09-30T16:50:17.052109+0000","last_became_active":"2023-09-30T16:50:16.080482+0000","last_became_peered":"2023-09-30T16:50:16.080482+0000","last_unstale":"2023-09-30T16:50:17.052109+0000","last_undegraded":"2023-09-30T16:50:17.052109+0000","last_fullsized":"2023-09-30T16:50:17.052109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:42:07.617840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065308+0000","last_change":"2023-09-30T16:50:16.091887+0000","last_active":"2023-09-30T16:50:17.065308+0000","last_peered":"2023-09-30T16:50:17.065308+0000","last_clean":"2023-09-30T16:50:17.065308+0000","last_became_active":"2023-09-30T16:50:16.091514+0000","last_became_peered":"2023-09-30T16:50:16.091514+0000","last_unstale":"2023-09-30T16:50:17.065308+0000","last_undegraded":"2023-09-30T16:50:17.065308+0000","last_fullsized":"2023-09-30T16:50:17.065308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:23.128542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065927+0000","last_change":"2023-09-30T16:50:16.076634+0000","last_active":"2023-09-30T16:50:17.065927+0000","last_peered":"2023-09-30T16:50:17.065927+0000","last_clean":"2023-09-30T16:50:17.065927+0000","last_became_active":"2023-09-30T16:50:16.075754+0000","last_became_peered":"2023-09-30T16:50:16.075754+0000","last_unstale":"2023-09-30T16:50:17.065927+0000","last_undegraded":"2023-09-30T16:50:17.065927+0000","last_fullsized":"2023-09-30T16:50:17.065927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:03.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044468+0000","last_change":"2023-09-30T16:50:16.069708+0000","last_active":"2023-09-30T16:50:17.044468+0000","last_peered":"2023-09-30T16:50:17.044468+0000","last_clean":"2023-09-30T16:50:17.044468+0000","last_became_active":"2023-09-30T16:50:16.068831+0000","last_became_peered":"2023-09-30T16:50:16.068831+0000","last_unstale":"2023-09-30T16:50:17.044468+0000","last_undegraded":"2023-09-30T16:50:17.044468+0000","last_fullsized":"2023-09-30T16:50:17.044468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:35.151933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044742+0000","last_change":"2023-09-30T16:50:16.093381+0000","last_active":"2023-09-30T16:50:17.044742+0000","last_peered":"2023-09-30T16:50:17.044742+0000","last_clean":"2023-09-30T16:50:17.044742+0000","last_became_active":"2023-09-30T16:50:16.092784+0000","last_became_peered":"2023-09-30T16:50:16.092784+0000","last_unstale":"2023-09-30T16:50:17.044742+0000","last_undegraded":"2023-09-30T16:50:17.044742+0000","last_fullsized":"2023-09-30T16:50:17.044742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:11:34.293847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066490+0000","last_change":"2023-09-30T16:50:16.100559+0000","last_active":"2023-09-30T16:50:17.066490+0000","last_peered":"2023-09-30T16:50:17.066490+0000","last_clean":"2023-09-30T16:50:17.066490+0000","last_became_active":"2023-09-30T16:50:16.100148+0000","last_became_peered":"2023-09-30T16:50:16.100148+0000","last_unstale":"2023-09-30T16:50:17.066490+0000","last_undegraded":"2023-09-30T16:50:17.066490+0000","last_fullsized":"2023-09-30T16:50:17.066490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:01.898245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.052874+0000","last_change":"2023-09-30T16:50:16.072909+0000","last_active":"2023-09-30T16:50:17.052874+0000","last_peered":"2023-09-30T16:50:17.052874+0000","last_clean":"2023-09-30T16:50:17.052874+0000","last_became_active":"2023-09-30T16:50:16.070930+0000","last_became_peered":"2023-09-30T16:50:16.070930+0000","last_unstale":"2023-09-30T16:50:17.052874+0000","last_undegraded":"2023-09-30T16:50:17.052874+0000","last_fullsized":"2023-09-30T16:50:17.052874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:37:52.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065594+0000","last_change":"2023-09-30T16:50:16.072073+0000","last_active":"2023-09-30T16:50:17.065594+0000","last_peered":"2023-09-30T16:50:17.065594+0000","last_clean":"2023-09-30T16:50:17.065594+0000","last_became_active":"2023-09-30T16:50:16.070494+0000","last_became_peered":"2023-09-30T16:50:16.070494+0000","last_unstale":"2023-09-30T16:50:17.065594+0000","last_undegraded":"2023-09-30T16:50:17.065594+0000","last_fullsized":"2023-09-30T16:50:17.065594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:29:57.131859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065412+0000","last_change":"2023-09-30T16:50:16.092902+0000","last_active":"2023-09-30T16:50:17.065412+0000","last_peered":"2023-09-30T16:50:17.065412+0000","last_clean":"2023-09-30T16:50:17.065412+0000","last_became_active":"2023-09-30T16:50:16.092567+0000","last_became_peered":"2023-09-30T16:50:16.092567+0000","last_unstale":"2023-09-30T16:50:17.065412+0000","last_undegraded":"2023-09-30T16:50:17.065412+0000","last_fullsized":"2023-09-30T16:50:17.065412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:20:11.307436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.049970+0000","last_change":"2023-09-30T16:50:16.103628+0000","last_active":"2023-09-30T16:50:17.049970+0000","last_peered":"2023-09-30T16:50:17.049970+0000","last_clean":"2023-09-30T16:50:17.049970+0000","last_became_active":"2023-09-30T16:50:16.103162+0000","last_became_peered":"2023-09-30T16:50:16.103162+0000","last_unstale":"2023-09-30T16:50:17.049970+0000","last_undegraded":"2023-09-30T16:50:17.049970+0000","last_fullsized":"2023-09-30T16:50:17.049970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:47.610964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051413+0000","last_change":"2023-09-30T16:50:16.071727+0000","last_active":"2023-09-30T16:50:17.051413+0000","last_peered":"2023-09-30T16:50:17.051413+0000","last_clean":"2023-09-30T16:50:17.051413+0000","last_became_active":"2023-09-30T16:50:16.070854+0000","last_became_peered":"2023-09-30T16:50:16.070854+0000","last_unstale":"2023-09-30T16:50:17.051413+0000","last_undegraded":"2023-09-30T16:50:17.051413+0000","last_fullsized":"2023-09-30T16:50:17.051413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:07.830008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063564+0000","last_change":"2023-09-30T16:50:16.077564+0000","last_active":"2023-09-30T16:50:17.063564+0000","last_peered":"2023-09-30T16:50:17.063564+0000","last_clean":"2023-09-30T16:50:17.063564+0000","last_became_active":"2023-09-30T16:50:16.076877+0000","last_became_peered":"2023-09-30T16:50:16.076877+0000","last_unstale":"2023-09-30T16:50:17.063564+0000","last_undegraded":"2023-09-30T16:50:17.063564+0000","last_fullsized":"2023-09-30T16:50:17.063564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:50.422811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063676+0000","last_change":"2023-09-30T16:50:16.059634+0000","last_active":"2023-09-30T16:50:17.063676+0000","last_peered":"2023-09-30T16:50:17.063676+0000","last_clean":"2023-09-30T16:50:17.063676+0000","last_became_active":"2023-09-30T16:50:16.058772+0000","last_became_peered":"2023-09-30T16:50:16.058772+0000","last_unstale":"2023-09-30T16:50:17.063676+0000","last_undegraded":"2023-09-30T16:50:17.063676+0000","last_fullsized":"2023-09-30T16:50:17.063676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:35:30.935185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066270+0000","last_change":"2023-09-30T16:50:16.083279+0000","last_active":"2023-09-30T16:50:17.066270+0000","last_peered":"2023-09-30T16:50:17.066270+0000","last_clean":"2023-09-30T16:50:17.066270+0000","last_became_active":"2023-09-30T16:50:16.082944+0000","last_became_peered":"2023-09-30T16:50:16.082944+0000","last_unstale":"2023-09-30T16:50:17.066270+0000","last_undegraded":"2023-09-30T16:50:17.066270+0000","last_fullsized":"2023-09-30T16:50:17.066270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:03:55.562624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066956+0000","last_change":"2023-09-30T16:50:16.088386+0000","last_active":"2023-09-30T16:50:17.066956+0000","last_peered":"2023-09-30T16:50:17.066956+0000","last_clean":"2023-09-30T16:50:17.066956+0000","last_became_active":"2023-09-30T16:50:16.087548+0000","last_became_peered":"2023-09-30T16:50:16.087548+0000","last_unstale":"2023-09-30T16:50:17.066956+0000","last_undegraded":"2023-09-30T16:50:17.066956+0000","last_fullsized":"2023-09-30T16:50:17.066956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:30:08.918374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066082+0000","last_change":"2023-09-30T16:50:16.070003+0000","last_active":"2023-09-30T16:50:17.066082+0000","last_peered":"2023-09-30T16:50:17.066082+0000","last_clean":"2023-09-30T16:50:17.066082+0000","last_became_active":"2023-09-30T16:50:16.069265+0000","last_became_peered":"2023-09-30T16:50:16.069265+0000","last_unstale":"2023-09-30T16:50:17.066082+0000","last_undegraded":"2023-09-30T16:50:17.066082+0000","last_fullsized":"2023-09-30T16:50:17.066082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:23:08.524991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050296+0000","last_change":"2023-09-30T16:50:16.092187+0000","last_active":"2023-09-30T16:50:17.050296+0000","last_peered":"2023-09-30T16:50:17.050296+0000","last_clean":"2023-09-30T16:50:17.050296+0000","last_became_active":"2023-09-30T16:50:16.091503+0000","last_became_peered":"2023-09-30T16:50:16.091503+0000","last_unstale":"2023-09-30T16:50:17.050296+0000","last_undegraded":"2023-09-30T16:50:17.050296+0000","last_fullsized":"2023-09-30T16:50:17.050296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:05:00.445128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063793+0000","last_change":"2023-09-30T16:50:16.086045+0000","last_active":"2023-09-30T16:50:17.063793+0000","last_peered":"2023-09-30T16:50:17.063793+0000","last_clean":"2023-09-30T16:50:17.063793+0000","last_became_active":"2023-09-30T16:50:16.085296+0000","last_became_peered":"2023-09-30T16:50:16.085296+0000","last_unstale":"2023-09-30T16:50:17.063793+0000","last_undegraded":"2023-09-30T16:50:17.063793+0000","last_fullsized":"2023-09-30T16:50:17.063793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:48.154754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044916+0000","last_change":"2023-09-30T16:50:16.084107+0000","last_active":"2023-09-30T16:50:17.044916+0000","last_peered":"2023-09-30T16:50:17.044916+0000","last_clean":"2023-09-30T16:50:17.044916+0000","last_became_active":"2023-09-30T16:50:16.083647+0000","last_became_peered":"2023-09-30T16:50:16.083647+0000","last_unstale":"2023-09-30T16:50:17.044916+0000","last_undegraded":"2023-09-30T16:50:17.044916+0000","last_fullsized":"2023-09-30T16:50:17.044916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:00:23.748781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.049176+0000","last_change":"2023-09-30T16:50:16.087396+0000","last_active":"2023-09-30T16:50:17.049176+0000","last_peered":"2023-09-30T16:50:17.049176+0000","last_clean":"2023-09-30T16:50:17.049176+0000","last_became_active":"2023-09-30T16:50:16.085078+0000","last_became_peered":"2023-09-30T16:50:16.085078+0000","last_unstale":"2023-09-30T16:50:17.049176+0000","last_undegraded":"2023-09-30T16:50:17.049176+0000","last_fullsized":"2023-09-30T16:50:17.049176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:37.040677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044743+0000","last_change":"2023-09-30T16:50:16.084740+0000","last_active":"2023-09-30T16:50:17.044743+0000","last_peered":"2023-09-30T16:50:17.044743+0000","last_clean":"2023-09-30T16:50:17.044743+0000","last_became_active":"2023-09-30T16:50:16.084206+0000","last_became_peered":"2023-09-30T16:50:16.084206+0000","last_unstale":"2023-09-30T16:50:17.044743+0000","last_undegraded":"2023-09-30T16:50:17.044743+0000","last_fullsized":"2023-09-30T16:50:17.044743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:16:18.856600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051890+0000","last_change":"2023-09-30T16:50:16.063793+0000","last_active":"2023-09-30T16:50:17.051890+0000","last_peered":"2023-09-30T16:50:17.051890+0000","last_clean":"2023-09-30T16:50:17.051890+0000","last_became_active":"2023-09-30T16:50:16.063008+0000","last_became_peered":"2023-09-30T16:50:16.063008+0000","last_unstale":"2023-09-30T16:50:17.051890+0000","last_undegraded":"2023-09-30T16:50:17.051890+0000","last_fullsized":"2023-09-30T16:50:17.051890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:59:22.885992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.053031+0000","last_change":"2023-09-30T16:50:16.070339+0000","last_active":"2023-09-30T16:50:17.053031+0000","last_peered":"2023-09-30T16:50:17.053031+0000","last_clean":"2023-09-30T16:50:17.053031+0000","last_became_active":"2023-09-30T16:50:16.069618+0000","last_became_peered":"2023-09-30T16:50:16.069618+0000","last_unstale":"2023-09-30T16:50:17.053031+0000","last_undegraded":"2023-09-30T16:50:17.053031+0000","last_fullsized":"2023-09-30T16:50:17.053031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:24.184807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065489+0000","last_change":"2023-09-30T16:50:16.074017+0000","last_active":"2023-09-30T16:50:17.065489+0000","last_peered":"2023-09-30T16:50:17.065489+0000","last_clean":"2023-09-30T16:50:17.065489+0000","last_became_active":"2023-09-30T16:50:16.073070+0000","last_became_peered":"2023-09-30T16:50:16.073070+0000","last_unstale":"2023-09-30T16:50:17.065489+0000","last_undegraded":"2023-09-30T16:50:17.065489+0000","last_fullsized":"2023-09-30T16:50:17.065489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:12.972666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045380+0000","last_change":"2023-09-30T16:50:16.088210+0000","last_active":"2023-09-30T16:50:17.045380+0000","last_peered":"2023-09-30T16:50:17.045380+0000","last_clean":"2023-09-30T16:50:17.045380+0000","last_became_active":"2023-09-30T16:50:16.087557+0000","last_became_peered":"2023-09-30T16:50:16.087557+0000","last_unstale":"2023-09-30T16:50:17.045380+0000","last_undegraded":"2023-09-30T16:50:17.045380+0000","last_fullsized":"2023-09-30T16:50:17.045380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:20:50.936127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064062+0000","last_change":"2023-09-30T16:50:16.066084+0000","last_active":"2023-09-30T16:50:17.064062+0000","last_peered":"2023-09-30T16:50:17.064062+0000","last_clean":"2023-09-30T16:50:17.064062+0000","last_became_active":"2023-09-30T16:50:16.065206+0000","last_became_peered":"2023-09-30T16:50:16.065206+0000","last_unstale":"2023-09-30T16:50:17.064062+0000","last_undegraded":"2023-09-30T16:50:17.064062+0000","last_fullsized":"2023-09-30T16:50:17.064062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:35:52.556254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063625+0000","last_change":"2023-09-30T16:50:16.061631+0000","last_active":"2023-09-30T16:50:17.063625+0000","last_peered":"2023-09-30T16:50:17.063625+0000","last_clean":"2023-09-30T16:50:17.063625+0000","last_became_active":"2023-09-30T16:50:16.060848+0000","last_became_peered":"2023-09-30T16:50:16.060848+0000","last_unstale":"2023-09-30T16:50:17.063625+0000","last_undegraded":"2023-09-30T16:50:17.063625+0000","last_fullsized":"2023-09-30T16:50:17.063625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:20:50.936127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045056+0000","last_change":"2023-09-30T16:50:16.064332+0000","last_active":"2023-09-30T16:50:17.045056+0000","last_peered":"2023-09-30T16:50:17.045056+0000","last_clean":"2023-09-30T16:50:17.045056+0000","last_became_active":"2023-09-30T16:50:16.063524+0000","last_became_peered":"2023-09-30T16:50:16.063524+0000","last_unstale":"2023-09-30T16:50:17.045056+0000","last_undegraded":"2023-09-30T16:50:17.045056+0000","last_fullsized":"2023-09-30T16:50:17.045056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:27.627046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064897+0000","last_change":"2023-09-30T16:50:16.077792+0000","last_active":"2023-09-30T16:50:17.064897+0000","last_peered":"2023-09-30T16:50:17.064897+0000","last_clean":"2023-09-30T16:50:17.064897+0000","last_became_active":"2023-09-30T16:50:16.077062+0000","last_became_peered":"2023-09-30T16:50:16.077062+0000","last_unstale":"2023-09-30T16:50:17.064897+0000","last_undegraded":"2023-09-30T16:50:17.064897+0000","last_fullsized":"2023-09-30T16:50:17.064897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:05:29.573532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050703+0000","last_change":"2023-09-30T16:50:16.085844+0000","last_active":"2023-09-30T16:50:17.050703+0000","last_peered":"2023-09-30T16:50:17.050703+0000","last_clean":"2023-09-30T16:50:17.050703+0000","last_became_active":"2023-09-30T16:50:16.085089+0000","last_became_peered":"2023-09-30T16:50:16.085089+0000","last_unstale":"2023-09-30T16:50:17.050703+0000","last_undegraded":"2023-09-30T16:50:17.050703+0000","last_fullsized":"2023-09-30T16:50:17.050703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:02.047591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066463+0000","last_change":"2023-09-30T16:50:15.037271+0000","last_active":"2023-09-30T16:50:17.066463+0000","last_peered":"2023-09-30T16:50:17.066463+0000","last_clean":"2023-09-30T16:50:17.066463+0000","last_became_active":"2023-09-30T16:50:15.036995+0000","last_became_peered":"2023-09-30T16:50:15.036995+0000","last_unstale":"2023-09-30T16:50:17.066463+0000","last_undegraded":"2023-09-30T16:50:17.066463+0000","last_fullsized":"2023-09-30T16:50:17.066463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:10:43.996729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045654+0000","last_change":"2023-09-30T16:50:16.068187+0000","last_active":"2023-09-30T16:50:17.045654+0000","last_peered":"2023-09-30T16:50:17.045654+0000","last_clean":"2023-09-30T16:50:17.045654+0000","last_became_active":"2023-09-30T16:50:16.067345+0000","last_became_peered":"2023-09-30T16:50:16.067345+0000","last_unstale":"2023-09-30T16:50:17.045654+0000","last_undegraded":"2023-09-30T16:50:17.045654+0000","last_fullsized":"2023-09-30T16:50:17.045654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:48.154754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.053145+0000","last_change":"2023-09-30T16:50:15.025344+0000","last_active":"2023-09-30T16:50:17.053145+0000","last_peered":"2023-09-30T16:50:17.053145+0000","last_clean":"2023-09-30T16:50:17.053145+0000","last_became_active":"2023-09-30T16:50:15.024650+0000","last_became_peered":"2023-09-30T16:50:15.024650+0000","last_unstale":"2023-09-30T16:50:17.053145+0000","last_undegraded":"2023-09-30T16:50:17.053145+0000","last_fullsized":"2023-09-30T16:50:17.053145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:22.124681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045513+0000","last_change":"2023-09-30T16:50:16.084045+0000","last_active":"2023-09-30T16:50:17.045513+0000","last_peered":"2023-09-30T16:50:17.045513+0000","last_clean":"2023-09-30T16:50:17.045513+0000","last_became_active":"2023-09-30T16:50:16.083694+0000","last_became_peered":"2023-09-30T16:50:16.083694+0000","last_unstale":"2023-09-30T16:50:17.045513+0000","last_undegraded":"2023-09-30T16:50:17.045513+0000","last_fullsized":"2023-09-30T16:50:17.045513+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:35:30.935185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066560+0000","last_change":"2023-09-30T16:50:15.041266+0000","last_active":"2023-09-30T16:50:17.066560+0000","last_peered":"2023-09-30T16:50:17.066560+0000","last_clean":"2023-09-30T16:50:17.066560+0000","last_became_active":"2023-09-30T16:50:15.040545+0000","last_became_peered":"2023-09-30T16:50:15.040545+0000","last_unstale":"2023-09-30T16:50:17.066560+0000","last_undegraded":"2023-09-30T16:50:17.066560+0000","last_fullsized":"2023-09-30T16:50:17.066560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:49:10.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.052402+0000","last_change":"2023-09-30T16:50:16.088774+0000","last_active":"2023-09-30T16:50:17.052402+0000","last_peered":"2023-09-30T16:50:17.052402+0000","last_clean":"2023-09-30T16:50:17.052402+0000","last_became_active":"2023-09-30T16:50:16.088151+0000","last_became_peered":"2023-09-30T16:50:16.088151+0000","last_unstale":"2023-09-30T16:50:17.052402+0000","last_undegraded":"2023-09-30T16:50:17.052402+0000","last_fullsized":"2023-09-30T16:50:17.052402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:15:59.422865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.052522+0000","last_change":"2023-09-30T16:50:15.035822+0000","last_active":"2023-09-30T16:50:17.052522+0000","last_peered":"2023-09-30T16:50:17.052522+0000","last_clean":"2023-09-30T16:50:17.052522+0000","last_became_active":"2023-09-30T16:50:15.033817+0000","last_became_peered":"2023-09-30T16:50:15.033817+0000","last_unstale":"2023-09-30T16:50:17.052522+0000","last_undegraded":"2023-09-30T16:50:17.052522+0000","last_fullsized":"2023-09-30T16:50:17.052522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:54.832498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065733+0000","last_change":"2023-09-30T16:50:16.099682+0000","last_active":"2023-09-30T16:50:17.065733+0000","last_peered":"2023-09-30T16:50:17.065733+0000","last_clean":"2023-09-30T16:50:17.065733+0000","last_became_active":"2023-09-30T16:50:16.099322+0000","last_became_peered":"2023-09-30T16:50:16.099322+0000","last_unstale":"2023-09-30T16:50:17.065733+0000","last_undegraded":"2023-09-30T16:50:17.065733+0000","last_fullsized":"2023-09-30T16:50:17.065733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:06:51.435192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044712+0000","last_change":"2023-09-30T16:50:15.029795+0000","last_active":"2023-09-30T16:50:17.044712+0000","last_peered":"2023-09-30T16:50:17.044712+0000","last_clean":"2023-09-30T16:50:17.044712+0000","last_became_active":"2023-09-30T16:50:15.029369+0000","last_became_peered":"2023-09-30T16:50:15.029369+0000","last_unstale":"2023-09-30T16:50:17.044712+0000","last_undegraded":"2023-09-30T16:50:17.044712+0000","last_fullsized":"2023-09-30T16:50:17.044712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:11.404787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044890+0000","last_change":"2023-09-30T16:50:16.064528+0000","last_active":"2023-09-30T16:50:17.044890+0000","last_peered":"2023-09-30T16:50:17.044890+0000","last_clean":"2023-09-30T16:50:17.044890+0000","last_became_active":"2023-09-30T16:50:16.063688+0000","last_became_peered":"2023-09-30T16:50:16.063688+0000","last_unstale":"2023-09-30T16:50:17.044890+0000","last_undegraded":"2023-09-30T16:50:17.044890+0000","last_fullsized":"2023-09-30T16:50:17.044890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:15:39.469247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045030+0000","last_change":"2023-09-30T16:50:15.019537+0000","last_active":"2023-09-30T16:50:17.045030+0000","last_peered":"2023-09-30T16:50:17.045030+0000","last_clean":"2023-09-30T16:50:17.045030+0000","last_became_active":"2023-09-30T16:50:15.019294+0000","last_became_peered":"2023-09-30T16:50:15.019294+0000","last_unstale":"2023-09-30T16:50:17.045030+0000","last_undegraded":"2023-09-30T16:50:17.045030+0000","last_fullsized":"2023-09-30T16:50:17.045030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:30:07.914513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063269+0000","last_change":"2023-09-30T16:50:16.073069+0000","last_active":"2023-09-30T16:50:17.063269+0000","last_peered":"2023-09-30T16:50:17.063269+0000","last_clean":"2023-09-30T16:50:17.063269+0000","last_became_active":"2023-09-30T16:50:16.072391+0000","last_became_peered":"2023-09-30T16:50:16.072391+0000","last_unstale":"2023-09-30T16:50:17.063269+0000","last_undegraded":"2023-09-30T16:50:17.063269+0000","last_fullsized":"2023-09-30T16:50:17.063269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:45:59.834976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066598+0000","last_change":"2023-09-30T16:50:15.037158+0000","last_active":"2023-09-30T16:50:17.066598+0000","last_peered":"2023-09-30T16:50:17.066598+0000","last_clean":"2023-09-30T16:50:17.066598+0000","last_became_active":"2023-09-30T16:50:15.036389+0000","last_became_peered":"2023-09-30T16:50:15.036389+0000","last_unstale":"2023-09-30T16:50:17.066598+0000","last_undegraded":"2023-09-30T16:50:17.066598+0000","last_fullsized":"2023-09-30T16:50:17.066598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:50:35.602970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050839+0000","last_change":"2023-09-30T16:50:16.061433+0000","last_active":"2023-09-30T16:50:17.050839+0000","last_peered":"2023-09-30T16:50:17.050839+0000","last_clean":"2023-09-30T16:50:17.050839+0000","last_became_active":"2023-09-30T16:50:16.057834+0000","last_became_peered":"2023-09-30T16:50:16.057834+0000","last_unstale":"2023-09-30T16:50:17.050839+0000","last_undegraded":"2023-09-30T16:50:17.050839+0000","last_fullsized":"2023-09-30T16:50:17.050839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:58:00.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045035+0000","last_change":"2023-09-30T16:50:15.035536+0000","last_active":"2023-09-30T16:50:17.045035+0000","last_peered":"2023-09-30T16:50:17.045035+0000","last_clean":"2023-09-30T16:50:17.045035+0000","last_became_active":"2023-09-30T16:50:15.035126+0000","last_became_peered":"2023-09-30T16:50:15.035126+0000","last_unstale":"2023-09-30T16:50:17.045035+0000","last_undegraded":"2023-09-30T16:50:17.045035+0000","last_fullsized":"2023-09-30T16:50:17.045035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:28:28.765738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065658+0000","last_change":"2023-09-30T16:50:16.087335+0000","last_active":"2023-09-30T16:50:17.065658+0000","last_peered":"2023-09-30T16:50:17.065658+0000","last_clean":"2023-09-30T16:50:17.065658+0000","last_became_active":"2023-09-30T16:50:16.086962+0000","last_became_peered":"2023-09-30T16:50:16.086962+0000","last_unstale":"2023-09-30T16:50:17.065658+0000","last_undegraded":"2023-09-30T16:50:17.065658+0000","last_fullsized":"2023-09-30T16:50:17.065658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:28:26.639798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066722+0000","last_change":"2023-09-30T16:50:15.028197+0000","last_active":"2023-09-30T16:50:17.066722+0000","last_peered":"2023-09-30T16:50:17.066722+0000","last_clean":"2023-09-30T16:50:17.066722+0000","last_became_active":"2023-09-30T16:50:15.027519+0000","last_became_peered":"2023-09-30T16:50:15.027519+0000","last_unstale":"2023-09-30T16:50:17.066722+0000","last_undegraded":"2023-09-30T16:50:17.066722+0000","last_fullsized":"2023-09-30T16:50:17.066722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:53:01.043730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.052002+0000","last_change":"2023-09-30T16:50:16.072755+0000","last_active":"2023-09-30T16:50:17.052002+0000","last_peered":"2023-09-30T16:50:17.052002+0000","last_clean":"2023-09-30T16:50:17.052002+0000","last_became_active":"2023-09-30T16:50:16.071784+0000","last_became_peered":"2023-09-30T16:50:16.071784+0000","last_unstale":"2023-09-30T16:50:17.052002+0000","last_undegraded":"2023-09-30T16:50:17.052002+0000","last_fullsized":"2023-09-30T16:50:17.052002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:25.503522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065892+0000","last_change":"2023-09-30T16:50:15.037993+0000","last_active":"2023-09-30T16:50:17.065892+0000","last_peered":"2023-09-30T16:50:17.065892+0000","last_clean":"2023-09-30T16:50:17.065892+0000","last_became_active":"2023-09-30T16:50:15.037347+0000","last_became_peered":"2023-09-30T16:50:15.037347+0000","last_unstale":"2023-09-30T16:50:17.065892+0000","last_undegraded":"2023-09-30T16:50:17.065892+0000","last_fullsized":"2023-09-30T16:50:17.065892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:46.607103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.052366+0000","last_change":"2023-09-30T16:50:16.081093+0000","last_active":"2023-09-30T16:50:17.052366+0000","last_peered":"2023-09-30T16:50:17.052366+0000","last_clean":"2023-09-30T16:50:17.052366+0000","last_became_active":"2023-09-30T16:50:16.079651+0000","last_became_peered":"2023-09-30T16:50:16.079651+0000","last_unstale":"2023-09-30T16:50:17.052366+0000","last_undegraded":"2023-09-30T16:50:17.052366+0000","last_fullsized":"2023-09-30T16:50:17.052366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:00.380515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065471+0000","last_change":"2023-09-30T16:50:15.016362+0000","last_active":"2023-09-30T16:50:17.065471+0000","last_peered":"2023-09-30T16:50:17.065471+0000","last_clean":"2023-09-30T16:50:17.065471+0000","last_became_active":"2023-09-30T16:50:15.016034+0000","last_became_peered":"2023-09-30T16:50:15.016034+0000","last_unstale":"2023-09-30T16:50:17.065471+0000","last_undegraded":"2023-09-30T16:50:17.065471+0000","last_fullsized":"2023-09-30T16:50:17.065471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:35:51.552393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065344+0000","last_change":"2023-09-30T16:50:16.072551+0000","last_active":"2023-09-30T16:50:17.065344+0000","last_peered":"2023-09-30T16:50:17.065344+0000","last_clean":"2023-09-30T16:50:17.065344+0000","last_became_active":"2023-09-30T16:50:16.071422+0000","last_became_peered":"2023-09-30T16:50:16.071422+0000","last_unstale":"2023-09-30T16:50:17.065344+0000","last_undegraded":"2023-09-30T16:50:17.065344+0000","last_fullsized":"2023-09-30T16:50:17.065344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:30:06.554359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050738+0000","last_change":"2023-09-30T16:50:15.038081+0000","last_active":"2023-09-30T16:50:17.050738+0000","last_peered":"2023-09-30T16:50:17.050738+0000","last_clean":"2023-09-30T16:50:17.050738+0000","last_became_active":"2023-09-30T16:50:15.037368+0000","last_became_peered":"2023-09-30T16:50:15.037368+0000","last_unstale":"2023-09-30T16:50:17.050738+0000","last_undegraded":"2023-09-30T16:50:17.050738+0000","last_fullsized":"2023-09-30T16:50:17.050738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:18:02.436754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.049433+0000","last_change":"2023-09-30T16:50:16.088089+0000","last_active":"2023-09-30T16:50:17.049433+0000","last_peered":"2023-09-30T16:50:17.049433+0000","last_clean":"2023-09-30T16:50:17.049433+0000","last_became_active":"2023-09-30T16:50:16.087674+0000","last_became_peered":"2023-09-30T16:50:16.087674+0000","last_unstale":"2023-09-30T16:50:17.049433+0000","last_undegraded":"2023-09-30T16:50:17.049433+0000","last_fullsized":"2023-09-30T16:50:17.049433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:06:42.627211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044821+0000","last_change":"2023-09-30T16:50:15.021256+0000","last_active":"2023-09-30T16:50:17.044821+0000","last_peered":"2023-09-30T16:50:17.044821+0000","last_clean":"2023-09-30T16:50:17.044821+0000","last_became_active":"2023-09-30T16:50:15.020412+0000","last_became_peered":"2023-09-30T16:50:15.020412+0000","last_unstale":"2023-09-30T16:50:17.044821+0000","last_undegraded":"2023-09-30T16:50:17.044821+0000","last_fullsized":"2023-09-30T16:50:17.044821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:24:22.517588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051853+0000","last_change":"2023-09-30T16:50:16.086327+0000","last_active":"2023-09-30T16:50:17.051853+0000","last_peered":"2023-09-30T16:50:17.051853+0000","last_clean":"2023-09-30T16:50:17.051853+0000","last_became_active":"2023-09-30T16:50:16.085623+0000","last_became_peered":"2023-09-30T16:50:16.085623+0000","last_unstale":"2023-09-30T16:50:17.051853+0000","last_undegraded":"2023-09-30T16:50:17.051853+0000","last_fullsized":"2023-09-30T16:50:17.051853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:31:04.190707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051437+0000","last_change":"2023-09-30T16:50:15.023923+0000","last_active":"2023-09-30T16:50:17.051437+0000","last_peered":"2023-09-30T16:50:17.051437+0000","last_clean":"2023-09-30T16:50:17.051437+0000","last_became_active":"2023-09-30T16:50:15.023211+0000","last_became_peered":"2023-09-30T16:50:15.023211+0000","last_unstale":"2023-09-30T16:50:17.051437+0000","last_undegraded":"2023-09-30T16:50:17.051437+0000","last_fullsized":"2023-09-30T16:50:17.051437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:23.338863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045150+0000","last_change":"2023-09-30T16:50:16.075130+0000","last_active":"2023-09-30T16:50:17.045150+0000","last_peered":"2023-09-30T16:50:17.045150+0000","last_clean":"2023-09-30T16:50:17.045150+0000","last_became_active":"2023-09-30T16:50:16.074215+0000","last_became_peered":"2023-09-30T16:50:16.074215+0000","last_unstale":"2023-09-30T16:50:17.045150+0000","last_undegraded":"2023-09-30T16:50:17.045150+0000","last_fullsized":"2023-09-30T16:50:17.045150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:50.422811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051006+0000","last_change":"2023-09-30T16:50:15.005769+0000","last_active":"2023-09-30T16:50:17.051006+0000","last_peered":"2023-09-30T16:50:17.051006+0000","last_clean":"2023-09-30T16:50:17.051006+0000","last_became_active":"2023-09-30T16:50:15.003898+0000","last_became_peered":"2023-09-30T16:50:15.003898+0000","last_unstale":"2023-09-30T16:50:17.051006+0000","last_undegraded":"2023-09-30T16:50:17.051006+0000","last_fullsized":"2023-09-30T16:50:17.051006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:36.036816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064838+0000","last_change":"2023-09-30T16:50:16.066615+0000","last_active":"2023-09-30T16:50:17.064838+0000","last_peered":"2023-09-30T16:50:17.064838+0000","last_clean":"2023-09-30T16:50:17.064838+0000","last_became_active":"2023-09-30T16:50:16.065407+0000","last_became_peered":"2023-09-30T16:50:16.065407+0000","last_unstale":"2023-09-30T16:50:17.064838+0000","last_undegraded":"2023-09-30T16:50:17.064838+0000","last_fullsized":"2023-09-30T16:50:17.064838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:50:03.199246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066070+0000","last_change":"2023-09-30T16:50:15.032081+0000","last_active":"2023-09-30T16:50:17.066070+0000","last_peered":"2023-09-30T16:50:17.066070+0000","last_clean":"2023-09-30T16:50:17.066070+0000","last_became_active":"2023-09-30T16:50:15.031289+0000","last_became_peered":"2023-09-30T16:50:15.031289+0000","last_unstale":"2023-09-30T16:50:17.066070+0000","last_undegraded":"2023-09-30T16:50:17.066070+0000","last_fullsized":"2023-09-30T16:50:17.066070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:22:21.420959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065868+0000","last_change":"2023-09-30T16:50:16.071105+0000","last_active":"2023-09-30T16:50:17.065868+0000","last_peered":"2023-09-30T16:50:17.065868+0000","last_clean":"2023-09-30T16:50:17.065868+0000","last_became_active":"2023-09-30T16:50:16.070321+0000","last_became_peered":"2023-09-30T16:50:16.070321+0000","last_unstale":"2023-09-30T16:50:17.065868+0000","last_undegraded":"2023-09-30T16:50:17.065868+0000","last_fullsized":"2023-09-30T16:50:17.065868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:37.301400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066843+0000","last_change":"2023-09-30T16:50:15.041832+0000","last_active":"2023-09-30T16:50:17.066843+0000","last_peered":"2023-09-30T16:50:17.066843+0000","last_clean":"2023-09-30T16:50:17.066843+0000","last_became_active":"2023-09-30T16:50:15.041147+0000","last_became_peered":"2023-09-30T16:50:15.041147+0000","last_unstale":"2023-09-30T16:50:17.066843+0000","last_undegraded":"2023-09-30T16:50:17.066843+0000","last_fullsized":"2023-09-30T16:50:17.066843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:24:22.517588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066553+0000","last_change":"2023-09-30T16:50:16.073568+0000","last_active":"2023-09-30T16:50:17.066553+0000","last_peered":"2023-09-30T16:50:17.066553+0000","last_clean":"2023-09-30T16:50:17.066553+0000","last_became_active":"2023-09-30T16:50:16.072809+0000","last_became_peered":"2023-09-30T16:50:16.072809+0000","last_unstale":"2023-09-30T16:50:17.066553+0000","last_undegraded":"2023-09-30T16:50:17.066553+0000","last_fullsized":"2023-09-30T16:50:17.066553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:41:40.082913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045296+0000","last_change":"2023-09-30T16:50:15.022203+0000","last_active":"2023-09-30T16:50:17.045296+0000","last_peered":"2023-09-30T16:50:17.045296+0000","last_clean":"2023-09-30T16:50:17.045296+0000","last_became_active":"2023-09-30T16:50:15.021732+0000","last_became_peered":"2023-09-30T16:50:15.021732+0000","last_unstale":"2023-09-30T16:50:17.045296+0000","last_undegraded":"2023-09-30T16:50:17.045296+0000","last_fullsized":"2023-09-30T16:50:17.045296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:49:10.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065482+0000","last_change":"2023-09-30T16:50:16.070372+0000","last_active":"2023-09-30T16:50:17.065482+0000","last_peered":"2023-09-30T16:50:17.065482+0000","last_clean":"2023-09-30T16:50:17.065482+0000","last_became_active":"2023-09-30T16:50:16.069621+0000","last_became_peered":"2023-09-30T16:50:16.069621+0000","last_unstale":"2023-09-30T16:50:17.065482+0000","last_undegraded":"2023-09-30T16:50:17.065482+0000","last_fullsized":"2023-09-30T16:50:17.065482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:58:00.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065745+0000","last_change":"2023-09-30T16:50:15.015979+0000","last_active":"2023-09-30T16:50:17.065745+0000","last_peered":"2023-09-30T16:50:17.065745+0000","last_clean":"2023-09-30T16:50:17.065745+0000","last_became_active":"2023-09-30T16:50:15.015699+0000","last_became_peered":"2023-09-30T16:50:15.015699+0000","last_unstale":"2023-09-30T16:50:17.065745+0000","last_undegraded":"2023-09-30T16:50:17.065745+0000","last_fullsized":"2023-09-30T16:50:17.065745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:00:46.498081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066322+0000","last_change":"2023-09-30T16:50:16.075770+0000","last_active":"2023-09-30T16:50:17.066322+0000","last_peered":"2023-09-30T16:50:17.066322+0000","last_clean":"2023-09-30T16:50:17.066322+0000","last_became_active":"2023-09-30T16:50:16.074973+0000","last_became_peered":"2023-09-30T16:50:16.074973+0000","last_unstale":"2023-09-30T16:50:17.066322+0000","last_undegraded":"2023-09-30T16:50:17.066322+0000","last_fullsized":"2023-09-30T16:50:17.066322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:44:59.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064590+0000","last_change":"2023-09-30T16:50:15.036250+0000","last_active":"2023-09-30T16:50:17.064590+0000","last_peered":"2023-09-30T16:50:17.064590+0000","last_clean":"2023-09-30T16:50:17.064590+0000","last_became_active":"2023-09-30T16:50:15.035981+0000","last_became_peered":"2023-09-30T16:50:15.035981+0000","last_unstale":"2023-09-30T16:50:17.064590+0000","last_undegraded":"2023-09-30T16:50:17.064590+0000","last_fullsized":"2023-09-30T16:50:17.064590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:26.623186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.049298+0000","last_change":"2023-09-30T16:50:16.087431+0000","last_active":"2023-09-30T16:50:17.049298+0000","last_peered":"2023-09-30T16:50:17.049298+0000","last_clean":"2023-09-30T16:50:17.049298+0000","last_became_active":"2023-09-30T16:50:16.086837+0000","last_became_peered":"2023-09-30T16:50:16.086837+0000","last_unstale":"2023-09-30T16:50:17.049298+0000","last_undegraded":"2023-09-30T16:50:17.049298+0000","last_fullsized":"2023-09-30T16:50:17.049298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:35:42.340040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065897+0000","last_change":"2023-09-30T16:50:15.037822+0000","last_active":"2023-09-30T16:50:17.065897+0000","last_peered":"2023-09-30T16:50:17.065897+0000","last_clean":"2023-09-30T16:50:17.065897+0000","last_became_active":"2023-09-30T16:50:15.036490+0000","last_became_peered":"2023-09-30T16:50:15.036490+0000","last_unstale":"2023-09-30T16:50:17.065897+0000","last_undegraded":"2023-09-30T16:50:17.065897+0000","last_fullsized":"2023-09-30T16:50:17.065897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:06:41.623351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065652+0000","last_change":"2023-09-30T16:50:16.067725+0000","last_active":"2023-09-30T16:50:17.065652+0000","last_peered":"2023-09-30T16:50:17.065652+0000","last_clean":"2023-09-30T16:50:17.065652+0000","last_became_active":"2023-09-30T16:50:16.067086+0000","last_became_peered":"2023-09-30T16:50:16.067086+0000","last_unstale":"2023-09-30T16:50:17.065652+0000","last_undegraded":"2023-09-30T16:50:17.065652+0000","last_fullsized":"2023-09-30T16:50:17.065652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:07.830008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.045151+0000","last_change":"2023-09-30T16:50:15.020677+0000","last_active":"2023-09-30T16:50:17.045151+0000","last_peered":"2023-09-30T16:50:17.045151+0000","last_clean":"2023-09-30T16:50:17.045151+0000","last_became_active":"2023-09-30T16:50:15.020307+0000","last_became_peered":"2023-09-30T16:50:15.020307+0000","last_unstale":"2023-09-30T16:50:17.045151+0000","last_undegraded":"2023-09-30T16:50:17.045151+0000","last_fullsized":"2023-09-30T16:50:17.045151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:11.048187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.049176+0000","last_change":"2023-09-30T16:50:16.085503+0000","last_active":"2023-09-30T16:50:17.049176+0000","last_peered":"2023-09-30T16:50:17.049176+0000","last_clean":"2023-09-30T16:50:17.049176+0000","last_became_active":"2023-09-30T16:50:16.085179+0000","last_became_peered":"2023-09-30T16:50:16.085179+0000","last_unstale":"2023-09-30T16:50:17.049176+0000","last_undegraded":"2023-09-30T16:50:17.049176+0000","last_fullsized":"2023-09-30T16:50:17.049176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:55.836359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065035+0000","last_change":"2023-09-30T16:50:15.027424+0000","last_active":"2023-09-30T16:50:17.065035+0000","last_peered":"2023-09-30T16:50:17.065035+0000","last_clean":"2023-09-30T16:50:17.065035+0000","last_became_active":"2023-09-30T16:50:15.027084+0000","last_became_peered":"2023-09-30T16:50:15.027084+0000","last_unstale":"2023-09-30T16:50:17.065035+0000","last_undegraded":"2023-09-30T16:50:17.065035+0000","last_fullsized":"2023-09-30T16:50:17.065035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:17.409054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063794+0000","last_change":"2023-09-30T16:50:16.081783+0000","last_active":"2023-09-30T16:50:17.063794+0000","last_peered":"2023-09-30T16:50:17.063794+0000","last_clean":"2023-09-30T16:50:17.063794+0000","last_became_active":"2023-09-30T16:50:16.081068+0000","last_became_peered":"2023-09-30T16:50:16.081068+0000","last_unstale":"2023-09-30T16:50:17.063794+0000","last_undegraded":"2023-09-30T16:50:17.063794+0000","last_fullsized":"2023-09-30T16:50:17.063794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:39:38.790053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064709+0000","last_change":"2023-09-30T16:50:15.018398+0000","last_active":"2023-09-30T16:50:17.064709+0000","last_peered":"2023-09-30T16:50:17.064709+0000","last_clean":"2023-09-30T16:50:17.064709+0000","last_became_active":"2023-09-30T16:50:15.018025+0000","last_became_peered":"2023-09-30T16:50:15.018025+0000","last_unstale":"2023-09-30T16:50:17.064709+0000","last_undegraded":"2023-09-30T16:50:17.064709+0000","last_fullsized":"2023-09-30T16:50:17.064709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:49.418950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.067058+0000","last_change":"2023-09-30T16:50:16.075908+0000","last_active":"2023-09-30T16:50:17.067058+0000","last_peered":"2023-09-30T16:50:17.067058+0000","last_clean":"2023-09-30T16:50:17.067058+0000","last_became_active":"2023-09-30T16:50:16.075079+0000","last_became_peered":"2023-09-30T16:50:16.075079+0000","last_unstale":"2023-09-30T16:50:17.067058+0000","last_undegraded":"2023-09-30T16:50:17.067058+0000","last_fullsized":"2023-09-30T16:50:17.067058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:13:12.052047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050237+0000","last_change":"2023-09-30T16:50:15.022501+0000","last_active":"2023-09-30T16:50:17.050237+0000","last_peered":"2023-09-30T16:50:17.050237+0000","last_clean":"2023-09-30T16:50:17.050237+0000","last_became_active":"2023-09-30T16:50:15.021887+0000","last_became_peered":"2023-09-30T16:50:15.021887+0000","last_unstale":"2023-09-30T16:50:17.050237+0000","last_undegraded":"2023-09-30T16:50:17.050237+0000","last_fullsized":"2023-09-30T16:50:17.050237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:46:29.667728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066364+0000","last_change":"2023-09-30T16:50:16.060503+0000","last_active":"2023-09-30T16:50:17.066364+0000","last_peered":"2023-09-30T16:50:17.066364+0000","last_clean":"2023-09-30T16:50:17.066364+0000","last_became_active":"2023-09-30T16:50:16.059751+0000","last_became_peered":"2023-09-30T16:50:16.059751+0000","last_unstale":"2023-09-30T16:50:17.066364+0000","last_undegraded":"2023-09-30T16:50:17.066364+0000","last_fullsized":"2023-09-30T16:50:17.066364+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:29.137674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:18.107780+0000","last_change":"2023-09-30T16:50:15.030676+0000","last_active":"2023-09-30T16:50:18.107780+0000","last_peered":"2023-09-30T16:50:18.107780+0000","last_clean":"2023-09-30T16:50:18.107780+0000","last_became_active":"2023-09-30T16:50:15.029867+0000","last_became_peered":"2023-09-30T16:50:15.029867+0000","last_unstale":"2023-09-30T16:50:18.107780+0000","last_undegraded":"2023-09-30T16:50:18.107780+0000","last_fullsized":"2023-09-30T16:50:18.107780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:04:59.441267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.066345+0000","last_change":"2023-09-30T16:50:16.084326+0000","last_active":"2023-09-30T16:50:17.066345+0000","last_peered":"2023-09-30T16:50:17.066345+0000","last_clean":"2023-09-30T16:50:17.066345+0000","last_became_active":"2023-09-30T16:50:16.083377+0000","last_became_peered":"2023-09-30T16:50:16.083377+0000","last_unstale":"2023-09-30T16:50:17.066345+0000","last_undegraded":"2023-09-30T16:50:17.066345+0000","last_fullsized":"2023-09-30T16:50:17.066345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:12.408648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050979+0000","last_change":"2023-09-30T16:50:15.025811+0000","last_active":"2023-09-30T16:50:17.050979+0000","last_peered":"2023-09-30T16:50:17.050979+0000","last_clean":"2023-09-30T16:50:17.050979+0000","last_became_active":"2023-09-30T16:50:15.024610+0000","last_became_peered":"2023-09-30T16:50:15.024610+0000","last_unstale":"2023-09-30T16:50:17.050979+0000","last_undegraded":"2023-09-30T16:50:17.050979+0000","last_fullsized":"2023-09-30T16:50:17.050979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:23.338863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.063755+0000","last_change":"2023-09-30T16:50:16.056239+0000","last_active":"2023-09-30T16:50:17.063755+0000","last_peered":"2023-09-30T16:50:17.063755+0000","last_clean":"2023-09-30T16:50:17.063755+0000","last_became_active":"2023-09-30T16:50:16.055357+0000","last_became_peered":"2023-09-30T16:50:16.055357+0000","last_unstale":"2023-09-30T16:50:17.063755+0000","last_undegraded":"2023-09-30T16:50:17.063755+0000","last_fullsized":"2023-09-30T16:50:17.063755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:53:49.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.050220+0000","last_change":"2023-09-30T16:50:15.021278+0000","last_active":"2023-09-30T16:50:17.050220+0000","last_peered":"2023-09-30T16:50:17.050220+0000","last_clean":"2023-09-30T16:50:17.050220+0000","last_became_active":"2023-09-30T16:50:15.020466+0000","last_became_peered":"2023-09-30T16:50:15.020466+0000","last_unstale":"2023-09-30T16:50:17.050220+0000","last_undegraded":"2023-09-30T16:50:17.050220+0000","last_fullsized":"2023-09-30T16:50:17.050220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:54.479897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051839+0000","last_change":"2023-09-30T16:50:16.092246+0000","last_active":"2023-09-30T16:50:17.051839+0000","last_peered":"2023-09-30T16:50:17.051839+0000","last_clean":"2023-09-30T16:50:17.051839+0000","last_became_active":"2023-09-30T16:50:16.089779+0000","last_became_peered":"2023-09-30T16:50:16.089779+0000","last_unstale":"2023-09-30T16:50:17.051839+0000","last_undegraded":"2023-09-30T16:50:17.051839+0000","last_fullsized":"2023-09-30T16:50:17.051839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:04:38.600032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.049531+0000","last_change":"2023-09-30T16:50:15.023920+0000","last_active":"2023-09-30T16:50:17.049531+0000","last_peered":"2023-09-30T16:50:17.049531+0000","last_clean":"2023-09-30T16:50:17.049531+0000","last_became_active":"2023-09-30T16:50:15.023220+0000","last_became_peered":"2023-09-30T16:50:15.023220+0000","last_unstale":"2023-09-30T16:50:17.049531+0000","last_undegraded":"2023-09-30T16:50:17.049531+0000","last_fullsized":"2023-09-30T16:50:17.049531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:14:42.405587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051052+0000","last_change":"2023-09-30T16:50:16.080672+0000","last_active":"2023-09-30T16:50:17.051052+0000","last_peered":"2023-09-30T16:50:17.051052+0000","last_clean":"2023-09-30T16:50:17.051052+0000","last_became_active":"2023-09-30T16:50:16.079926+0000","last_became_peered":"2023-09-30T16:50:16.079926+0000","last_unstale":"2023-09-30T16:50:17.051052+0000","last_undegraded":"2023-09-30T16:50:17.051052+0000","last_fullsized":"2023-09-30T16:50:17.051052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:12.972666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.044574+0000","last_change":"2023-09-30T16:50:15.021269+0000","last_active":"2023-09-30T16:50:17.044574+0000","last_peered":"2023-09-30T16:50:17.044574+0000","last_clean":"2023-09-30T16:50:17.044574+0000","last_became_active":"2023-09-30T16:50:15.020851+0000","last_became_peered":"2023-09-30T16:50:15.020851+0000","last_unstale":"2023-09-30T16:50:17.044574+0000","last_undegraded":"2023-09-30T16:50:17.044574+0000","last_fullsized":"2023-09-30T16:50:17.044574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:37:44.728942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064712+0000","last_change":"2023-09-30T16:50:16.059377+0000","last_active":"2023-09-30T16:50:17.064712+0000","last_peered":"2023-09-30T16:50:17.064712+0000","last_clean":"2023-09-30T16:50:17.064712+0000","last_became_active":"2023-09-30T16:50:16.058566+0000","last_became_peered":"2023-09-30T16:50:16.058566+0000","last_unstale":"2023-09-30T16:50:17.064712+0000","last_undegraded":"2023-09-30T16:50:17.064712+0000","last_fullsized":"2023-09-30T16:50:17.064712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:19:09.131472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.051262+0000","last_change":"2023-09-30T16:50:15.024854+0000","last_active":"2023-09-30T16:50:17.051262+0000","last_peered":"2023-09-30T16:50:17.051262+0000","last_clean":"2023-09-30T16:50:17.051262+0000","last_became_active":"2023-09-30T16:50:15.024136+0000","last_became_peered":"2023-09-30T16:50:15.024136+0000","last_unstale":"2023-09-30T16:50:17.051262+0000","last_undegraded":"2023-09-30T16:50:17.051262+0000","last_fullsized":"2023-09-30T16:50:17.051262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:35:41.336179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.064427+0000","last_change":"2023-09-30T16:50:16.062229+0000","last_active":"2023-09-30T16:50:17.064427+0000","last_peered":"2023-09-30T16:50:17.064427+0000","last_clean":"2023-09-30T16:50:17.064427+0000","last_became_active":"2023-09-30T16:50:16.061429+0000","last_became_peered":"2023-09-30T16:50:16.061429+0000","last_unstale":"2023-09-30T16:50:17.064427+0000","last_undegraded":"2023-09-30T16:50:17.064427+0000","last_fullsized":"2023-09-30T16:50:17.064427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:14.985761+0000","last_clean_scrub_stamp":"2023-09-30T16:50:14.985761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:25:57.162350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-09-30T16:50:17.065776+0000","last_change":"2023-09-30T16:50:15.015598+0000","last_active":"2023-09-30T16:50:17.065776+0000","last_peered":"2023-09-30T16:50:17.065776+0000","last_clean":"2023-09-30T16:50:17.065776+0000","last_became_active":"2023-09-30T16:50:15.015171+0000","last_became_peered":"2023-09-30T16:50:15.015171+0000","last_unstale":"2023-09-30T16:50:17.065776+0000","last_undegraded":"2023-09-30T16:50:17.065776+0000","last_fullsized":"2023-09-30T16:50:17.065776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:50:13.981901+0000","last_clean_scrub_stamp":"2023-09-30T16:50:13.981901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:30:22.789263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-09-30T16:50:16.054230+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-09-30T16:50:16.054230+0000","last_peered":"2023-09-30T16:50:16.054230+0000","last_clean":"2023-09-30T16:50:16.054230+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-09-30T16:50:16.054230+0000","last_undegraded":"2023-09-30T16:50:16.054230+0000","last_fullsized":"2023-09-30T16:50:16.054230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.0229999999999999}]},{"osd":1,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.101}]},{"osd":2,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.073},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Sat Sep 30 16:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.143}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":156453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":1.169}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.2490000000000001}]},{"osd":2,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.0549999999999999}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.089},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.2110000000000001}]},{"osd":4,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.022}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":745791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.0509999999999999}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.0049999999999999}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.204},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.0820000000000001}]},{"osd":4,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.2509999999999999}]},{"osd":6,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.2290000000000001}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.151},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.292}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.302},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.073}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.145},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.359}]},{"osd":5,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.004},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0369999999999999}]},{"osd":6,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.1850000000000001}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.413}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":409600,"data_stored":155617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1,"5min":1,"15min":1},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.871}]},{"osd":5,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.141}]},{"osd":6,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.95399999999999996}]},{"osd":7,"last update":"Sat Sep 30 16:50:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.0029999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.436},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.98499999999999999}]},{"osd":3,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":1.0169999999999999}]},{"osd":4,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.302},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0489999999999999}]},{"osd":5,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.88600000000000001}]},{"osd":6,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.069},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.2649999999999999}]},{"osd":7,"last update":"Sat Sep 30 16:50:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.109},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.099}]},{"osd":4,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.141},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.96899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":745279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.752}]},{"osd":2,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.1599999999999999}]},{"osd":3,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0029999999999999}]},{"osd":4,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.401}]},{"osd":5,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.508},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.222}]},{"osd":6,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.357}]},{"osd":7,"last update":"Sat Sep 30 16:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.4390000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T16:50:19.779 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T16:50:19.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T16:50:19.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.938+0000 7fcd5585c640 1 Processor -- start 2023-09-30T16:50:19.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.938+0000 7fcd5585c640 1 -- start start 2023-09-30T16:50:19.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd5585c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 0x7fcd500b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd5585c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcd500c9460 0x7fcd500b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd5585c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd500aded0 con 0x7fcd50159080 2023-09-30T16:50:19.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd5585c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd50159460 con 0x7fcd500c9460 2023-09-30T16:50:19.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd5585c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5006d510 con 0x7fcd5006d060 2023-09-30T16:50:19.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 0x7fcd500b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcd500c9460 0x7fcd500b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 0x7fcd500b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:36336/0 (socket says 172.21.15.52:36336) 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 -- 172.21.15.52:0/1819251343 learned_addr learned my addr 172.21.15.52:0/1819251343 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4effd640 1 --1- 172.21.15.52:0/1819251343 >> v1:172.21.15.186:6789/0 conn(0x7fcd50159080 0x7fcd5006c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:39276/0 (socket says 172.21.15.52:39276) 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 -- 172.21.15.52:0/1819251343 >> v2:172.21.15.186:3300/0 conn(0x7fcd500c9460 msgr2=0x7fcd500b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 --2- 172.21.15.52:0/1819251343 >> v2:172.21.15.186:3300/0 conn(0x7fcd500c9460 0x7fcd500b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 -- 172.21.15.52:0/1819251343 >> v1:172.21.15.186:6789/0 conn(0x7fcd50159080 legacy=0x7fcd5006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.942+0000 7fcd4e7fc640 1 -- 172.21.15.52:0/1819251343 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5006d7f0 con 0x7fcd5006d060 2023-09-30T16:50:19.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4e7fc640 1 --2- 172.21.15.52:0/1819251343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 0x7fcd500b00a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009e50 tx=0x7fcd4001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f385807f355c2f49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4dffb640 1 -- 172.21.15.52:0/1819251343 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400a5820 con 0x7fcd5006d060 2023-09-30T16:50:19.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4dffb640 1 -- 172.21.15.52:0/1819251343 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd400a5980 con 0x7fcd5006d060 2023-09-30T16:50:19.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4dffb640 1 -- 172.21.15.52:0/1819251343 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400a5d10 con 0x7fcd5006d060 2023-09-30T16:50:19.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819251343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 msgr2=0x7fcd500b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819251343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 0x7fcd500b00a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009e50 tx=0x7fcd4001c9e0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819251343 shutdown_connections 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819251343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd5006d060 0x7fcd500b00a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819251343 >> v2:172.21.15.186:3300/0 conn(0x7fcd500c9460 0x7fcd500b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819251343 >> 172.21.15.52:0/1819251343 conn(0x7fcd5006a5c0 msgr2=0x7fcd500ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819251343 shutdown_connections 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819251343 wait complete. 2023-09-30T16:50:19.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 Processor -- start 2023-09-30T16:50:19.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- start start 2023-09-30T16:50:19.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 0x7fcd50148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd500c9460 0x7fcd50070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd50159080 0x7fcd500705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c5190 con 0x7fcd5006d060 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c4270 con 0x7fcd500c9460 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd5585c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500c4510 con 0x7fcd50159080 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 0x7fcd50148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 0x7fcd50148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44806/0 (socket says 172.21.15.52:44806) 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4effd640 1 -- 172.21.15.52:0/1819309652 learned_addr learned my addr 172.21.15.52:0/1819309652 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4f7fe640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd50159080 0x7fcd500705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.946+0000 7fcd4e7fc640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd500c9460 0x7fcd50070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4effd640 1 -- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd50159080 msgr2=0x7fcd500705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4effd640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd50159080 0x7fcd500705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4effd640 1 -- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd500c9460 msgr2=0x7fcd50070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4effd640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd500c9460 0x7fcd50070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4effd640 1 -- 172.21.15.52:0/1819309652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009b30 con 0x7fcd5006d060 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4f7fe640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd50159080 0x7fcd500705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4effd640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 0x7fcd50148170 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400c370 tx=0x7fcd4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd440074e0 con 0x7fcd5006d060 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd44007640 con 0x7fcd5006d060 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44004a30 con 0x7fcd5006d060 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500c47f0 con 0x7fcd5006d060 2023-09-30T16:50:19.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500c4db0 con 0x7fcd5006d060 2023-09-30T16:50:19.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd500740a0 con 0x7fcd5006d060 2023-09-30T16:50:19.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fcd44004b90 con 0x7fcd5006d060 2023-09-30T16:50:19.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd37fff640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd3c066190 0x7fcd3c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:19.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd440832d0 con 0x7fcd5006d060 2023-09-30T16:50:19.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4e7fc640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd3c066190 0x7fcd3c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:19.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.950+0000 7fcd4e7fc640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd3c066190 0x7fcd3c068650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd400ae000 tx=0x7fcd400a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:19.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:19.954+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fcd44050980 con 0x7fcd5006d060 2023-09-30T16:50:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.166+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcd5006c1e0 con 0x7fcd5006d060 2023-09-30T16:50:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.170+0000 7fcd37fff640 1 -- 172.21.15.52:0/1819309652 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fcd44053fa0 con 0x7fcd5006d060 2023-09-30T16:50:20.174 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2023-09-30T16:50:20.174 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUURhlmBlVGRAAbcs+tyuczQOq3IgP2hhLGQ== 2023-09-30T16:50:20.174 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2023-09-30T16:50:20.175 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2023-09-30T16:50:20.175 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-30T16:50:20.175 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-09-30T16:50:20.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd3c066190 msgr2=0x7fcd3c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd3c066190 0x7fcd3c068650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd400ae000 tx=0x7fcd400a7070 comp rx=0 tx=0).stop 2023-09-30T16:50:20.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 msgr2=0x7fcd50148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 0x7fcd50148170 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400c370 tx=0x7fcd4400c830 comp rx=0 tx=0).stop 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 shutdown_connections 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fcd3c066190 0x7fcd3c068650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd50159080 0x7fcd500705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd500c9460 0x7fcd50070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 --2- 172.21.15.52:0/1819309652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5006d060 0x7fcd50148170 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 >> 172.21.15.52:0/1819309652 conn(0x7fcd5006a5c0 msgr2=0x7fcd500cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 shutdown_connections 2023-09-30T16:50:20.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.174+0000 7fcd5585c640 1 -- 172.21.15.52:0/1819309652 wait complete. 2023-09-30T16:50:20.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T16:50:20.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 Processor -- start 2023-09-30T16:50:20.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 -- start start 2023-09-30T16:50:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f74bc15ce10 0x7f74bc0b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f74bc0cd870 0x7f74bc0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc0b7570 con 0x7f74bc0d0fa0 2023-09-30T16:50:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0b7850 con 0x7f74bc0cd870 2023-09-30T16:50:20.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74c101e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0b7b30 con 0x7f74bc15ce10 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74b259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f74bc0cd870 0x7f74bc0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74bb59e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f74bc0d0fa0 0x7f74bc0d1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40874/0 (socket says 172.21.15.52:40874) 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74b259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f74bc0cd870 0x7f74bc0cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44820/0 (socket says 172.21.15.52:44820) 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74bb59e640 1 -- 172.21.15.52:0/3363551478 learned_addr learned my addr 172.21.15.52:0/3363551478 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74bad9d640 1 --2- 172.21.15.52:0/3363551478 >> v2:172.21.15.186:3300/0 conn(0x7f74bc15ce10 0x7f74bc0b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74b259c640 1 -- 172.21.15.52:0/3363551478 >> v2:172.21.15.186:3300/0 conn(0x7f74bc15ce10 msgr2=0x7f74bc0b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74b259c640 1 --2- 172.21.15.52:0/3363551478 >> v2:172.21.15.186:3300/0 conn(0x7f74bc15ce10 0x7f74bc0b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74b259c640 1 -- 172.21.15.52:0/3363551478 >> v1:172.21.15.52:6789/0 conn(0x7f74bc0d0fa0 legacy=0x7f74bc0d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74ba59c640 1 -- 172.21.15.52:0/3363551478 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926089739 0 0) 0x7f74bc0b7570 con 0x7f74bc0d0fa0 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74b259c640 1 -- 172.21.15.52:0/3363551478 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc0b7e10 con 0x7f74bc0cd870 2023-09-30T16:50:20.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.306+0000 7f74bad9d640 1 --2- 172.21.15.52:0/3363551478 >> v2:172.21.15.186:3300/0 conn(0x7f74bc15ce10 0x7f74bc0b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74b259c640 1 --2- 172.21.15.52:0/3363551478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc0cd870 0x7f74bc0cdcb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0b4e30 tx=0x7f74a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebbef49adc67afb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74ba59c640 1 -- 172.21.15.52:0/3363551478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40ab5f0 con 0x7f74bc0cd870 2023-09-30T16:50:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74ba59c640 1 -- 172.21.15.52:0/3363551478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40ab750 con 0x7f74bc0cd870 2023-09-30T16:50:20.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74ba59c640 1 -- 172.21.15.52:0/3363551478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40abae0 con 0x7f74bc0cd870 2023-09-30T16:50:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- 172.21.15.52:0/3363551478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc0cd870 msgr2=0x7f74bc0cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 --2- 172.21.15.52:0/3363551478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc0cd870 0x7f74bc0cdcb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0b4e30 tx=0x7f74a401c3d0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- 172.21.15.52:0/3363551478 shutdown_connections 2023-09-30T16:50:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 --2- 172.21.15.52:0/3363551478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc0cd870 0x7f74bc0cdcb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 --2- 172.21.15.52:0/3363551478 >> v2:172.21.15.186:3300/0 conn(0x7f74bc15ce10 0x7f74bc0b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- 172.21.15.52:0/3363551478 >> 172.21.15.52:0/3363551478 conn(0x7f74bc071930 msgr2=0x7f74bc071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- 172.21.15.52:0/3363551478 shutdown_connections 2023-09-30T16:50:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- 172.21.15.52:0/3363551478 wait complete. 2023-09-30T16:50:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 Processor -- start 2023-09-30T16:50:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- start start 2023-09-30T16:50:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc0cd870 0x7f74bc14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:20.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74bc0d0fa0 0x7f74bc1f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 0x7f74bc1f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc14e0d0 con 0x7f74bc158610 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1f5f00 con 0x7f74bc0cd870 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.310+0000 7f74c101e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc15d310 con 0x7f74bc0d0fa0 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 0x7f74bc1f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 0x7f74bc1f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44828/0 (socket says 172.21.15.52:44828) 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 -- 172.21.15.52:0/2596152347 learned_addr learned my addr 172.21.15.52:0/2596152347 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bad9d640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc0cd870 0x7f74bc14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b259c640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74bc0d0fa0 0x7f74bc1f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 -- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74bc0d0fa0 msgr2=0x7f74bc1f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74bc0d0fa0 0x7f74bc1f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 -- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc0cd870 msgr2=0x7f74bc14db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc0cd870 0x7f74bc14db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 -- 172.21.15.52:0/2596152347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009420 con 0x7f74bc158610 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bad9d640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc0cd870 0x7f74bc14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bb59e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 0x7f74bc1f4e90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f74b4001570 tx=0x7f74b400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400a640 con 0x7f74bc158610 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b400a7c0 con 0x7f74bc158610 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc1f5940 con 0x7f74bc158610 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400ab70 con 0x7f74bc158610 2023-09-30T16:50:20.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc1f8640 con 0x7f74bc158610 2023-09-30T16:50:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc0740a0 con 0x7f74bc158610 2023-09-30T16:50:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f74b400acd0 con 0x7f74bc158610 2023-09-30T16:50:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b3fff640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f749c066160 0x7f749c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74b40832c0 con 0x7f74bc158610 2023-09-30T16:50:20.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.314+0000 7f74bad9d640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f749c066160 0x7f749c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.318+0000 7f74bad9d640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f749c066160 0x7f749c068620 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0079d0 tx=0x7f74ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.318+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f74b40508d0 con 0x7f74bc158610 2023-09-30T16:50:20.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.506+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74bc072090 con 0x7f74bc158610 2023-09-30T16:50:20.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.506+0000 7f74b3fff640 1 -- 172.21.15.52:0/2596152347 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f74b4053ef0 con 0x7f74bc158610 2023-09-30T16:50:20.510 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:20.510 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:50:15.359964+0000","modified":"2023-09-30T16:50:17.412644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4945":{"gid":4945,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.186:6837/2755050347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2755050347},{"type":"v1","addr":"172.21.15.186:6837","nonce":2755050347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T16:50:20.510 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 14 2023-09-30T16:50:20.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f749c066160 msgr2=0x7f749c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f749c066160 0x7f749c068620 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0079d0 tx=0x7f74ac008040 comp rx=0 tx=0).stop 2023-09-30T16:50:20.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 msgr2=0x7f74bc1f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 0x7f74bc1f4e90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f74b4001570 tx=0x7f74b400cca0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 shutdown_connections 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f749c066160 0x7f749c068620 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc158610 0x7f74bc1f4e90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74bc0d0fa0 0x7f74bc1f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 --2- 172.21.15.52:0/2596152347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74bc0cd870 0x7f74bc14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 >> 172.21.15.52:0/2596152347 conn(0x7f74bc071930 msgr2=0x7f74bc156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 shutdown_connections 2023-09-30T16:50:20.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:20.510+0000 7f74c101e640 1 -- 172.21.15.52:0/2596152347 wait complete. 2023-09-30T16:50:20.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T16:50:15.359964+0000', 'modified': '2023-09-30T16:50:17.412644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4945}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4945': {'gid': 4945, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.186:6837/2755050347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 2755050347}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 2755050347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T16:50:20.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T16:50:20.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-30T16:50:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.066+0000 7f31d2150640 1 Processor -- start 2023-09-30T16:50:21.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.066+0000 7f31d2150640 1 -- start start 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31cc0712b0 0x7f31cc0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc06dfc0 con 0x7f31cc142170 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc06e2a0 con 0x7f31cc0712b0 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc06e580 con 0x7f31cc141d90 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31cc0712b0 0x7f31cc0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31cc0712b0 0x7f31cc0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44834/0 (socket says 172.21.15.52:44834) 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 -- 172.21.15.52:0/3655873406 learned_addr learned my addr 172.21.15.52:0/3655873406 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/3655873406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 -- 172.21.15.52:0/3655873406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 msgr2=0x7f31cc142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 --2- 172.21.15.52:0/3655873406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 -- 172.21.15.52:0/3655873406 >> v1:172.21.15.186:6789/0 conn(0x7f31cc142170 legacy=0x7f31cc070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 -- 172.21.15.52:0/3655873406 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc06e860 con 0x7f31cc0712b0 2023-09-30T16:50:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31cbfff640 1 --2- 172.21.15.52:0/3655873406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc0cd940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f31c400d150 tx=0x7f31c401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bee63b4d02cff6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31ca7fc640 1 -- 172.21.15.52:0/3655873406 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c40a7b50 con 0x7f31cc0712b0 2023-09-30T16:50:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31ca7fc640 1 -- 172.21.15.52:0/3655873406 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c40ab070 con 0x7f31cc0712b0 2023-09-30T16:50:21.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31ca7fc640 1 -- 172.21.15.52:0/3655873406 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c40b1400 con 0x7f31cc0712b0 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- 172.21.15.52:0/3655873406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 msgr2=0x7f31cc0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 --2- 172.21.15.52:0/3655873406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc0cd940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f31c400d150 tx=0x7f31c401eba0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- 172.21.15.52:0/3655873406 shutdown_connections 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 --2- 172.21.15.52:0/3655873406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc0cd940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 --2- 172.21.15.52:0/3655873406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- 172.21.15.52:0/3655873406 >> 172.21.15.52:0/3655873406 conn(0x7f31cc0cbb80 msgr2=0x7f31cc0cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- 172.21.15.52:0/3655873406 shutdown_connections 2023-09-30T16:50:21.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.070+0000 7f31d2150640 1 -- 172.21.15.52:0/3655873406 wait complete. 2023-09-30T16:50:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 Processor -- start 2023-09-30T16:50:21.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 -- start start 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc1f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31cc142170 0x7f31cc0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc154bd0 con 0x7f31cc0712b0 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc156700 con 0x7f31cc142170 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1f97b0 con 0x7f31cc141d90 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc1f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc1f64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44846/0 (socket says 172.21.15.52:44846) 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1766224203 learned_addr learned my addr 172.21.15.52:0/1766224203 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cbfff640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31cc142170 0x7f31cc0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31caffd640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 msgr2=0x7f31cc154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31cc142170 msgr2=0x7f31cc0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31cc142170 0x7f31cc0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1766224203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c400bd40 con 0x7f31cc0712b0 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cbfff640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31cc142170 0x7f31cc0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc1f64f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d830 tx=0x7f31bc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31b3fff640 1 -- 172.21.15.52:0/1766224203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00b6c0 con 0x7f31cc0712b0 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31b3fff640 1 -- 172.21.15.52:0/1766224203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00b820 con 0x7f31cc0712b0 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc1f9a90 con 0x7f31cc0712b0 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31b3fff640 1 -- 172.21.15.52:0/1766224203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00bb90 con 0x7f31cc0712b0 2023-09-30T16:50:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc0afd10 con 0x7f31cc0712b0 2023-09-30T16:50:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.074+0000 7f31b3fff640 1 -- 172.21.15.52:0/1766224203 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f31bc01e460 con 0x7f31cc0712b0 2023-09-30T16:50:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31b3fff640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f31b8066190 0x7f31b8068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31b3fff640 1 -- 172.21.15.52:0/1766224203 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31bc0841b0 con 0x7f31cc0712b0 2023-09-30T16:50:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f31b8066190 0x7f31b8068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 Processor -- start 2023-09-30T16:50:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- start start 2023-09-30T16:50:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f31b8066190 0x7f31b8068650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0af720 tx=0x7f31c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47675e0 0x5603b47679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 0x5603b471d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b471e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b4512cc0 con 0x5603b4767f00 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b45758e0 con 0x5603b471dd50 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603b4572e10 con 0x5603b47675e0 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 0x5603b471d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 0x5603b471d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44854/0 (socket says 172.21.15.52:44854) 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 -- 172.21.15.52:0/1565952046 learned_addr learned my addr 172.21.15.52:0/1565952046 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47675e0 0x5603b47679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31cbfff640 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b471e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 -- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47675e0 msgr2=0x5603b47679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47675e0 0x5603b47679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 -- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 msgr2=0x5603b471e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b471e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 -- 172.21.15.52:0/1565952046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603b4267890 con 0x5603b4767f00 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31caffd640 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 0x5603b471d810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c8e0 tx=0x7f31c000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93700da0f55fb651 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31b17fa640 1 -- 172.21.15.52:0/1565952046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0013b80 con 0x5603b4767f00 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31b17fa640 1 -- 172.21.15.52:0/1565952046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0013ce0 con 0x5603b4767f00 2023-09-30T16:50:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31b17fa640 1 -- 172.21.15.52:0/1565952046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c001d630 con 0x5603b4767f00 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- 172.21.15.52:0/1565952046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 msgr2=0x5603b471d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 0x5603b471d810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c8e0 tx=0x7f31c000f000 comp rx=0 tx=0).stop 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- 172.21.15.52:0/1565952046 shutdown_connections 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b471e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4767f00 0x5603b471d810 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 --2- 172.21.15.52:0/1565952046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47675e0 0x5603b47679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- 172.21.15.52:0/1565952046 >> 172.21.15.52:0/1565952046 conn(0x5603b47244e0 msgr2=0x5603b471c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- 172.21.15.52:0/1565952046 shutdown_connections 2023-09-30T16:50:21.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.078+0000 7f31d5297000 1 -- 172.21.15.52:0/1565952046 wait complete. 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- start start 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 Processor -- start 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 0x5603b47559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b47675e0 0x5603b4755f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4767f00 0x5603b4756440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b456e700 con 0x5603b471dd50 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b452dd10 con 0x5603b47675e0 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603b452d9b0 con 0x5603b4767f00 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 10 client.0 _ll_register_callbacks cb 0x5603b47096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T16:50:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 0x5603b47559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 0x5603b47559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44856/0 (socket says 172.21.15.52:44856) 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1082753046 learned_addr learned my addr 172.21.15.52:0/1082753046 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cbfff640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4767f00 0x5603b4756440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31caffd640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b47675e0 0x5603b4755f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4767f00 msgr2=0x5603b4756440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4767f00 0x5603b4756440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b47675e0 msgr2=0x5603b4755f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b47675e0 0x5603b4755f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 -- 172.21.15.52:0/1082753046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c000c5c0 con 0x5603b471dd50 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cbfff640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4767f00 0x5603b4756440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31caffd640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b47675e0 0x5603b4755f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 0x5603b47559c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00b4b0 tx=0x7f31bc055cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4eb4c61344a64e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 1 -- 172.21.15.52:0/1082753046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc06c070 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603b4522370 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 1 -- 172.21.15.52:0/1082753046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31bc059170 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 1 -- 172.21.15.52:0/1082753046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31bc059330 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 10 client.5385 fetch_fsmap learned FSMap version 14 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5603b4530460 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 1 -- 172.21.15.52:0/1082753046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5603b4522370 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 1 -- 172.21.15.52:0/1082753046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f31bc082250 con 0x5603b471dd50 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 10 client.5385 fetch_fsmap finished waiting for FSMap version 14 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 10 client.5385 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 20 client.5385 populate_metadata read hostname 'smithi052' 2023-09-30T16:50:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b4756e50 0x5603b47798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 4 client.5385 mds_command: new command op to 4945 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 --> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603b45082d0 con 0x5603b4756e50 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31caffd640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b4756e50 0x5603b47798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31caffd640 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b4756e50 0x5603b47798a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e32531f1b152bf70 server_cookie=9b148eb2d8f9435c in_seq=0 out_seq=0 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.082+0000 7f31aa7fc640 10 client.5385 ms_handle_connect on v2:172.21.15.186:6836/2755050347 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31aa7fc640 1 -- 172.21.15.52:0/1082753046 <== mds.0 v2:172.21.15.186:6836/2755050347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5603b45082d0 con 0x5603b4756e50 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31aa7fc640 10 client.5385 handle_command_reply: tid=0 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 client.5385 shutdown 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 msgr2=0x5603b47559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 0x5603b47559c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00b4b0 tx=0x7f31bc055cc0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 shutdown_connections 2023-09-30T16:50:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b4756e50 0x5603b47798a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4767f00 0x5603b4756440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b47675e0 0x5603b4755f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31aa7fc640 0 client.5385 ms_handle_reset on v2:172.21.15.186:6836/2755050347 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 --2- 172.21.15.52:0/1082753046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b471dd50 0x5603b47559c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 >> 172.21.15.52:0/1082753046 conn(0x5603b47244e0 msgr2=0x5603b471c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 shutdown_connections 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 1 -- 172.21.15.52:0/1082753046 wait complete. 2023-09-30T16:50:21.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.086+0000 7f31d5297000 20 client.5385 trim_cache size 0 max 16384 2023-09-30T16:50:21.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.098+0000 7f31d5297000 1 Processor -- start 2023-09-30T16:50:21.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.098+0000 7f31d5297000 1 -- start start 2023-09-30T16:50:21.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 0x5603b4754230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b4754770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4756e50 0x5603b4777890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b4228940 con 0x5603b47244e0 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b4537720 con 0x5603b471dd50 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603b4572700 con 0x5603b4756e50 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 0x5603b4754230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 0x5603b4754230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44872/0 (socket says 172.21.15.52:44872) 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 -- 172.21.15.52:0/3440288399 learned_addr learned my addr 172.21.15.52:0/3440288399 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 -- 172.21.15.52:0/3440288399 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4756e50 msgr2=0x5603b4777890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4756e50 0x5603b4777890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 -- 172.21.15.52:0/3440288399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 msgr2=0x5603b4754770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b4754770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 -- 172.21.15.52:0/3440288399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603b4516760 con 0x5603b47244e0 2023-09-30T16:50:21.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 0x5603b4754230 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f31bc05d250 tx=0x7f31bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9676329dfa13e18d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31b1ffb640 1 -- 172.21.15.52:0/3440288399 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc06c040 con 0x5603b47244e0 2023-09-30T16:50:21.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31b1ffb640 1 -- 172.21.15.52:0/3440288399 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0731f0 con 0x5603b47244e0 2023-09-30T16:50:21.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31b1ffb640 1 -- 172.21.15.52:0/3440288399 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc054de0 con 0x5603b47244e0 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- 172.21.15.52:0/3440288399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 msgr2=0x5603b4754230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 0x5603b4754230 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f31bc05d250 tx=0x7f31bc015000 comp rx=0 tx=0).stop 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- 172.21.15.52:0/3440288399 shutdown_connections 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b4756e50 0x5603b4777890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b4754770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- 172.21.15.52:0/3440288399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b47244e0 0x5603b4754230 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- 172.21.15.52:0/3440288399 >> 172.21.15.52:0/3440288399 conn(0x5603b4755fa0 msgr2=0x5603b4752b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- 172.21.15.52:0/3440288399 shutdown_connections 2023-09-30T16:50:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- 172.21.15.52:0/3440288399 wait complete. 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- start start 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 Processor -- start 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b477aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47244e0 0x5603b4782c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 0x5603b47831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b451c6c0 con 0x5603b4756e50 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b4720b80 con 0x5603b471dd50 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603b456a070 con 0x5603b47244e0 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31d5297000 10 client.0 _ll_register_callbacks cb 0x7f31c000a420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 0x5603b47831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 0x5603b47831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44888/0 (socket says 172.21.15.52:44888) 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 -- 172.21.15.52:0/2295212500 learned_addr learned my addr 172.21.15.52:0/2295212500 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31caffd640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47244e0 0x5603b4782c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b477aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 -- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47244e0 msgr2=0x5603b4782c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47244e0 0x5603b4782c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 -- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 msgr2=0x5603b477aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b477aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cbfff640 1 -- 172.21.15.52:0/2295212500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603b4530460 con 0x5603b4756e50 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.102+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b477aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31cbfff640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 0x5603b47831a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f31c400d150 tx=0x7f31c401b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fc4389277d04f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 1 -- 172.21.15.52:0/2295212500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c40a7c10 con 0x5603b4756e50 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 1 -- 172.21.15.52:0/2295212500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31c40a7d70 con 0x5603b4756e50 2023-09-30T16:50:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603b45066f0 con 0x5603b4756e50 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 1 -- 172.21.15.52:0/2295212500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31c40ba480 con 0x5603b4756e50 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 10 client.5391 fetch_fsmap learned FSMap version 14 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5603b4267cc0 con 0x5603b4756e50 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 1 -- 172.21.15.52:0/2295212500 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5603b45066f0 con 0x5603b4756e50 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 1 -- 172.21.15.52:0/2295212500 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f31c40af030 con 0x5603b4756e50 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 10 client.5391 fetch_fsmap finished waiting for FSMap version 14 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 10 client.5391 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 20 client.5391 populate_metadata read hostname 'smithi052' 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b47675e0 0x5603b47c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 4 client.5391 mds_command: new command op to 4945 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 --> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5603b45676e0 con 0x5603b47675e0 2023-09-30T16:50:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b47675e0 0x5603b47c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31cb7fe640 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b47675e0 0x5603b47c64b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7587b02a68995a9 server_cookie=edf30a83a6a61ab9 in_seq=0 out_seq=0 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 10 client.5391 ms_handle_connect on v2:172.21.15.186:6836/2755050347 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 1 -- 172.21.15.52:0/2295212500 <== mds.0 v2:172.21.15.186:6836/2755050347 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5603b45676e0 con 0x5603b47675e0 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 10 client.5391 handle_command_reply: tid=0 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 client.5391 shutdown 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 msgr2=0x5603b47831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 0x5603b47831a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f31c400d150 tx=0x7f31c401b940 comp rx=0 tx=0).stop 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 shutdown_connections 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:6836/2755050347,v1:172.21.15.186:6837/2755050347] conn(0x5603b47675e0 0x5603b47c64b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5603b4756e50 0x5603b47831a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5603b47244e0 0x5603b4782c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31aa7fc640 0 client.5391 ms_handle_reset on v2:172.21.15.186:6836/2755050347 2023-09-30T16:50:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 --2- 172.21.15.52:0/2295212500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5603b471dd50 0x5603b477aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 >> 172.21.15.52:0/2295212500 conn(0x5603b4755fa0 msgr2=0x5603b4752b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 shutdown_connections 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 1 -- 172.21.15.52:0/2295212500 wait complete. 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d5297000 20 client.5391 trim_cache size 0 max 16384 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "a2b00988-da85-4e26-9767-73ee6224a074", 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4945, 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-09-30T16:50:21.114 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 5.0286047439999999, 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 14, 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 35, 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 35, 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 13.00643255 2023-09-30T16:50:21.115 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f31b8066190 msgr2=0x7f31b8068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f31b8066190 0x7f31b8068650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0af720 tx=0x7f31c0008040 comp rx=0 tx=0).stop 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 msgr2=0x7f31cc1f64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc1f64f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d830 tx=0x7f31bc00dcf0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 shutdown_connections 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f31b8066190 0x7f31b8068650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31cc142170 0x7f31cc0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31cc141d90 0x7f31cc154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 --2- 172.21.15.52:0/1766224203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31cc0712b0 0x7f31cc1f64f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 >> 172.21.15.52:0/1766224203 conn(0x7f31cc0cbb80 msgr2=0x7f31cc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 shutdown_connections 2023-09-30T16:50:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.106+0000 7f31d2150640 1 -- 172.21.15.52:0/1766224203 wait complete. 2023-09-30T16:50:21.124 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T16:50:21.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.234+0000 7fe0d4194640 1 Processor -- start 2023-09-30T16:50:21.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.234+0000 7fe0d4194640 1 -- start start 2023-09-30T16:50:21.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d4194640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d4194640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc0c9dd0 con 0x7fe0cc159df0 2023-09-30T16:50:21.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d4194640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc15a5b0 con 0x7fe0cc1574c0 2023-09-30T16:50:21.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d4194640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15ae50 con 0x7fe0cc0ca590 2023-09-30T16:50:21.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d172f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe0cc159df0 0x7fe0cc06bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40888/0 (socket says 172.21.15.52:40888) 2023-09-30T16:50:21.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d172f640 1 -- 172.21.15.52:0/2047839219 learned_addr learned my addr 172.21.15.52:0/2047839219 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170524989 0 0) 0x7fe0cc0c9dd0 con 0x7fe0cc159df0 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b8003530 con 0x7fe0cc159df0 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137144973 0 0) 0x7fe0b8003530 con 0x7fe0cc159df0 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 msgr2=0x7fe0cc0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 0x7fe0cc0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 >> v1:172.21.15.186:6789/0 conn(0x7fe0cc1574c0 legacy=0x7fe0cc0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc15a890 con 0x7fe0cc159df0 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fe0bc001680 con 0x7fe0cc159df0 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 >> v1:172.21.15.52:6789/0 conn(0x7fe0cc159df0 legacy=0x7fe0cc06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 0x7fe0b8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b8003fa0 0x7fe0b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0b8004d10 0x7fe0b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15ae50 con 0x7fe0b8004d10 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b800baf0 con 0x7fe0b8003fa0 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b800bcb0 con 0x7fe0cc0ca590 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0b8004d10 0x7fe0b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d172f640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b8003fa0 0x7fe0b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d1f30640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 0x7fe0b8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 -- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 msgr2=0x7fe0b8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc0ca590 0x7fe0b8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 -- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b8003fa0 msgr2=0x7fe0b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:21.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b8003fa0 0x7fe0b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 -- 172.21.15.52:0/2047839219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8003530 con 0x7fe0b8004d10 2023-09-30T16:50:21.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.238+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0b8004d10 0x7fe0b8005190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009ae0 tx=0x7fe0c401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4d0092698ff23d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40a5640 con 0x7fe0b8004d10 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c40a57a0 con 0x7fe0b8004d10 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d0f2e640 1 -- 172.21.15.52:0/2047839219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40a5b50 con 0x7fe0b8004d10 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2047839219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0b8004d10 msgr2=0x7fe0b8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2047839219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0b8004d10 0x7fe0b8005190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009ae0 tx=0x7fe0c401ca50 comp rx=0 tx=0).stop 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 -- 172.21.15.52:0/2047839219 reap_dead start 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2047839219 shutdown_connections 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2047839219 >> 172.21.15.52:0/2047839219 conn(0x7fe0cc06a5f0 msgr2=0x7fe0cc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2047839219 shutdown_connections 2023-09-30T16:50:21.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2047839219 wait complete. 2023-09-30T16:50:21.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 Processor -- start 2023-09-30T16:50:21.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- start start 2023-09-30T16:50:21.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc153fb0 0x7fe0cc1e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0cc154390 0x7fe0cc1e0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 0x7fe0cc1e1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1570d0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc14bf70 con 0x7fe0cc154390 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1e01b0 con 0x7fe0cc153fb0 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 0x7fe0cc1e1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 0x7fe0cc1e1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44908/0 (socket says 172.21.15.52:44908) 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 -- 172.21.15.52:0/2931120983 learned_addr learned my addr 172.21.15.52:0/2931120983 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d1f30640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc153fb0 0x7fe0cc1e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d172f640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0cc154390 0x7fe0cc1e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 -- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc153fb0 msgr2=0x7fe0cc1e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc153fb0 0x7fe0cc1e2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 -- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0cc154390 msgr2=0x7fe0cc1e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0cc154390 0x7fe0cc1e0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 -- 172.21.15.52:0/2931120983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc156b10 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d2731640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 0x7fe0cc1e1000 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40b0040 tx=0x7fe0b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40bb070 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c4004020 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc156df0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40a5640 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.242+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc1e2fe0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.246+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc1dfca0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.246+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe0c40b4040 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.246+0000 7fe0c27fc640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0b0066190 0x7fe0b0068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:21.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.246+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0c411d810 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.246+0000 7fe0d1f30640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0b0066190 0x7fe0b0068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:21.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.246+0000 7fe0d1f30640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0b0066190 0x7fe0b0068650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8005210 tx=0x7fe0c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:21.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.250+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe0cc1dfca0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.434+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0cc1dfca0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0c27fc640 1 -- 172.21.15.52:0/2931120983 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe0cc1dfca0 con 0x7fe0cc1e0b80 2023-09-30T16:50:21.439 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T16:50:21.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0b0066190 msgr2=0x7fe0b0068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0b0066190 0x7fe0b0068650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8005210 tx=0x7fe0c8009040 comp rx=0 tx=0).stop 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 msgr2=0x7fe0cc1e1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 0x7fe0cc1e1000 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40b0040 tx=0x7fe0b8005800 comp rx=0 tx=0).stop 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 shutdown_connections 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe0b0066190 0x7fe0b0068650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0cc1e0b80 0x7fe0cc1e1000 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0cc154390 0x7fe0cc1e0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 --2- 172.21.15.52:0/2931120983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0cc153fb0 0x7fe0cc1e2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 >> 172.21.15.52:0/2931120983 conn(0x7fe0cc06a5f0 msgr2=0x7fe0cc14fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:21.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 shutdown_connections 2023-09-30T16:50:21.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:21.438+0000 7fe0d4194640 1 -- 172.21.15.52:0/2931120983 wait complete. 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T16:50:21.456 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T16:50:21.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.457 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-09-30T16:50:21.462 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2023-09-30T16:50:21.463 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42382sec preferred_lft 42382sec 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 02:42:57:b4:1e:67 brd ff:ff:ff:ff:ff:ff 2023-09-30T16:50:21.464 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.465 INFO:teuthology.orchestra.run.smithi052.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T16:50:21.466 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:21.466 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-30T16:50:21.466 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-09-30T16:50:21.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.466 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T16:50:21.522 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-09-30T16:50:21.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.523 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-09-30T16:50:21.571 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-09-30T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-09-30T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-30T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-09-30T16:50:21.572 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T16:50:21.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.572 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-09-30T16:50:21.573 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-09-30T16:50:21.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-30T16:50:21.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-30T16:50:21.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-30T16:50:21.573 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-09-30T16:50:21.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.649 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-09-30T16:50:21.695 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T16:50:21.695 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T16:50:21.695 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T16:50:21.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-09-30T16:50:21.751 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T16:50:21.751 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:50:21.751 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:21.799 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T16:50:21.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T16:50:21.799 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:21.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:50:21.905 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:50:21.953 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:50:21.953 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:50:21.953 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:50:21.953 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:50:21.954 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:50:21.955 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:21.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:21.957 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:50:22.003 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T16:50:22.003 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T16:50:22.048 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:50:22.062 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:50:22.111 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:50:22.111 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:50:22.111 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:50:22.112 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:50:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:22.114 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:22.115 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:22.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:22.116 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:50:22.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2023-09-30T16:50:22.126+0000 7f5261905580 -1 init, newargv = 0x560174afaab0 newargc=15 2023-09-30T16:50:22.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[47157]: starting ceph client 2023-09-30T16:50:22.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[47157]: starting fuse 2023-09-30T16:50:23.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2023-09-30T16:50:23.252 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T16:50:23.304 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2023-09-30T16:50:23.304 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2023-09-30T16:50:23.304 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2023-09-30T16:50:23.305 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2023-09-30T16:50:23.306 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T16:50:23.307 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:23.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:23.308 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2023-09-30T16:50:23.355 INFO:teuthology.orchestra.run.smithi052.stdout:45 2023-09-30T16:50:23.355 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> import re 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> import os 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:50:23.356 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> return f 2023-09-30T16:50:23.357 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T16:50:23.358 DEBUG:teuthology.orchestra.run.smithi052:> 2023-09-30T16:50:23.358 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2023-09-30T16:50:23.358 DEBUG:teuthology.orchestra.run.smithi052:> ' 2023-09-30T16:50:23.486 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.47157.asok 2023-09-30T16:50:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T16:50:23.498 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47157.asok 2023-09-30T16:50:23.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:23.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47157.asok status 2023-09-30T16:50:23.660 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "47157", 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2023-09-30T16:50:23.661 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 5406, 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 5406 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2192695578 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:23.662 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2192695578 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.5406 192.168.0.1:0/2192695578", 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/2192695578", 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 14, 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 35, 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2023-09-30T16:50:23.663 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2023-09-30T16:50:23.664 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-09-30T16:50:23.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:23.674 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2023-09-30T16:50:23.674 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:23.681 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2023-09-30T16:50:23.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:23.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:23.681 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T16:50:23.736 DEBUG:teuthology.orchestra.run.smithi052:> mktemp -d --suffix=xfstests-dev 2023-09-30T16:50:23.783 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.qvcny3LNTMxfstests-dev 2023-09-30T16:50:23.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:23.783 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.qvcny3LNTMxfstests-dev) 2023-09-30T16:50:23.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:23.843 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.qvcny3LNTMxfstests-dev) 2023-09-30T16:50:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:Cloning into '/tmp/tmp.qvcny3LNTMxfstests-dev'... 2023-09-30T16:50:24.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:24.780 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-09-30T16:50:24.841 DEBUG:teuthology.orchestra.run.smithi052:> mktemp -d --suffix=test 2023-09-30T16:50:24.886 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.NXbAzGS4G1test 2023-09-30T16:50:24.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:50:24.887 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-09-30T16:50:24.942 DEBUG:teuthology.orchestra.run.smithi052:> mktemp -d --suffix=scratch 2023-09-30T16:50:24.987 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.00ndkjFPiWscratch 2023-09-30T16:50:24.987 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-09-30T16:50:24.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-09-30T16:50:25.098 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2023-09-30T16:50:25.292 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2023-09-30T16:50:25.293 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2023-09-30T16:50:25.461 INFO:teuthology.orchestra.run.smithi052.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:gcc set to manually installed. 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:make is already the newest version (4.3-4.1build1). 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:make set to manually installed. 2023-09-30T16:50:25.462 INFO:teuthology.orchestra.run.smithi052.stdout:quota is already the newest version (4.06-1build2). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:dbench is already the newest version (4.0-2build1). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:python2 is already the newest version (2.7.18-3). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:python2 set to manually installed. 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T16:50:25.463 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-09-30T16:50:25.464 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-09-30T16:50:25.464 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-09-30T16:50:25.464 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T16:50:25.464 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2023-09-30T16:50:25.464 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemblk1 2023-09-30T16:50:25.465 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2023-09-30T16:50:25.465 INFO:teuthology.orchestra.run.smithi052.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc 2023-09-30T16:50:25.494 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2023-09-30T16:50:25.495 INFO:teuthology.orchestra.run.smithi052.stdout: fio libgdbm-dev libpmemblk1 sqlite3 2023-09-30T16:50:25.496 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2023-09-30T16:50:25.497 INFO:teuthology.orchestra.run.smithi052.stdout: gawk 2023-09-30T16:50:25.677 INFO:teuthology.orchestra.run.smithi052.stdout:1 upgraded, 4 newly installed, 0 to remove and 251 not upgraded. 2023-09-30T16:50:25.677 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 5,445 kB of archives. 2023-09-30T16:50:25.677 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 9,949 kB of additional disk space will be used. 2023-09-30T16:50:25.677 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-09-30T16:50:26.201 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-09-30T16:50:26.209 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-09-30T16:50:26.500 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-09-30T16:50:26.503 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-09-30T16:50:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:debconf: unable to initialize frontend: Dialog 2023-09-30T16:50:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-09-30T16:50:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:debconf: falling back to frontend: Readline 2023-09-30T16:50:26.846 INFO:teuthology.orchestra.run.smithi052.stderr:debconf: unable to initialize frontend: Readline 2023-09-30T16:50:26.846 INFO:teuthology.orchestra.run.smithi052.stderr:debconf: (This frontend requires a controlling tty.) 2023-09-30T16:50:26.846 INFO:teuthology.orchestra.run.smithi052.stderr:debconf: falling back to frontend: Teletype 2023-09-30T16:50:26.850 INFO:teuthology.orchestra.run.smithi052.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-09-30T16:50:26.885 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 5,445 kB in 1s (5,354 kB/s) 2023-09-30T16:50:27.169 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175729 files and directories currently installed.) 2023-09-30T16:50:27.175 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-09-30T16:50:27.310 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-09-30T16:50:27.855 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-09-30T16:50:27.884 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-09-30T16:50:27.963 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-09-30T16:50:28.300 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package fio. 2023-09-30T16:50:28.329 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-09-30T16:50:28.358 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking fio (3.28-1) ... 2023-09-30T16:50:28.830 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-09-30T16:50:28.858 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libgdbm-dev_1.23-1_amd64.deb ... 2023-09-30T16:50:28.896 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-09-30T16:50:29.233 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package sqlite3. 2023-09-30T16:50:29.250 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-09-30T16:50:29.291 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-09-30T16:50:29.585 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-09-30T16:50:29.939 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-09-30T16:50:30.065 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-09-30T16:50:30.191 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-09-30T16:50:30.292 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up fio (3.28-1) ... 2023-09-30T16:50:31.005 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-30T16:50:31.365 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-30T16:50:32.599 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-30T16:50:33.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo useradd -m fsgqa 2023-09-30T16:50:33.131 INFO:teuthology.orchestra.run.smithi052.stderr:useradd: user 'fsgqa' already exists 2023-09-30T16:50:33.132 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-30T16:50:33.132 DEBUG:teuthology.orchestra.run.smithi052:> sudo groupadd fsgqa 2023-09-30T16:50:33.183 INFO:teuthology.orchestra.run.smithi052.stderr:groupadd: group 'fsgqa' already exists 2023-09-30T16:50:33.183 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-30T16:50:33.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo useradd fsgqa2 2023-09-30T16:50:33.543 DEBUG:teuthology.orchestra.run.smithi052:> sudo useradd 123456-fsgqa 2023-09-30T16:50:33.922 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-09-30T16:50:34.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4cb5b640 1 Processor -- start 2023-09-30T16:50:34.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4cb5b640 1 -- start start 2023-09-30T16:50:34.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4cb5b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 0x7f6d480b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4cb5b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480b7330 con 0x7f6d4815ce10 2023-09-30T16:50:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4cb5b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480b7570 con 0x7f6d480cdf80 2023-09-30T16:50:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4cb5b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b7850 con 0x7f6d480d1fb0 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4659c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6d4815ce10 0x7f6d480cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60206/0 (socket says 172.21.15.52:60206) 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4659c640 1 -- 172.21.15.52:0/1669971496 learned_addr learned my addr 172.21.15.52:0/1669971496 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d45d9b640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 0x7f6d480b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204803012 0 0) 0x7f6d38001120 con 0x7f6d4815ce10 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d30003530 con 0x7f6d4815ce10 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1752534739 0 0) 0x7f6d30003530 con 0x7f6d4815ce10 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 msgr2=0x7f6d480b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 0x7f6d480b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 >> v1:172.21.15.186:6789/0 conn(0x7f6d480cdf80 legacy=0x7f6d480b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480b7b30 con 0x7f6d4815ce10 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f6d38001810 con 0x7f6d4815ce10 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 >> v1:172.21.15.52:6789/0 conn(0x7f6d4815ce10 legacy=0x7f6d480cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 0x7f6d30003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d30003ff0 0x7f6d300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d30004d10 0x7f6d30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b7850 con 0x7f6d30004d10 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3000bbd0 con 0x7f6d30003ff0 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3000bd90 con 0x7f6d480d1fb0 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d30004d10 0x7f6d30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d4659c640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 0x7f6d30003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d45d9b640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d30003ff0 0x7f6d300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d46d9d640 1 -- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 msgr2=0x7f6d30003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480d1fb0 0x7f6d30003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d46d9d640 1 -- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d30003ff0 msgr2=0x7f6d300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T16:50:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d30003ff0 0x7f6d300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.057+0000 7f6d46d9d640 1 -- 172.21.15.52:0/1669971496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d30003530 con 0x7f6d30004d10 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d30004d10 0x7f6d30005190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001e70 tx=0x7f6d4001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad29e7b07fe3180 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40003b80 con 0x7f6d30004d10 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40003ce0 con 0x7f6d30004d10 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4559a640 1 -- 172.21.15.52:0/1669971496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400052c0 con 0x7f6d30004d10 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/1669971496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d30004d10 msgr2=0x7f6d30005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/1669971496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d30004d10 0x7f6d30005190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001e70 tx=0x7f6d4001c760 comp rx=0 tx=0).stop 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d46d9d640 1 -- 172.21.15.52:0/1669971496 reap_dead start 2023-09-30T16:50:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/1669971496 shutdown_connections 2023-09-30T16:50:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/1669971496 >> 172.21.15.52:0/1669971496 conn(0x7f6d48071930 msgr2=0x7f6d48071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/1669971496 shutdown_connections 2023-09-30T16:50:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/1669971496 wait complete. 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 Processor -- start 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.061+0000 7f6d4cb5b640 1 -- start start 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d48140600 0x7f6d4815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4813ec80 0x7f6d4815f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 0x7f6d48140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815d860 con 0x7f6d481409e0 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48159d10 con 0x7f6d48140600 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815a5b0 con 0x7f6d4813ec80 2023-09-30T16:50:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 0x7f6d48140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 0x7f6d48140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39320/0 (socket says 172.21.15.52:39320) 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 -- 172.21.15.52:0/3678912503 learned_addr learned my addr 172.21.15.52:0/3678912503 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d45d9b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4813ec80 0x7f6d4815f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4659c640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d48140600 0x7f6d4815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 -- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4813ec80 msgr2=0x7f6d4815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4813ec80 0x7f6d4815f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 -- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d48140600 msgr2=0x7f6d4815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d48140600 0x7f6d4815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 -- 172.21.15.52:0/3678912503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4815ff00 con 0x7f6d481409e0 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d46d9d640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 0x7f6d48140e60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6d4001ccd0 tx=0x7f6d30005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40006d60 con 0x7f6d481409e0 2023-09-30T16:50:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40007dc0 con 0x7f6d481409e0 2023-09-30T16:50:34.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40007230 con 0x7f6d481409e0 2023-09-30T16:50:34.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d48159f60 con 0x7f6d481409e0 2023-09-30T16:50:34.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4815fb60 con 0x7f6d481409e0 2023-09-30T16:50:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d480740a0 con 0x7f6d481409e0 2023-09-30T16:50:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f6d40007390 con 0x7f6d481409e0 2023-09-30T16:50:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d36ffd640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6d28066190 0x7f6d28068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d4011cb40 con 0x7f6d481409e0 2023-09-30T16:50:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.065+0000 7f6d4659c640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6d28066190 0x7f6d28068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.069+0000 7f6d4659c640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6d28066190 0x7f6d28068650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d380012c0 tx=0x7f6d38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.069+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f6d400ea1f0 con 0x7f6d481409e0 2023-09-30T16:50:34.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.281+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6d480b4300 con 0x7f6d481409e0 2023-09-30T16:50:34.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d36ffd640 1 -- 172.21.15.52:0/3678912503 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f6d400b7090 con 0x7f6d481409e0 2023-09-30T16:50:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:50:34.287 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","modified":"2023-09-30T16:48:19.330750Z","created":"2023-09-30T16:48:19.330750Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3301","nonce":0},{"type":"v1","addr":"172.21.15.186:6790","nonce":0}]},"addr":"172.21.15.186:6790/0","public_addr":"172.21.15.186:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-09-30T16:50:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6d28066190 msgr2=0x7f6d28068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6d28066190 0x7f6d28068650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d380012c0 tx=0x7f6d38009040 comp rx=0 tx=0).stop 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 msgr2=0x7f6d48140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 0x7f6d48140e60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6d4001ccd0 tx=0x7f6d30005800 comp rx=0 tx=0).stop 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 shutdown_connections 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f6d28066190 0x7f6d28068650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d481409e0 0x7f6d48140e60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4813ec80 0x7f6d4815f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 --2- 172.21.15.52:0/3678912503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d48140600 0x7f6d4815d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 >> 172.21.15.52:0/3678912503 conn(0x7f6d48071930 msgr2=0x7f6d480b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 shutdown_connections 2023-09-30T16:50:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.285+0000 7f6d4cb5b640 1 -- 172.21.15.52:0/3678912503 wait complete. 2023-09-30T16:50:34.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-09-30T16:50:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6ca6b640 1 Processor -- start 2023-09-30T16:50:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6ca6b640 1 -- start start 2023-09-30T16:50:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6ca6b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe680c19f0 0x7efe680ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6ca6b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680cc160 con 0x7efe680b07b0 2023-09-30T16:50:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6ca6b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680cc720 con 0x7efe68164cd0 2023-09-30T16:50:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6ca6b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe68165720 con 0x7efe680c19f0 2023-09-30T16:50:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe680c19f0 0x7efe680ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe6659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe680c19f0 0x7efe680ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39328/0 (socket says 172.21.15.52:39328) 2023-09-30T16:50:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6659c640 1 -- 172.21.15.52:0/3577941838 learned_addr learned my addr 172.21.15.52:0/3577941838 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.429+0000 7efe66d9d640 1 --1- 172.21.15.52:0/3577941838 >> v1:172.21.15.52:6789/0 conn(0x7efe680b07b0 0x7efe680c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60210/0 (socket says 172.21.15.52:60210) 2023-09-30T16:50:34.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6659c640 1 -- 172.21.15.52:0/3577941838 >> v1:172.21.15.186:6789/0 conn(0x7efe68164cd0 legacy=0x7efe680b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6659c640 1 -- 172.21.15.52:0/3577941838 >> v1:172.21.15.52:6789/0 conn(0x7efe680b07b0 legacy=0x7efe680c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6659c640 1 -- 172.21.15.52:0/3577941838 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68165a00 con 0x7efe680c19f0 2023-09-30T16:50:34.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6559a640 1 -- 172.21.15.52:0/3577941838 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617699609 0 0) 0x7efe680cc160 con 0x7efe680b07b0 2023-09-30T16:50:34.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6659c640 1 --2- 172.21.15.52:0/3577941838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680ccbb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe5801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c06a712a18494e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:34.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6559a640 1 -- 172.21.15.52:0/3577941838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580ab600 con 0x7efe680c19f0 2023-09-30T16:50:34.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6559a640 1 -- 172.21.15.52:0/3577941838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580a7050 con 0x7efe680c19f0 2023-09-30T16:50:34.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6559a640 1 -- 172.21.15.52:0/3577941838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580ab980 con 0x7efe680c19f0 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 -- 172.21.15.52:0/3577941838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 msgr2=0x7efe680ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/3577941838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680ccbb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe5801c4b0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 -- 172.21.15.52:0/3577941838 shutdown_connections 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/3577941838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680ccbb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 -- 172.21.15.52:0/3577941838 >> 172.21.15.52:0/3577941838 conn(0x7efe6806a5c0 msgr2=0x7efe680ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 -- 172.21.15.52:0/3577941838 shutdown_connections 2023-09-30T16:50:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.433+0000 7efe6ca6b640 1 -- 172.21.15.52:0/3577941838 wait complete. 2023-09-30T16:50:34.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 Processor -- start 2023-09-30T16:50:34.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- start start 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe680b07b0 0x7efe6815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe68164cd0 0x7efe68161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6815dc20 con 0x7efe680c19f0 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680c4490 con 0x7efe680b07b0 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680c4730 con 0x7efe68164cd0 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39332/0 (socket says 172.21.15.52:39332) 2023-09-30T16:50:34.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 -- 172.21.15.52:0/589823769 learned_addr learned my addr 172.21.15.52:0/589823769 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6659c640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe680b07b0 0x7efe6815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe66d9d640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe68164cd0 0x7efe68161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 -- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe68164cd0 msgr2=0x7efe68161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe68164cd0 0x7efe68161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 -- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe680b07b0 msgr2=0x7efe6815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe680b07b0 0x7efe6815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 -- 172.21.15.52:0/589823769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580094d0 con 0x7efe680c19f0 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6659c640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe680b07b0 0x7efe6815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe65d9b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680c3f50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c3c0 tx=0x7efe5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:34.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0052d0 con 0x7efe680c19f0 2023-09-30T16:50:34.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c005430 con 0x7efe680c19f0 2023-09-30T16:50:34.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe680c4a10 con 0x7efe680c19f0 2023-09-30T16:50:34.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c003840 con 0x7efe680c19f0 2023-09-30T16:50:34.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe68161f70 con 0x7efe680c19f0 2023-09-30T16:50:34.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.437+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6815e0b0 con 0x7efe680c19f0 2023-09-30T16:50:34.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.441+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7efe5c0039a0 con 0x7efe680c19f0 2023-09-30T16:50:34.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.441+0000 7efe56ffd640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efe48066160 0x7efe48068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T16:50:34.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.441+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe5c082f30 con 0x7efe680c19f0 2023-09-30T16:50:34.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.441+0000 7efe6659c640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efe48066160 0x7efe48068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T16:50:34.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.441+0000 7efe6659c640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efe48066160 0x7efe48068620 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe580ad000 tx=0x7efe580a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T16:50:34.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.445+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7efe6815e0b0 con 0x7efe680c19f0 2023-09-30T16:50:34.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7efe6815e0b0 con 0x7efe680c19f0 2023-09-30T16:50:34.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe56ffd640 1 -- 172.21.15.52:0/589823769 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7efe6815e0b0 con 0x7efe680c19f0 2023-09-30T16:50:34.659 INFO:teuthology.orchestra.run.smithi052.stdout:[client.admin] 2023-09-30T16:50:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBTURhlaOAwIRAAZ6oGuyw+IHMDUngsifd1Bg== 2023-09-30T16:50:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow *" 2023-09-30T16:50:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: caps mgr = "allow *" 2023-09-30T16:50:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow *" 2023-09-30T16:50:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow *" 2023-09-30T16:50:34.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efe48066160 msgr2=0x7efe48068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efe48066160 0x7efe48068620 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe580ad000 tx=0x7efe580a6000 comp rx=0 tx=0).stop 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 msgr2=0x7efe680c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680c3f50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00c3c0 tx=0x7efe5c00c880 comp rx=0 tx=0).stop 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 shutdown_connections 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efe48066160 0x7efe48068620 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe68164cd0 0x7efe68161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe680c19f0 0x7efe680c3f50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 --2- 172.21.15.52:0/589823769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe680b07b0 0x7efe6815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 >> 172.21.15.52:0/589823769 conn(0x7efe6806a5c0 msgr2=0x7efe6815c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 shutdown_connections 2023-09-30T16:50:34.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-09-30T16:50:34.657+0000 7efe6ca6b640 1 -- 172.21.15.52:0/589823769 wait complete. 2023-09-30T16:50:34.679 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2023-09-30T16:50:34.684 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.Wjny9xoMqW 2023-09-30T16:50:34.684 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:50:34.684 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/tmp/tmp.Wjny9xoMqW 2023-09-30T16:50:34.731 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:50:34.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/tmp/tmp.qvcny3LNTMxfstests-dev/local.config 2023-09-30T16:50:34.787 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.NXbAzGS4G1test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.00ndkjFPiWscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.52:6789 -k /tmp/tmp.Wjny9xoMqW --client_mountpoint /test" 2023-09-30T16:50:34.787 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-09-30T16:50:34.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/tmp/tmp.qvcny3LNTMxfstests-dev/ceph.exclude 2023-09-30T16:50:34.843 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo make) 2023-09-30T16:50:34.903 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize -cfi 2023-09-30T16:50:35.233 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: putting auxiliary files in '.'. 2023-09-30T16:50:35.233 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file './config.guess' 2023-09-30T16:50:35.238 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file './config.sub' 2023-09-30T16:50:35.261 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file './install-sh' 2023-09-30T16:50:35.268 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file './ltmain.sh' 2023-09-30T16:50:35.293 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-09-30T16:50:35.293 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-09-30T16:50:35.319 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-09-30T16:50:35.325 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-09-30T16:50:35.332 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-09-30T16:50:35.338 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-09-30T16:50:35.343 INFO:teuthology.orchestra.run.smithi052.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-09-30T16:50:35.345 INFO:teuthology.orchestra.run.smithi052.stdout:cp include/install-sh . 2023-09-30T16:50:35.346 INFO:teuthology.orchestra.run.smithi052.stdout:aclocal -I m4 2023-09-30T16:50:36.599 INFO:teuthology.orchestra.run.smithi052.stdout:autoheader 2023-09-30T16:50:36.961 INFO:teuthology.orchestra.run.smithi052.stdout:autoconf 2023-09-30T16:50:37.374 INFO:teuthology.orchestra.run.smithi052.stdout:./configure \ 2023-09-30T16:50:37.374 INFO:teuthology.orchestra.run.smithi052.stdout: --libexecdir=/usr/lib \ 2023-09-30T16:50:37.374 INFO:teuthology.orchestra.run.smithi052.stdout: --exec_prefix=/var/lib 2023-09-30T16:50:37.803 INFO:teuthology.orchestra.run.smithi052.stdout:checking build system type... x86_64-pc-linux-gnu 2023-09-30T16:50:37.804 INFO:teuthology.orchestra.run.smithi052.stdout:checking host system type... x86_64-pc-linux-gnu 2023-09-30T16:50:37.845 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to print strings... printf 2023-09-30T16:50:37.845 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gcc... gcc 2023-09-30T16:50:38.066 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether the C compiler works... yes 2023-09-30T16:50:38.066 INFO:teuthology.orchestra.run.smithi052.stdout:checking for C compiler default output file name... a.out 2023-09-30T16:50:38.104 INFO:teuthology.orchestra.run.smithi052.stdout:checking for suffix of executables... 2023-09-30T16:50:38.181 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether we are cross compiling... no 2023-09-30T16:50:38.203 INFO:teuthology.orchestra.run.smithi052.stdout:checking for suffix of object files... o 2023-09-30T16:50:38.221 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether the compiler supports GNU C... yes 2023-09-30T16:50:38.240 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether gcc accepts -g... yes 2023-09-30T16:50:38.370 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gcc option to enable C11 features... none needed 2023-09-30T16:50:38.376 INFO:teuthology.orchestra.run.smithi052.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-09-30T16:50:38.379 INFO:teuthology.orchestra.run.smithi052.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-09-30T16:50:38.381 INFO:teuthology.orchestra.run.smithi052.stdout:checking for egrep... /usr/bin/grep -E 2023-09-30T16:50:38.383 INFO:teuthology.orchestra.run.smithi052.stdout:checking for fgrep... /usr/bin/grep -F 2023-09-30T16:50:38.388 INFO:teuthology.orchestra.run.smithi052.stdout:checking for ld used by gcc... /usr/bin/ld 2023-09-30T16:50:38.391 INFO:teuthology.orchestra.run.smithi052.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-09-30T16:50:38.402 INFO:teuthology.orchestra.run.smithi052.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-09-30T16:50:38.426 INFO:teuthology.orchestra.run.smithi052.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-09-30T16:50:38.426 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether ln -s works... yes 2023-09-30T16:50:38.435 INFO:teuthology.orchestra.run.smithi052.stdout:checking the maximum length of command line arguments... 1572864 2023-09-30T16:50:38.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-09-30T16:50:38.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-09-30T16:50:38.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-09-30T16:50:38.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking for objdump... objdump 2023-09-30T16:50:38.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to recognize dependent libraries... pass_all 2023-09-30T16:50:38.440 INFO:teuthology.orchestra.run.smithi052.stdout:checking for dlltool... no 2023-09-30T16:50:38.440 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-09-30T16:50:38.441 INFO:teuthology.orchestra.run.smithi052.stdout:checking for ar... ar 2023-09-30T16:50:38.473 INFO:teuthology.orchestra.run.smithi052.stdout:checking for archiver @FILE support... @ 2023-09-30T16:50:38.474 INFO:teuthology.orchestra.run.smithi052.stdout:checking for strip... strip 2023-09-30T16:50:38.474 INFO:teuthology.orchestra.run.smithi052.stdout:checking for ranlib... ranlib 2023-09-30T16:50:38.475 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gawk... gawk 2023-09-30T16:50:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-09-30T16:50:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sysroot... no 2023-09-30T16:50:38.549 INFO:teuthology.orchestra.run.smithi052.stdout:checking for a working dd... /usr/bin/dd 2023-09-30T16:50:38.553 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-09-30T16:50:38.568 INFO:teuthology.orchestra.run.smithi052.stdout:checking for mt... mt 2023-09-30T16:50:38.576 INFO:teuthology.orchestra.run.smithi052.stdout:checking if mt is a manifest tool... no 2023-09-30T16:50:38.607 INFO:teuthology.orchestra.run.smithi052.stdout:checking for stdio.h... yes 2023-09-30T16:50:38.646 INFO:teuthology.orchestra.run.smithi052.stdout:checking for stdlib.h... yes 2023-09-30T16:50:38.674 INFO:teuthology.orchestra.run.smithi052.stdout:checking for string.h... yes 2023-09-30T16:50:38.723 INFO:teuthology.orchestra.run.smithi052.stdout:checking for inttypes.h... yes 2023-09-30T16:50:38.757 INFO:teuthology.orchestra.run.smithi052.stdout:checking for stdint.h... yes 2023-09-30T16:50:38.786 INFO:teuthology.orchestra.run.smithi052.stdout:checking for strings.h... yes 2023-09-30T16:50:38.814 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/stat.h... yes 2023-09-30T16:50:38.840 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/types.h... yes 2023-09-30T16:50:38.893 INFO:teuthology.orchestra.run.smithi052.stdout:checking for unistd.h... yes 2023-09-30T16:50:38.949 INFO:teuthology.orchestra.run.smithi052.stdout:checking for dlfcn.h... yes 2023-09-30T16:50:38.952 INFO:teuthology.orchestra.run.smithi052.stdout:checking for objdir... .libs 2023-09-30T16:50:39.035 INFO:teuthology.orchestra.run.smithi052.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-09-30T16:50:39.035 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-09-30T16:50:39.051 INFO:teuthology.orchestra.run.smithi052.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-09-30T16:50:39.247 INFO:teuthology.orchestra.run.smithi052.stdout:checking if gcc static flag -static works... yes 2023-09-30T16:50:39.277 INFO:teuthology.orchestra.run.smithi052.stdout:checking if gcc supports -c -o file.o... yes 2023-09-30T16:50:39.277 INFO:teuthology.orchestra.run.smithi052.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-09-30T16:50:39.287 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-09-30T16:50:39.314 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether -lc should be explicitly linked in... no 2023-09-30T16:50:39.403 INFO:teuthology.orchestra.run.smithi052.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-09-30T16:50:39.403 INFO:teuthology.orchestra.run.smithi052.stdout:checking how to hardcode library paths into programs... immediate 2023-09-30T16:50:39.414 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether stripping libraries is possible... yes 2023-09-30T16:50:39.414 INFO:teuthology.orchestra.run.smithi052.stdout:checking if libtool supports shared libraries... yes 2023-09-30T16:50:39.415 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether to build shared libraries... yes 2023-09-30T16:50:39.415 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether to build static libraries... yes 2023-09-30T16:50:39.423 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gcc... (cached) gcc 2023-09-30T16:50:39.448 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-09-30T16:50:39.448 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether gcc accepts -g... (cached) yes 2023-09-30T16:50:39.448 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-09-30T16:50:39.448 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gmake... /usr/bin/gmake 2023-09-30T16:50:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-09-30T16:50:39.449 INFO:teuthology.orchestra.run.smithi052.stdout:checking for tar... /bin/tar 2023-09-30T16:50:39.449 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gzip... /bin/gzip 2023-09-30T16:50:39.459 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether gcc -MM is supported... yes 2023-09-30T16:50:39.460 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sort... /bin/sort 2023-09-30T16:50:39.460 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether ln -s works... yes 2023-09-30T16:50:39.460 INFO:teuthology.orchestra.run.smithi052.stdout:checking for rpm... no 2023-09-30T16:50:39.492 INFO:teuthology.orchestra.run.smithi052.stdout:checking for assert.h... yes 2023-09-30T16:50:39.528 INFO:teuthology.orchestra.run.smithi052.stdout:checking for bstring.h... no 2023-09-30T16:50:39.561 INFO:teuthology.orchestra.run.smithi052.stdout:checking for libgen.h... yes 2023-09-30T16:50:39.634 INFO:teuthology.orchestra.run.smithi052.stdout:checking for dirent.h... yes 2023-09-30T16:50:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:checking for errno.h... yes 2023-09-30T16:50:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:checking for malloc.h... yes 2023-09-30T16:50:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:checking for uuid.h... no 2023-09-30T16:50:39.830 INFO:teuthology.orchestra.run.smithi052.stdout:checking for uuid/uuid.h... yes 2023-09-30T16:50:39.872 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/uuid.h... no 2023-09-30T16:50:39.911 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/file.h... yes 2023-09-30T16:50:39.950 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/fcntl.h... yes 2023-09-30T16:50:39.985 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/syssgi.h... no 2023-09-30T16:50:40.050 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/param.h... yes 2023-09-30T16:50:40.051 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/stat.h... (cached) yes 2023-09-30T16:50:40.087 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/statvfs.h... yes 2023-09-30T16:50:40.121 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/time.h... yes 2023-09-30T16:50:40.165 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/ioctl.h... yes 2023-09-30T16:50:40.198 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/wait.h... yes 2023-09-30T16:50:40.198 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/types.h... (cached) yes 2023-09-30T16:50:40.198 INFO:teuthology.orchestra.run.smithi052.stdout:checking for strings.h... (cached) yes 2023-09-30T16:50:40.231 INFO:teuthology.orchestra.run.smithi052.stdout:checking for err.h... yes 2023-09-30T16:50:40.268 INFO:teuthology.orchestra.run.smithi052.stdout:checking for linux/falloc.h... yes 2023-09-30T16:50:40.304 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/fs/xfs_fsops.h... no 2023-09-30T16:50:40.336 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/fs/xfs_itable.h... no 2023-09-30T16:50:40.369 INFO:teuthology.orchestra.run.smithi052.stdout:checking for xfs/platform_defs.h... no 2023-09-30T16:50:40.405 INFO:teuthology.orchestra.run.smithi052.stdout:checking for btrfs/ioctl.h... no 2023-09-30T16:50:40.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking for cifs/ioctl.h... no 2023-09-30T16:50:40.474 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/mman.h... yes 2023-09-30T16:50:40.490 INFO:teuthology.orchestra.run.smithi052.stdout:checking for xfs/xfs_log_format.h... no 2023-09-30T16:50:40.531 INFO:teuthology.orchestra.run.smithi052.stdout:checking for uuid_compare... no 2023-09-30T16:50:40.566 INFO:teuthology.orchestra.run.smithi052.stdout:checking for uuid_compare in -luuid... yes 2023-09-30T16:50:40.689 INFO:teuthology.orchestra.run.smithi052.stdout:checking for xfs/xfs.h... yes 2023-09-30T16:50:40.706 INFO:teuthology.orchestra.run.smithi052.stdout:checking for xfs/libxfs.h... no 2023-09-30T16:50:40.739 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-09-30T16:50:40.759 INFO:teuthology.orchestra.run.smithi052.stdout:checking whether xlog_assign_lsn is declared... no 2023-09-30T16:50:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:checking for xfs/xqm.h... yes 2023-09-30T16:50:40.882 INFO:teuthology.orchestra.run.smithi052.stdout:checking xfsctl from xfs/xfs.h... ok 2023-09-30T16:50:40.918 INFO:teuthology.orchestra.run.smithi052.stdout:checking for xfs/handle.h... yes 2023-09-30T16:50:40.955 INFO:teuthology.orchestra.run.smithi052.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-09-30T16:50:40.997 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/acl.h... yes 2023-09-30T16:50:41.036 INFO:teuthology.orchestra.run.smithi052.stdout:checking for acl/libacl.h... yes 2023-09-30T16:50:41.073 INFO:teuthology.orchestra.run.smithi052.stdout:checking for acl_init in -lacl... yes 2023-09-30T16:50:41.107 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gdbm-ndbm.h... no 2023-09-30T16:50:41.138 INFO:teuthology.orchestra.run.smithi052.stdout:checking for gdbm/ndbm.h... no 2023-09-30T16:50:41.169 INFO:teuthology.orchestra.run.smithi052.stdout:checking for ndbm.h... no 2023-09-30T16:50:41.201 INFO:teuthology.orchestra.run.smithi052.stdout:checking for libaio.h... yes 2023-09-30T16:50:41.233 INFO:teuthology.orchestra.run.smithi052.stdout:checking for liburing.h... no 2023-09-30T16:50:41.263 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/capability.h... no 2023-09-30T16:50:41.293 INFO:teuthology.orchestra.run.smithi052.stdout:checking for linux/fiemap.h... yes 2023-09-30T16:50:41.330 INFO:teuthology.orchestra.run.smithi052.stdout:checking for fallocate... yes 2023-09-30T16:50:41.371 INFO:teuthology.orchestra.run.smithi052.stdout:checking for open_by_handle_at... yes 2023-09-30T16:50:41.406 INFO:teuthology.orchestra.run.smithi052.stdout:checking for sys/prctl.h... yes 2023-09-30T16:50:41.439 INFO:teuthology.orchestra.run.smithi052.stdout:checking for linux/fs.h... yes 2023-09-30T16:50:41.476 INFO:teuthology.orchestra.run.smithi052.stdout:checking for btrfsutil.h... no 2023-09-30T16:50:41.523 INFO:teuthology.orchestra.run.smithi052.stdout:checking for copy_file_range... yes 2023-09-30T16:50:41.570 INFO:teuthology.orchestra.run.smithi052.stdout:checking for SEEK_DATA... yes 2023-09-30T16:50:41.639 INFO:teuthology.orchestra.run.smithi052.stdout:checking for BMV_OF_SHARED... yes 2023-09-30T16:50:41.681 INFO:teuthology.orchestra.run.smithi052.stdout:checking for nftw... yes 2023-09-30T16:50:41.722 INFO:teuthology.orchestra.run.smithi052.stdout:checking for RLIMIT_NOFILE... yes 2023-09-30T16:50:41.747 INFO:teuthology.orchestra.run.smithi052.stdout:checking for FIEXCHANGE_RANGE... no 2023-09-30T16:50:41.786 INFO:teuthology.orchestra.run.smithi052.stdout:checking for renameat2... yes 2023-09-30T16:50:41.821 INFO:teuthology.orchestra.run.smithi052.stdout:checking for reallocarray... yes 2023-09-30T16:50:41.855 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct mount_attr... yes 2023-09-30T16:50:41.891 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_qgroup_limit... yes 2023-09-30T16:50:41.929 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-09-30T16:50:41.966 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-09-30T16:50:42.000 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-09-30T16:50:42.037 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-09-30T16:50:42.074 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-09-30T16:50:42.110 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-09-30T16:50:42.145 INFO:teuthology.orchestra.run.smithi052.stdout:checking for linux/btrfs.h... yes 2023-09-30T16:50:42.178 INFO:teuthology.orchestra.run.smithi052.stdout:checking for linux/btrfs_tree.h... yes 2023-09-30T16:50:42.200 INFO:teuthology.orchestra.run.smithi052.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-09-30T16:50:42.219 INFO:teuthology.orchestra.run.smithi052.stdout:configure: creating ./config.status 2023-09-30T16:50:42.632 INFO:teuthology.orchestra.run.smithi052.stdout:config.status: creating include/builddefs 2023-09-30T16:50:42.648 INFO:teuthology.orchestra.run.smithi052.stdout:config.status: creating include/config.h 2023-09-30T16:50:42.659 INFO:teuthology.orchestra.run.smithi052.stdout:config.status: executing libtool commands 2023-09-30T16:50:42.704 INFO:teuthology.orchestra.run.smithi052.stdout:Building include 2023-09-30T16:50:42.708 INFO:teuthology.orchestra.run.smithi052.stdout:Building lib 2023-09-30T16:50:42.711 INFO:teuthology.orchestra.run.smithi052.stdout: [LTDEP] 2023-09-30T16:50:42.857 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dataascii.lo 2023-09-30T16:50:42.969 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] databin.lo 2023-09-30T16:50:43.146 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] datapid.lo 2023-09-30T16:50:43.262 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] file_lock.lo 2023-09-30T16:50:43.422 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] forker.lo 2023-09-30T16:50:43.561 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] pattern.lo 2023-09-30T16:50:43.672 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] open_flags.lo 2023-09-30T16:50:43.822 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] random_range.lo 2023-09-30T16:50:44.074 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] string_to_tokens.lo 2023-09-30T16:50:44.173 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] str_to_bytes.lo 2023-09-30T16:50:44.309 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] tlibio.lo 2023-09-30T16:50:44.583 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] write_log.lo 2023-09-30T16:50:44.647 INFO:teuthology.orchestra.run.smithi052.stderr:write_log.c: In function 'wlog_record_write': 2023-09-30T16:50:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:44.648 INFO:teuthology.orchestra.run.smithi052.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-09-30T16:50:44.648 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:44.648 INFO:teuthology.orchestra.run.smithi052.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:44.648 INFO:teuthology.orchestra.run.smithi052.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-09-30T16:50:44.648 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:44.853 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] random.lo 2023-09-30T16:50:44.957 INFO:teuthology.orchestra.run.smithi052.stdout: [LD] 2023-09-30T16:50:45.028 INFO:teuthology.orchestra.run.smithi052.stdout:Building ltp 2023-09-30T16:50:45.032 INFO:teuthology.orchestra.run.smithi052.stdout: [DEP] 2023-09-30T16:50:45.175 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] doio 2023-09-30T16:50:45.913 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fsstress 2023-09-30T16:50:47.403 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fsx 2023-09-30T16:50:48.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:50:48.007 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:50:48.199 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] growfiles 2023-09-30T16:50:48.755 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] iogen 2023-09-30T16:50:48.876 INFO:teuthology.orchestra.run.smithi052.stderr:iogen.c: In function 'main': 2023-09-30T16:50:48.876 INFO:teuthology.orchestra.run.smithi052.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:48.876 INFO:teuthology.orchestra.run.smithi052.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-09-30T16:50:48.876 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:48.879 INFO:teuthology.orchestra.run.smithi052.stderr:iogen.c: In function 'parse_cmdline': 2023-09-30T16:50:48.879 INFO:teuthology.orchestra.run.smithi052.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:48.879 INFO:teuthology.orchestra.run.smithi052.stderr: 1535 | getcwd(fptr->f_path, 2023-09-30T16:50:48.879 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:48.879 INFO:teuthology.orchestra.run.smithi052.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-09-30T16:50:48.879 INFO:teuthology.orchestra.run.smithi052.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:49.177 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-stress 2023-09-30T16:50:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-09-30T16:50:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:49.300 INFO:teuthology.orchestra.run.smithi052.stderr: 1013 | ftruncate(fd, total_ram); 2023-09-30T16:50:49.300 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:49.626 INFO:teuthology.orchestra.run.smithi052.stdout:Building src 2023-09-30T16:50:49.634 INFO:teuthology.orchestra.run.smithi052.stdout: [DEP] 2023-09-30T16:50:51.721 INFO:teuthology.orchestra.run.smithi052.stdout: [DEP] 2023-09-30T16:50:51.761 INFO:teuthology.orchestra.run.smithi052.stdout: [DEP] 2023-09-30T16:50:51.770 INFO:teuthology.orchestra.run.smithi052.stdout: [DEP] 2023-09-30T16:50:52.043 INFO:teuthology.orchestra.run.smithi052.stdout: [DEP] 2023-09-30T16:50:52.070 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dirstress 2023-09-30T16:50:52.339 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fill 2023-09-30T16:50:52.482 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fill2 2023-09-30T16:50:52.726 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] getpagesize 2023-09-30T16:50:52.861 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] holes 2023-09-30T16:50:53.061 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] lstat64 2023-09-30T16:50:53.254 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] nametest 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr:nametest.c: In function 'main': 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr: 236 | write(1, "\n", 1); 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr: 238 | write(1, ".", 1); 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:53.390 INFO:teuthology.orchestra.run.smithi052.stderr: 288 | write(1, ".", 1); 2023-09-30T16:50:53.391 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:50:53.518 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] permname 2023-09-30T16:50:53.726 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] randholes 2023-09-30T16:50:54.001 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] runas 2023-09-30T16:50:54.179 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] truncfile 2023-09-30T16:50:54.364 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] usemem 2023-09-30T16:50:54.505 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] mmapcat 2023-09-30T16:50:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:mmapcat.c: In function 'main': 2023-09-30T16:50:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:54.612 INFO:teuthology.orchestra.run.smithi052.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-09-30T16:50:54.612 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:54.645 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] append_reader 2023-09-30T16:50:54.779 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] append_writer 2023-09-30T16:50:54.913 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dirperf 2023-09-30T16:50:55.137 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] metaperf 2023-09-30T16:50:55.249 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c: In function 'crfiles': 2023-09-30T16:50:55.249 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.249 INFO:teuthology.orchestra.run.smithi052.stderr: 166 | write(fd, buf, fsize); 2023-09-30T16:50:55.249 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c: In function 't_linkun': 2023-09-30T16:50:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.250 INFO:teuthology.orchestra.run.smithi052.stderr: 454 | link("a", *fnp); 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~ 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c: In function 't_chown': 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr: 404 | chown(*fnp, 2, -1); 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr: 406 | chown(*fnp, 1, -1); 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c: In function 'i_chown': 2023-09-30T16:50:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.252 INFO:teuthology.orchestra.run.smithi052.stderr: 291 | chown(*fnp, 1, -1); 2023-09-30T16:50:55.252 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c: In function 'main': 2023-09-30T16:50:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.252 INFO:teuthology.orchestra.run.smithi052.stderr: 152 | chdir(".."); 2023-09-30T16:50:55.252 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~ 2023-09-30T16:50:55.428 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] devzero 2023-09-30T16:50:55.602 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] feature 2023-09-30T16:50:55.843 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] alloc 2023-09-30T16:50:55.972 INFO:teuthology.orchestra.run.smithi052.stderr:alloc.c: In function 'main': 2023-09-30T16:50:55.972 INFO:teuthology.orchestra.run.smithi052.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:55.973 INFO:teuthology.orchestra.run.smithi052.stderr: 247 | mkstemp(tmpfile); 2023-09-30T16:50:55.973 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:50:56.072 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fault 2023-09-30T16:50:56.233 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fstest 2023-09-30T16:50:56.479 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_access_root 2023-09-30T16:50:56.594 INFO:teuthology.orchestra.run.smithi052.stderr:t_access_root.c: In function 'main': 2023-09-30T16:50:56.594 INFO:teuthology.orchestra.run.smithi052.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:56.594 INFO:teuthology.orchestra.run.smithi052.stderr: 55 | system(cmd); 2023-09-30T16:50:56.595 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~ 2023-09-30T16:50:56.662 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] godown 2023-09-30T16:50:56.822 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] resvtest 2023-09-30T16:50:57.017 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] writemod 2023-09-30T16:50:57.158 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] writev_on_pagefault 2023-09-30T16:50:57.316 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] makeextents 2023-09-30T16:50:57.500 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] itrash 2023-09-30T16:50:57.672 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] rename 2023-09-30T16:50:57.804 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] multi_open_unlink 2023-09-30T16:50:57.970 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] unwritten_sync 2023-09-30T16:50:58.142 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] genhashnames 2023-09-30T16:50:58.326 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_holes 2023-09-30T16:50:58.478 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_writev 2023-09-30T16:50:58.621 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_truncate_cmtime 2023-09-30T16:50:58.778 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dirhash_collide 2023-09-30T16:50:58.965 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_rename_overwrite 2023-09-30T16:50:59.092 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] holetest 2023-09-30T16:50:59.208 INFO:teuthology.orchestra.run.smithi052.stderr:holetest.c: In function 'pt_write_marker': 2023-09-30T16:50:59.208 INFO:teuthology.orchestra.run.smithi052.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:59.208 INFO:teuthology.orchestra.run.smithi052.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-09-30T16:50:59.208 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:59.328 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_truncate_self 2023-09-30T16:50:59.464 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] af_unix 2023-09-30T16:50:59.632 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_stale_pmd 2023-09-30T16:50:59.754 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-09-30T16:50:59.754 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:59.754 INFO:teuthology.orchestra.run.smithi052.stderr: 42 | ftruncate(fd, 0); 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr: 43 | ftruncate(fd, MiB(4)); 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-09-30T16:50:59.755 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:59.794 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_cow_race 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_cow_race.c: In function 'main': 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr: 61 | ftruncate(fd, 0); 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr: 62 | ftruncate(fd, MiB(2)); 2023-09-30T16:50:59.914 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:50:59.968 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_fallocate 2023-09-30T16:51:00.124 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fsync-err 2023-09-30T16:51:00.310 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_write_ro 2023-09-30T16:51:00.465 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_ext4_dax_journal_corruption 2023-09-30T16:51:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-09-30T16:51:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:00.573 INFO:teuthology.orchestra.run.smithi052.stderr: 61 | ftruncate(fd, 0); 2023-09-30T16:51:00.574 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:51:00.622 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_ext4_dax_inline_corruption 2023-09-30T16:51:00.776 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_ofd_locks 2023-09-30T16:51:00.972 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_collision 2023-09-30T16:51:01.183 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] mmap-write-concurrent 2023-09-30T16:51:01.364 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_get_file_time 2023-09-30T16:51:01.514 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_create_short_dirs 2023-09-30T16:51:01.691 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_create_long_dirs 2023-09-30T16:51:01.859 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_enospc 2023-09-30T16:51:02.096 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_writev_overlap 2023-09-30T16:51:02.273 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] checkpoint_journal 2023-09-30T16:51:02.428 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] mmap-rw-fault 2023-09-30T16:51:02.613 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] allocstale 2023-09-30T16:51:02.797 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_cow_memory_failure 2023-09-30T16:51:02.983 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fake-dump-rootino 2023-09-30T16:51:03.129 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dio-buf-fault 2023-09-30T16:51:03.282 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] xfsctl 2023-09-30T16:51:03.478 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] bstat 2023-09-30T16:51:03.695 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mtab 2023-09-30T16:51:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:t_mtab.c: In function 'update_mtab': 2023-09-30T16:51:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:03.815 INFO:teuthology.orchestra.run.smithi052.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-09-30T16:51:03.815 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:03.895 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] getdevicesize 2023-09-30T16:51:04.039 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] preallo_rw_pattern_reader 2023-09-30T16:51:04.156 INFO:teuthology.orchestra.run.smithi052.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-09-30T16:51:04.156 INFO:teuthology.orchestra.run.smithi052.stderr:iopat.c: In function 'main': 2023-09-30T16:51:04.157 INFO:teuthology.orchestra.run.smithi052.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.157 INFO:teuthology.orchestra.run.smithi052.stderr: 38 | read(fd, &x, 1048576); 2023-09-30T16:51:04.157 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:04.190 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] preallo_rw_pattern_writer 2023-09-30T16:51:04.311 INFO:teuthology.orchestra.run.smithi052.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-09-30T16:51:04.311 INFO:teuthology.orchestra.run.smithi052.stderr:iopat.c: In function 'main': 2023-09-30T16:51:04.311 INFO:teuthology.orchestra.run.smithi052.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.311 INFO:teuthology.orchestra.run.smithi052.stderr: 34 | write(fd, &x, 1048576); 2023-09-30T16:51:04.311 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:04.343 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] ftrunc 2023-09-30T16:51:04.474 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] trunc 2023-09-30T16:51:04.634 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fs_perms 2023-09-30T16:51:04.757 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c: In function 'main': 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr: 54 | system("rm -f test.file"); 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c: In function 'testsetup': 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr: 67 | system("cp testx.file test.file"); 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.758 INFO:teuthology.orchestra.run.smithi052.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c: In function 'testfperm': 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr: 123 | seteuid(0); 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~ 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr: 124 | setegid(0); 2023-09-30T16:51:04.759 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~ 2023-09-30T16:51:04.807 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] testx 2023-09-30T16:51:04.940 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] looptest 2023-09-30T16:51:05.143 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] locktest 2023-09-30T16:51:05.483 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] unwritten_mmap 2023-09-30T16:51:05.646 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] bulkstat_unlink_test 2023-09-30T16:51:05.774 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test.c: In function 'main': 2023-09-30T16:51:05.774 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:05.774 INFO:teuthology.orchestra.run.smithi052.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-09-30T16:51:05.775 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:05.775 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:05.775 INFO:teuthology.orchestra.run.smithi052.stderr: 178 | system(fname); 2023-09-30T16:51:05.775 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~ 2023-09-30T16:51:05.862 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] deduperace 2023-09-30T16:51:06.076 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] bulkstat_unlink_test_modified 2023-09-30T16:51:06.192 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.193 INFO:teuthology.orchestra.run.smithi052.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.194 INFO:teuthology.orchestra.run.smithi052.stderr: 185 | system(fname); 2023-09-30T16:51:06.194 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~ 2023-09-30T16:51:06.275 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_dir_offset 2023-09-30T16:51:06.422 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_futimens 2023-09-30T16:51:06.552 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_immutable 2023-09-30T16:51:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c: In function 'create_test_area': 2023-09-30T16:51:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.680 INFO:teuthology.orchestra.run.smithi052.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-09-30T16:51:06.680 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.681 INFO:teuthology.orchestra.run.smithi052.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-09-30T16:51:06.681 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c: In function 'remove_test_area': 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.682 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-09-30T16:51:06.683 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c: In function 'check_test_area': 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.685 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-09-30T16:51:06.686 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.687 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.687 INFO:teuthology.orchestra.run.smithi052.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-09-30T16:51:06.687 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.687 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.687 INFO:teuthology.orchestra.run.smithi052.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-09-30T16:51:06.687 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c: In function 'test_immutable': 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.689 INFO:teuthology.orchestra.run.smithi052.stderr: 408 | chown(path, 0, 0); 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: 553 | chown(path, 0, 0); 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.690 INFO:teuthology.orchestra.run.smithi052.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.691 INFO:teuthology.orchestra.run.smithi052.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: 653 | chown(path, 0, 0); 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.692 INFO:teuthology.orchestra.run.smithi052.stderr: 705 | chown(path, 0, 0); 2023-09-30T16:51:06.693 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.693 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.693 INFO:teuthology.orchestra.run.smithi052.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-09-30T16:51:06.693 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.695 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c: In function 'test_append': 2023-09-30T16:51:06.695 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.695 INFO:teuthology.orchestra.run.smithi052.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-09-30T16:51:06.695 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.695 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.695 INFO:teuthology.orchestra.run.smithi052.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: 1051 | chown(path, 0, 0); 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.696 INFO:teuthology.orchestra.run.smithi052.stderr: 1516 | chown(path, 0, 0); 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.697 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-09-30T16:51:06.698 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: 1618 | chown(path, 0, 0); 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: 1644 | chown(path, 0, 0); 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.699 INFO:teuthology.orchestra.run.smithi052.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: 1692 | chown(path, 0, 0); 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-09-30T16:51:06.700 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.278 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] stale_handle 2023-09-30T16:51:07.406 INFO:teuthology.orchestra.run.smithi052.stderr:stale_handle.c: In function 'main': 2023-09-30T16:51:07.406 INFO:teuthology.orchestra.run.smithi052.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.406 INFO:teuthology.orchestra.run.smithi052.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-09-30T16:51:07.407 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.455 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] pwrite_mmap_blocked 2023-09-30T16:51:07.598 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_dir_offset2 2023-09-30T16:51:07.787 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] seek_sanity_test 2023-09-30T16:51:07.921 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c: In function 'test18': 2023-09-30T16:51:07.922 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.922 INFO:teuthology.orchestra.run.smithi052.stderr: 460 | ftruncate(fd, 0); 2023-09-30T16:51:07.922 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.923 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr: 1207 | ftruncate(fd, 0); 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr: 1256 | ftruncate(fd, 0); 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.924 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: 88 | ftruncate(fd, 0); 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: 98 | ftruncate(fd, 0); 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:07.925 INFO:teuthology.orchestra.run.smithi052.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-09-30T16:51:07.926 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:08.258 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] seek_copy_test 2023-09-30T16:51:08.429 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_readdir_1 2023-09-30T16:51:08.531 INFO:teuthology.orchestra.run.smithi052.stderr:t_readdir_1.c: In function 'main': 2023-09-30T16:51:08.531 INFO:teuthology.orchestra.run.smithi052.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:08.531 INFO:teuthology.orchestra.run.smithi052.stderr: 30 | read(fd, buf, 100); 2023-09-30T16:51:08.531 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:08.567 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_readdir_2 2023-09-30T16:51:08.711 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fsync-tester 2023-09-30T16:51:08.820 INFO:teuthology.orchestra.run.smithi052.stderr:fsync-tester.c: In function 'main': 2023-09-30T16:51:08.820 INFO:teuthology.orchestra.run.smithi052.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:08.820 INFO:teuthology.orchestra.run.smithi052.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-09-30T16:51:08.820 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:08.821 INFO:teuthology.orchestra.run.smithi052.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:08.821 INFO:teuthology.orchestra.run.smithi052.stderr: 541 | system("reboot -fn"); 2023-09-30T16:51:08.821 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:08.821 INFO:teuthology.orchestra.run.smithi052.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-09-30T16:51:08.821 INFO:teuthology.orchestra.run.smithi052.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:08.822 INFO:teuthology.orchestra.run.smithi052.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-09-30T16:51:08.822 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:08.977 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] nsexec 2023-09-30T16:51:09.160 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] cloner 2023-09-30T16:51:09.340 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] renameat2 2023-09-30T16:51:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_getcwd 2023-09-30T16:51:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:t_getcwd.c: In function 'test_getcwd': 2023-09-30T16:51:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:09.622 INFO:teuthology.orchestra.run.smithi052.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-09-30T16:51:09.622 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:09.675 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] e4compact 2023-09-30T16:51:09.884 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] test-nextquota 2023-09-30T16:51:10.063 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] punch-alternating 2023-09-30T16:51:10.230 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] attr-list-by-handle-cursor-test 2023-09-30T16:51:10.398 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] listxattr 2023-09-30T16:51:10.537 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dio-interleaved 2023-09-30T16:51:10.693 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_dir_type 2023-09-30T16:51:10.850 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] dio-invalidate-cache 2023-09-30T16:51:10.953 INFO:teuthology.orchestra.run.smithi052.stderr:dio-invalidate-cache.c: In function 'main': 2023-09-30T16:51:10.954 INFO:teuthology.orchestra.run.smithi052.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:10.954 INFO:teuthology.orchestra.run.smithi052.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-09-30T16:51:10.954 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:11.058 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] stat_test 2023-09-30T16:51:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_encrypted_d_revalidate 2023-09-30T16:51:11.556 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] attr_replace_test 2023-09-30T16:51:11.714 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] swapon 2023-09-30T16:51:11.896 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] mkswap 2023-09-30T16:51:12.056 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_attr_corruption 2023-09-30T16:51:12.197 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_open_tmpfiles 2023-09-30T16:51:12.374 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fscrypt-crypt-util 2023-09-30T16:51:13.066 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] bulkstat_null_ocount 2023-09-30T16:51:13.218 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] splice-test 2023-09-30T16:51:13.415 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] chprojid_fail 2023-09-30T16:51:13.574 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] detached_mounts_propagation 2023-09-30T16:51:13.759 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] ext4_resize 2023-09-30T16:51:13.909 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_readdir_3 2023-09-30T16:51:14.109 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] splice2pipe 2023-09-30T16:51:14.218 INFO:teuthology.orchestra.run.smithi052.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-09-30T16:51:14.219 INFO:teuthology.orchestra.run.smithi052.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:14.219 INFO:teuthology.orchestra.run.smithi052.stderr: 57 | write(p[1], buffer, n); 2023-09-30T16:51:14.219 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:14.219 INFO:teuthology.orchestra.run.smithi052.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:14.219 INFO:teuthology.orchestra.run.smithi052.stderr: 65 | read(p[0], buffer, n); 2023-09-30T16:51:14.219 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:14.268 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] uuid_ioctl 2023-09-30T16:51:14.420 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fiemap-tester 2023-09-30T16:51:14.695 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_stripealign 2023-09-30T16:51:14.860 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] open_by_handle 2023-09-30T16:51:15.127 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] t_mmap_dio 2023-09-30T16:51:15.298 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] xfsfind 2023-09-30T16:51:15.512 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] fssum 2023-09-30T16:51:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:Building log-writes 2023-09-30T16:51:16.005 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] replay-log 2023-09-30T16:51:16.371 INFO:teuthology.orchestra.run.smithi052.stdout:Building perf 2023-09-30T16:51:16.377 INFO:teuthology.orchestra.run.smithi052.stdout:Building aio-dio-regress 2023-09-30T16:51:16.385 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aiocp 2023-09-30T16:51:16.639 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-append-write-fallocate-race 2023-09-30T16:51:16.820 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-append-write-read-race 2023-09-30T16:51:17.013 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-cow-race 2023-09-30T16:51:17.174 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-cycle-write 2023-09-30T16:51:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-09-30T16:51:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:17.282 INFO:teuthology.orchestra.run.smithi052.stderr: 83 | ftruncate(fd, buf_size); 2023-09-30T16:51:17.282 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:17.374 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-eof-race 2023-09-30T16:51:17.572 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-extend-stat 2023-09-30T16:51:17.753 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-fcntl-race 2023-09-30T16:51:17.918 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-hole-filling-race 2023-09-30T16:51:18.069 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-invalidate-failure 2023-09-30T16:51:18.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:51:18.130 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:51:18.232 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-invalidate-readahead 2023-09-30T16:51:18.403 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aiodio_sparse2 2023-09-30T16:51:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-09-30T16:51:18.512 INFO:teuthology.orchestra.run.smithi052.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:18.512 INFO:teuthology.orchestra.run.smithi052.stderr: 111 | ftruncate(fd, filesize); 2023-09-30T16:51:18.512 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:18.513 INFO:teuthology.orchestra.run.smithi052.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-09-30T16:51:18.513 INFO:teuthology.orchestra.run.smithi052.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-30T16:51:18.513 INFO:teuthology.orchestra.run.smithi052.stderr: 274 | ftruncate(fd, size); 2023-09-30T16:51:18.513 INFO:teuthology.orchestra.run.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-09-30T16:51:18.639 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-subblock-eof-read 2023-09-30T16:51:18.791 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-dio-write-verify 2023-09-30T16:51:18.994 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-09-30T16:51:19.129 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-09-30T16:51:19.256 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] aio-last-ref-held-by-io 2023-09-30T16:51:19.434 INFO:teuthology.orchestra.run.smithi052.stdout:Building vfs 2023-09-30T16:51:19.442 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] vfstest 2023-09-30T16:51:21.719 INFO:teuthology.orchestra.run.smithi052.stdout: [CC] mount-idmapped 2023-09-30T16:51:22.156 INFO:teuthology.orchestra.run.smithi052.stdout:Building m4 2023-09-30T16:51:22.160 INFO:teuthology.orchestra.run.smithi052.stdout:Building common 2023-09-30T16:51:22.166 INFO:teuthology.orchestra.run.smithi052.stdout:Building tests 2023-09-30T16:51:22.172 INFO:teuthology.orchestra.run.smithi052.stdout:Building btrfs 2023-09-30T16:51:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/btrfs/group.list 2023-09-30T16:51:22.254 INFO:teuthology.orchestra.run.smithi052.stdout:Building ceph 2023-09-30T16:51:22.261 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ceph/group.list 2023-09-30T16:51:22.278 INFO:teuthology.orchestra.run.smithi052.stdout:Building cifs 2023-09-30T16:51:22.286 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/cifs/group.list 2023-09-30T16:51:22.299 INFO:teuthology.orchestra.run.smithi052.stdout:Building ext4 2023-09-30T16:51:22.305 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ext4/group.list 2023-09-30T16:51:22.351 INFO:teuthology.orchestra.run.smithi052.stdout:Building f2fs 2023-09-30T16:51:22.356 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/f2fs/group.list 2023-09-30T16:51:22.378 INFO:teuthology.orchestra.run.smithi052.stdout:Building generic 2023-09-30T16:51:22.387 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/generic/group.list 2023-09-30T16:51:22.497 INFO:teuthology.orchestra.run.smithi052.stdout:Building nfs 2023-09-30T16:51:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/nfs/group.list 2023-09-30T16:51:22.520 INFO:teuthology.orchestra.run.smithi052.stdout:Building ocfs2 2023-09-30T16:51:22.526 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ocfs2/group.list 2023-09-30T16:51:22.541 INFO:teuthology.orchestra.run.smithi052.stdout:Building overlay 2023-09-30T16:51:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/overlay/group.list 2023-09-30T16:51:22.592 INFO:teuthology.orchestra.run.smithi052.stdout:Building perf 2023-09-30T16:51:22.597 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/perf/group.list 2023-09-30T16:51:22.609 INFO:teuthology.orchestra.run.smithi052.stdout:Building selftest 2023-09-30T16:51:22.616 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/selftest/group.list 2023-09-30T16:51:22.629 INFO:teuthology.orchestra.run.smithi052.stdout:Building shared 2023-09-30T16:51:22.634 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/shared/group.list 2023-09-30T16:51:22.652 INFO:teuthology.orchestra.run.smithi052.stdout:Building tmpfs 2023-09-30T16:51:22.658 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/tmpfs/group.list 2023-09-30T16:51:22.674 INFO:teuthology.orchestra.run.smithi052.stdout:Building udf 2023-09-30T16:51:22.680 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/udf/group.list 2023-09-30T16:51:22.692 INFO:teuthology.orchestra.run.smithi052.stdout:Building xfs 2023-09-30T16:51:22.699 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/xfs/group.list 2023-09-30T16:51:22.815 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo make install) 2023-09-30T16:51:22.841 INFO:teuthology.orchestra.run.smithi052.stdout:Building include 2023-09-30T16:51:22.845 INFO:teuthology.orchestra.run.smithi052.stdout:Building lib 2023-09-30T16:51:22.849 INFO:teuthology.orchestra.run.smithi052.stdout:Building ltp 2023-09-30T16:51:22.854 INFO:teuthology.orchestra.run.smithi052.stdout:Building src 2023-09-30T16:51:22.894 INFO:teuthology.orchestra.run.smithi052.stdout:Building log-writes 2023-09-30T16:51:22.898 INFO:teuthology.orchestra.run.smithi052.stdout:Building perf 2023-09-30T16:51:22.902 INFO:teuthology.orchestra.run.smithi052.stdout:Building aio-dio-regress 2023-09-30T16:51:22.906 INFO:teuthology.orchestra.run.smithi052.stdout:Building vfs 2023-09-30T16:51:22.910 INFO:teuthology.orchestra.run.smithi052.stdout:Building m4 2023-09-30T16:51:22.914 INFO:teuthology.orchestra.run.smithi052.stdout:Building common 2023-09-30T16:51:22.919 INFO:teuthology.orchestra.run.smithi052.stdout:Building tests 2023-09-30T16:51:22.925 INFO:teuthology.orchestra.run.smithi052.stdout:Building btrfs 2023-09-30T16:51:22.934 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/btrfs/group.list 2023-09-30T16:51:23.005 INFO:teuthology.orchestra.run.smithi052.stdout:Building ceph 2023-09-30T16:51:23.010 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ceph/group.list 2023-09-30T16:51:23.026 INFO:teuthology.orchestra.run.smithi052.stdout:Building cifs 2023-09-30T16:51:23.033 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/cifs/group.list 2023-09-30T16:51:23.047 INFO:teuthology.orchestra.run.smithi052.stdout:Building ext4 2023-09-30T16:51:23.052 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ext4/group.list 2023-09-30T16:51:23.095 INFO:teuthology.orchestra.run.smithi052.stdout:Building f2fs 2023-09-30T16:51:23.100 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/f2fs/group.list 2023-09-30T16:51:23.119 INFO:teuthology.orchestra.run.smithi052.stdout:Building generic 2023-09-30T16:51:23.126 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/generic/group.list 2023-09-30T16:51:23.239 INFO:teuthology.orchestra.run.smithi052.stdout:Building nfs 2023-09-30T16:51:23.245 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/nfs/group.list 2023-09-30T16:51:23.261 INFO:teuthology.orchestra.run.smithi052.stdout:Building ocfs2 2023-09-30T16:51:23.267 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ocfs2/group.list 2023-09-30T16:51:23.282 INFO:teuthology.orchestra.run.smithi052.stdout:Building overlay 2023-09-30T16:51:23.288 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/overlay/group.list 2023-09-30T16:51:23.326 INFO:teuthology.orchestra.run.smithi052.stdout:Building perf 2023-09-30T16:51:23.331 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/perf/group.list 2023-09-30T16:51:23.344 INFO:teuthology.orchestra.run.smithi052.stdout:Building selftest 2023-09-30T16:51:23.349 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/selftest/group.list 2023-09-30T16:51:23.360 INFO:teuthology.orchestra.run.smithi052.stdout:Building shared 2023-09-30T16:51:23.365 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/shared/group.list 2023-09-30T16:51:23.383 INFO:teuthology.orchestra.run.smithi052.stdout:Building tmpfs 2023-09-30T16:51:23.388 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/tmpfs/group.list 2023-09-30T16:51:23.402 INFO:teuthology.orchestra.run.smithi052.stdout:Building udf 2023-09-30T16:51:23.407 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/udf/group.list 2023-09-30T16:51:23.418 INFO:teuthology.orchestra.run.smithi052.stdout:Building xfs 2023-09-30T16:51:23.423 INFO:teuthology.orchestra.run.smithi052.stdout: [GROUP] /tmp/tmp.qvcny3LNTMxfstests-dev/tests/xfs/group.list 2023-09-30T16:51:23.519 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-09-30T16:51:23.521 INFO:teuthology.orchestra.run.smithi052.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-30T16:51:23.521 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-09-30T16:51:23.524 INFO:teuthology.orchestra.run.smithi052.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-30T16:51:23.524 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-09-30T16:51:23.527 INFO:teuthology.orchestra.run.smithi052.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-09-30T16:51:23.535 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-09-30T16:51:23.611 INFO:teuthology.orchestra.run.smithi052.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-09-30T16:51:23.620 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-09-30T16:51:23.636 INFO:teuthology.orchestra.run.smithi052.stdout:Building log-writes 2023-09-30T16:51:23.640 INFO:teuthology.orchestra.run.smithi052.stdout:Building perf 2023-09-30T16:51:23.643 INFO:teuthology.orchestra.run.smithi052.stdout:Building aio-dio-regress 2023-09-30T16:51:23.647 INFO:teuthology.orchestra.run.smithi052.stdout:Building vfs 2023-09-30T16:51:23.650 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake -C log-writes install 2023-09-30T16:51:23.652 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-09-30T16:51:23.661 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-09-30T16:51:23.670 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake -C perf install 2023-09-30T16:51:23.673 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-09-30T16:51:23.682 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-09-30T16:51:23.702 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-09-30T16:51:23.705 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-09-30T16:51:23.714 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-09-30T16:51:23.762 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake -C vfs install 2023-09-30T16:51:23.764 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-09-30T16:51:23.772 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-09-30T16:51:23.784 INFO:teuthology.orchestra.run.smithi052.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-09-30T16:51:23.793 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-09-30T16:51:25.350 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-09-30T16:51:25.482 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-09-30T16:51:25.513 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-09-30T16:51:25.515 INFO:teuthology.orchestra.run.smithi052.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-30T16:51:25.515 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-09-30T16:51:25.518 INFO:teuthology.orchestra.run.smithi052.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-09-30T16:51:25.530 INFO:teuthology.orchestra.run.smithi052.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-09-30T16:51:25.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-09-30T16:51:25.683 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/btrfs/ install 2023-09-30T16:51:25.688 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-09-30T16:51:25.700 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-09-30T16:51:26.700 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-09-30T16:51:26.712 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 299.out 300.out /var/lib/xfstests/tests/btrfs 2023-09-30T16:51:27.773 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ceph/ install 2023-09-30T16:51:27.776 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-09-30T16:51:27.789 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-09-30T16:51:27.816 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-09-30T16:51:27.828 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-09-30T16:51:27.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/cifs/ install 2023-09-30T16:51:27.857 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-09-30T16:51:27.869 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-09-30T16:51:27.882 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-09-30T16:51:27.893 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-09-30T16:51:27.905 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ext4/ install 2023-09-30T16:51:27.908 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-09-30T16:51:27.921 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-09-30T16:51:28.136 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-09-30T16:51:28.147 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-09-30T16:51:28.381 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/f2fs/ install 2023-09-30T16:51:28.384 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-09-30T16:51:28.396 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-09-30T16:51:28.411 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-09-30T16:51:28.423 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-09-30T16:51:28.437 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/generic/ install 2023-09-30T16:51:28.443 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-09-30T16:51:28.456 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-09-30T16:51:31.024 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-09-30T16:51:31.037 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out /var/lib/xfstests/tests/generic 2023-09-30T16:51:33.618 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/nfs/ install 2023-09-30T16:51:33.621 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-09-30T16:51:33.634 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-09-30T16:51:33.646 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-09-30T16:51:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-09-30T16:51:33.671 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/ocfs2/ install 2023-09-30T16:51:33.674 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-09-30T16:51:33.686 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-09-30T16:51:33.699 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-09-30T16:51:33.711 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-09-30T16:51:33.723 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/overlay/ install 2023-09-30T16:51:33.727 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-09-30T16:51:33.739 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-09-30T16:51:34.091 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-09-30T16:51:34.105 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-09-30T16:51:34.455 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/perf/ install 2023-09-30T16:51:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-09-30T16:51:34.471 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-09-30T16:51:34.484 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-09-30T16:51:34.496 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-09-30T16:51:34.508 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/selftest/ install 2023-09-30T16:51:34.511 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-09-30T16:51:34.524 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-09-30T16:51:34.553 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-09-30T16:51:34.566 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-09-30T16:51:34.595 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/shared/ install 2023-09-30T16:51:34.598 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-09-30T16:51:34.610 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-09-30T16:51:34.629 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-09-30T16:51:34.642 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-09-30T16:51:34.660 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/tmpfs/ install 2023-09-30T16:51:34.663 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-09-30T16:51:34.677 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-09-30T16:51:34.688 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-09-30T16:51:34.701 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-09-30T16:51:34.714 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/udf/ install 2023-09-30T16:51:34.717 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-09-30T16:51:34.729 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-09-30T16:51:34.741 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-09-30T16:51:34.753 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-09-30T16:51:34.766 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qvcny3LNTMxfstests-dev/tests/xfs/ install 2023-09-30T16:51:34.773 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-09-30T16:51:34.785 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-09-30T16:51:37.098 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-09-30T16:51:37.112 INFO:teuthology.orchestra.run.smithi052.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-09-30T16:51:39.553 INFO:teuthology.orchestra.run.smithi052.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-09-30T16:51:39.567 INFO:teuthology.orchestra.run.smithi052.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-09-30T16:51:39.579 INFO:teuthology.orchestra.run.smithi052.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-09-30T16:51:39.591 INFO:teuthology.orchestra.run.smithi052.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-09-30T16:51:39.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T16:51:39.607 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec ls tests/generic) 2023-09-30T16:51:39.657 INFO:teuthology.orchestra.run.smithi052.stdout:001 2023-09-30T16:51:39.657 INFO:teuthology.orchestra.run.smithi052.stdout:001.out 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:002 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:002.out 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:003 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:003.out 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:004 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:004.out 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:005 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:005.out 2023-09-30T16:51:39.658 INFO:teuthology.orchestra.run.smithi052.stdout:006 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:006.out 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:007 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:007.out 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:008 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:008.out 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:009 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:009.out 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:010 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:010.out 2023-09-30T16:51:39.659 INFO:teuthology.orchestra.run.smithi052.stdout:011 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:011.out 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:012 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:012.out 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:013 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:013.out 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:014 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:014.out 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:015 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:015.out 2023-09-30T16:51:39.660 INFO:teuthology.orchestra.run.smithi052.stdout:016 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:016.out 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:017 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:017.out 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:018 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:018.out 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:019 2023-09-30T16:51:39.661 INFO:teuthology.orchestra.run.smithi052.stdout:019.out 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:020 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:020.out 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:021 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:021.out 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:022 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:022.out 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:023 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:023.out 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:024 2023-09-30T16:51:39.662 INFO:teuthology.orchestra.run.smithi052.stdout:024.out 2023-09-30T16:51:39.663 INFO:teuthology.orchestra.run.smithi052.stdout:025 2023-09-30T16:51:39.663 INFO:teuthology.orchestra.run.smithi052.stdout:025.out 2023-09-30T16:51:39.663 INFO:teuthology.orchestra.run.smithi052.stdout:026 2023-09-30T16:51:39.663 INFO:teuthology.orchestra.run.smithi052.stdout:026.out 2023-09-30T16:51:39.663 INFO:teuthology.orchestra.run.smithi052.stdout:027 2023-09-30T16:51:39.663 INFO:teuthology.orchestra.run.smithi052.stdout:027.out 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:028 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:028.out 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:029 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:029.out 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:030 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:030.out 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:031 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:031.out 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:032 2023-09-30T16:51:39.664 INFO:teuthology.orchestra.run.smithi052.stdout:032.out 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:033 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:033.out 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:034 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:034.out 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:035 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:035.cfg 2023-09-30T16:51:39.665 INFO:teuthology.orchestra.run.smithi052.stdout:035.out.default 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:035.out.nfs 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:036 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:036.out 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:037 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:037.out 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:038 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:038.out 2023-09-30T16:51:39.666 INFO:teuthology.orchestra.run.smithi052.stdout:039 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:039.out 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:040 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:040.out 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:041 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:041.out 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:042 2023-09-30T16:51:39.667 INFO:teuthology.orchestra.run.smithi052.stdout:042.out 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:043 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:043.out 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:044 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:044.out 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:045 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:045.out 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:046 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:046.out 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:047 2023-09-30T16:51:39.668 INFO:teuthology.orchestra.run.smithi052.stdout:047.out 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:048 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:048.out 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:049 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:049.out 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:050 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:050.cfg 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:050.out.default 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:050.out.nojournal 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:050.out.xfsquota 2023-09-30T16:51:39.669 INFO:teuthology.orchestra.run.smithi052.stdout:051 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:051.out 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:052 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:052.out 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:053 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:053.out 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:054 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:054.out 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:055 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:055.out 2023-09-30T16:51:39.670 INFO:teuthology.orchestra.run.smithi052.stdout:056 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:056.out 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:057 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:057.out 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:058 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:058.out 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:059 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:059.out 2023-09-30T16:51:39.671 INFO:teuthology.orchestra.run.smithi052.stdout:060 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:060.out 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:061 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:061.out 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:062 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:062.out 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:063 2023-09-30T16:51:39.672 INFO:teuthology.orchestra.run.smithi052.stdout:063.out 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:064 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:064.out 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:065 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:065.out 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:066 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:066.out 2023-09-30T16:51:39.673 INFO:teuthology.orchestra.run.smithi052.stdout:067 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:067.out 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:068 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:068.out 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:069 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:069.out 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:070 2023-09-30T16:51:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:070.out 2023-09-30T16:51:39.675 INFO:teuthology.orchestra.run.smithi052.stdout:071 2023-09-30T16:51:39.675 INFO:teuthology.orchestra.run.smithi052.stdout:071.out 2023-09-30T16:51:39.675 INFO:teuthology.orchestra.run.smithi052.stdout:072 2023-09-30T16:51:39.675 INFO:teuthology.orchestra.run.smithi052.stdout:072.out 2023-09-30T16:51:39.675 INFO:teuthology.orchestra.run.smithi052.stdout:073 2023-09-30T16:51:39.675 INFO:teuthology.orchestra.run.smithi052.stdout:073.out 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:074 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:074.out 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:075 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:075.out 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:076 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:076.out 2023-09-30T16:51:39.676 INFO:teuthology.orchestra.run.smithi052.stdout:077 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:077.out 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:078 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:078.out 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:079 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:079.out 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:080 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:080.out 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:081 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:081.out 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:082 2023-09-30T16:51:39.677 INFO:teuthology.orchestra.run.smithi052.stdout:082.out 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:083 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:083.out 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:084 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:084.out 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:085 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:085.out 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:086 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:086.out 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:087 2023-09-30T16:51:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:087.out 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:088 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:088.out 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:089 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:089.out 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:090 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:090.out 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:091 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:091.out 2023-09-30T16:51:39.679 INFO:teuthology.orchestra.run.smithi052.stdout:092 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:092.out 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:093 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:093.out 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:094 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:094.out 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:095 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:095.out 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:096 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:096.out 2023-09-30T16:51:39.680 INFO:teuthology.orchestra.run.smithi052.stdout:097 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:097.out 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:098 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:098.out 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:099 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:099.out 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:100 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:100.out 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:101 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:101.out 2023-09-30T16:51:39.681 INFO:teuthology.orchestra.run.smithi052.stdout:102 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:102.out 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:103 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:103.out 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:104 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:104.out 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:105 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:105.out 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:106 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:106.out 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:107 2023-09-30T16:51:39.682 INFO:teuthology.orchestra.run.smithi052.stdout:107.out 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:108 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:108.out 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:109 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:109.out 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:110 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:110.out 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:111 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:111.out 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:112 2023-09-30T16:51:39.683 INFO:teuthology.orchestra.run.smithi052.stdout:112.out 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:113 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:113.out 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:114 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:114.out 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:115 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:115.out 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:116 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:116.out 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:117 2023-09-30T16:51:39.684 INFO:teuthology.orchestra.run.smithi052.stdout:117.out 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:118 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:118.out 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:119 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:119.out 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:120 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:120.out 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:121 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:121.out 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:122 2023-09-30T16:51:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:122.out 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:123 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:123.out 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:124 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:124.out 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:125 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:125.out 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:126 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:126.out 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:127 2023-09-30T16:51:39.686 INFO:teuthology.orchestra.run.smithi052.stdout:127.out 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:128 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:128.out 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:129 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:129.out 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:130 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:130.out 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:131 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:131.out 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:132 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:132.out 2023-09-30T16:51:39.687 INFO:teuthology.orchestra.run.smithi052.stdout:133 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:133.out 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:134 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:134.out 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:135 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:135.out 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:136 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:136.out 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:137 2023-09-30T16:51:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:137.out 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:138 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:138.out 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:139 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:139.out 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:140 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:140.out 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:141 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:141.out 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:142 2023-09-30T16:51:39.689 INFO:teuthology.orchestra.run.smithi052.stdout:142.out 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:143 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:143.out 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:144 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:144.out 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:145 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:145.out 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:146 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:146.out 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:147 2023-09-30T16:51:39.690 INFO:teuthology.orchestra.run.smithi052.stdout:147.out 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:148 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:148.out 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:149 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:149.out 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:150 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:150.out 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:151 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:151.out 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:152 2023-09-30T16:51:39.691 INFO:teuthology.orchestra.run.smithi052.stdout:152.out 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:153 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:153.out 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:154 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:154.out 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:155 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:155.out 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:156 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:156.out 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:157 2023-09-30T16:51:39.692 INFO:teuthology.orchestra.run.smithi052.stdout:157.out 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:158 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:158.out 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:159 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:159.out 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:160 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:160.out 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:161 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:161.out 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:162 2023-09-30T16:51:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:162.out 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:163 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:163.out 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:164 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:164.out 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:165 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:165.out 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:166 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:166.out 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:167 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:167.out 2023-09-30T16:51:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:168 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:168.out 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:169 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:169.out 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:170 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:170.out 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:171 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:171.out 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:172 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:172.out 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:173 2023-09-30T16:51:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:173.out 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:174 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:174.out 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:175 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:175.out 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:176 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:176.out 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:177 2023-09-30T16:51:39.696 INFO:teuthology.orchestra.run.smithi052.stdout:177.out 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:178 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:178.out 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:179 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:179.out 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:180 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:180.out 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:181 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:181.out 2023-09-30T16:51:39.697 INFO:teuthology.orchestra.run.smithi052.stdout:182 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:182.out 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:183 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:183.out 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:184 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:184.out 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:185 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:185.out 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:186 2023-09-30T16:51:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:186.out 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:187 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:187.out 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:188 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:188.out 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:189 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:189.out 2023-09-30T16:51:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:190 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:190.out 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:191 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:191.out 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:192 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:192.out 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:193 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:193.out 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:194 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:194.out 2023-09-30T16:51:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:195 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:195.out 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:196 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:196.out 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:197 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:197.out 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:198 2023-09-30T16:51:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:198.out 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:199 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:199.out 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:200 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:200.out 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:201 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:201.out 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:202 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:202.out 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:203 2023-09-30T16:51:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:203.out 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:204 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:204.out 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:205 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:205.out 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:206 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:206.out 2023-09-30T16:51:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:207 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:207.out 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:208 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:208.out 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:209 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:209.out 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:210 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:210.out 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:211 2023-09-30T16:51:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:211.out 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:212 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:212.out 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:213 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:213.out 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:214 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:214.out 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:215 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:215.out 2023-09-30T16:51:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:216 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:216.out 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:217 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:217.out 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:218 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:218.out 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:219 2023-09-30T16:51:39.706 INFO:teuthology.orchestra.run.smithi052.stdout:219.out 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:220 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:220.out 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:221 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:221.out 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:222 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:222.out 2023-09-30T16:51:39.707 INFO:teuthology.orchestra.run.smithi052.stdout:223 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:223.out 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:224 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:224.out 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:225 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:225.out 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:226 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:226.out 2023-09-30T16:51:39.708 INFO:teuthology.orchestra.run.smithi052.stdout:227 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:227.out 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:228 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:228.out 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:229 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:229.out 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:230 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:230.out 2023-09-30T16:51:39.709 INFO:teuthology.orchestra.run.smithi052.stdout:231 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:231.out 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:232 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:232.out 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:233 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:233.out 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:234 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:234.out 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:235 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:235.out 2023-09-30T16:51:39.710 INFO:teuthology.orchestra.run.smithi052.stdout:236 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:236.out 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:237 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:237.out 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:238 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:238.out 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:239 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:239.out 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:240 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:240.out 2023-09-30T16:51:39.711 INFO:teuthology.orchestra.run.smithi052.stdout:241 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:241.out 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:242 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:242.out 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:243 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:243.out 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:244 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:244.out 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:245 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:245.out 2023-09-30T16:51:39.712 INFO:teuthology.orchestra.run.smithi052.stdout:246 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:246.out 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:247 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:247.out 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:248 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:248.out 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:249 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:249.out 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:250 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:250.out 2023-09-30T16:51:39.713 INFO:teuthology.orchestra.run.smithi052.stdout:251 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:251.out 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:252 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:252.out 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:253 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:253.out 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:254 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:254.out 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:255 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:255.out 2023-09-30T16:51:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:256 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:256.out 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:257 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:257.out 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:258 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:258.out 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:259 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:259.out 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:260 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:260.out 2023-09-30T16:51:39.715 INFO:teuthology.orchestra.run.smithi052.stdout:261 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:261.out 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:262 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:262.out 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:263 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:263.out 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:264 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:264.out 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:265 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:265.out 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:266 2023-09-30T16:51:39.716 INFO:teuthology.orchestra.run.smithi052.stdout:266.out 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:267 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:267.out 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:268 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:268.out 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:269 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:269.out 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:270 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:270.out 2023-09-30T16:51:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:271 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:271.out 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:272 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:272.out 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:273 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:273.out 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:274 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:274.out 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:275 2023-09-30T16:51:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:275.out 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:276 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:276.out 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:277 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:277.out 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:278 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:278.out 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:279 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:279.out 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:280 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:280.out 2023-09-30T16:51:39.719 INFO:teuthology.orchestra.run.smithi052.stdout:281 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:281.out 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:282 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:282.out 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:283 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:283.out 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:284 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:284.out 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:285 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:285.out 2023-09-30T16:51:39.720 INFO:teuthology.orchestra.run.smithi052.stdout:286 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:286.out 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:287 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:287.out 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:288 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:288.out 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:289 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:289.out 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:290 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:290.out 2023-09-30T16:51:39.721 INFO:teuthology.orchestra.run.smithi052.stdout:291 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:291.out 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:292 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:292.out 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:293 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:293.out 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:294 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:294.out 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:295 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:295.out 2023-09-30T16:51:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:296 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:296.out 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:297 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:297.out 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:298 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:298.out 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:299 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:299.out 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:300 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:300.out 2023-09-30T16:51:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:301 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:301.out 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:302 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:302.out 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:303 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:303.out 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:304 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:304.out 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:305 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:305.out 2023-09-30T16:51:39.724 INFO:teuthology.orchestra.run.smithi052.stdout:306 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:306.out 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:307 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:307.out 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:308 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:308.out 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:309 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:309.out 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:310 2023-09-30T16:51:39.725 INFO:teuthology.orchestra.run.smithi052.stdout:310.out 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:311 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:311.out 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:312 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:312.out 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:313 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:313.out 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:314 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:314.out 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:315 2023-09-30T16:51:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:315.out 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:316 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:316.out 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:317 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:317.out 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:318 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:318.out 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:319 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:319.out 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:320 2023-09-30T16:51:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:320.out 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:321 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:321.out 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:322 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:322.out 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:323 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:323.out 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:324 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:324.out 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:325 2023-09-30T16:51:39.728 INFO:teuthology.orchestra.run.smithi052.stdout:325.out 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:326 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:326.out 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:327 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:327.out 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:328 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:328.out 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:329 2023-09-30T16:51:39.729 INFO:teuthology.orchestra.run.smithi052.stdout:329.out 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:330 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:330.out 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:331 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:331.out 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:332 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:332.out 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:333 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:333.out 2023-09-30T16:51:39.730 INFO:teuthology.orchestra.run.smithi052.stdout:334 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:334.out 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:335 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:335.out 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:336 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:336.out 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:337 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:337.out 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:338 2023-09-30T16:51:39.731 INFO:teuthology.orchestra.run.smithi052.stdout:338.out 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:339 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:339.out 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:340 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:340.out 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:341 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:341.out 2023-09-30T16:51:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:342 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:342.out 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:343 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:343.out 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:344 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:344.out 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:345 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:345.out 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:346 2023-09-30T16:51:39.733 INFO:teuthology.orchestra.run.smithi052.stdout:346.out 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:347 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:347.out 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:348 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:348.out 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:349 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:349.out 2023-09-30T16:51:39.734 INFO:teuthology.orchestra.run.smithi052.stdout:350 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:350.out 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:351 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:351.out 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:352 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:352.out 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:353 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:353.out 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:354 2023-09-30T16:51:39.735 INFO:teuthology.orchestra.run.smithi052.stdout:354.out 2023-09-30T16:51:39.736 INFO:teuthology.orchestra.run.smithi052.stdout:355 2023-09-30T16:51:39.736 INFO:teuthology.orchestra.run.smithi052.stdout:355.out 2023-09-30T16:51:39.736 INFO:teuthology.orchestra.run.smithi052.stdout:356 2023-09-30T16:51:39.736 INFO:teuthology.orchestra.run.smithi052.stdout:356.out 2023-09-30T16:51:39.736 INFO:teuthology.orchestra.run.smithi052.stdout:357 2023-09-30T16:51:39.736 INFO:teuthology.orchestra.run.smithi052.stdout:357.out 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:358 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:358.out 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:359 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:359.out 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:360 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:360.out 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:361 2023-09-30T16:51:39.737 INFO:teuthology.orchestra.run.smithi052.stdout:361.out 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:362 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:362.out 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:363 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:363.out 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:364 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:364.out 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:365 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:365.out 2023-09-30T16:51:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:366 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:366.out 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:367 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:367.out 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:368 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:368.out 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:369 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:369.out 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:370 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:370.out 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:371 2023-09-30T16:51:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:371.out 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:372 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:372.out 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:373 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:373.out 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:374 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:374.out 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:375 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:375.out 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:376 2023-09-30T16:51:39.740 INFO:teuthology.orchestra.run.smithi052.stdout:376.out 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:377 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:377.out 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:378 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:378.out 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:379 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:379.out 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:380 2023-09-30T16:51:39.741 INFO:teuthology.orchestra.run.smithi052.stdout:380.out 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:381 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:381.out 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:382 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:382.out 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:383 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:383.out 2023-09-30T16:51:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:384 2023-09-30T16:51:39.743 INFO:teuthology.orchestra.run.smithi052.stdout:384.out 2023-09-30T16:51:39.743 INFO:teuthology.orchestra.run.smithi052.stdout:385 2023-09-30T16:51:39.743 INFO:teuthology.orchestra.run.smithi052.stdout:385.out 2023-09-30T16:51:39.743 INFO:teuthology.orchestra.run.smithi052.stdout:386 2023-09-30T16:51:39.743 INFO:teuthology.orchestra.run.smithi052.stdout:386.out 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:387 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:387.out 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:388 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:388.out 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:389 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:389.out 2023-09-30T16:51:39.744 INFO:teuthology.orchestra.run.smithi052.stdout:390 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:390.out 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:391 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:391.out 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:392 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:392.out 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:393 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:393.out 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:394 2023-09-30T16:51:39.745 INFO:teuthology.orchestra.run.smithi052.stdout:394.out 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:395 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:395.out 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:396 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:396.out 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:397 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:397.out 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:398 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:398.out 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:399 2023-09-30T16:51:39.746 INFO:teuthology.orchestra.run.smithi052.stdout:399.out 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:400 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:400.out 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:401 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:401.out 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:402 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:402.out 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:403 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:403.out 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:404 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:404.out 2023-09-30T16:51:39.747 INFO:teuthology.orchestra.run.smithi052.stdout:405 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:405.out 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:406 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:406.out 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:407 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:407.out 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:408 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:408.out 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:409 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:409.out 2023-09-30T16:51:39.748 INFO:teuthology.orchestra.run.smithi052.stdout:410 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:410.out 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:411 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:411.out 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:412 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:412.out 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:413 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:413.out 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:414 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:414.out 2023-09-30T16:51:39.749 INFO:teuthology.orchestra.run.smithi052.stdout:415 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:415.out 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:416 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:416.out 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:417 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:417.out 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:418 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:418.out 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:419 2023-09-30T16:51:39.750 INFO:teuthology.orchestra.run.smithi052.stdout:419.out 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:420 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:420.out 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:421 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:421.out 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:422 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:422.out 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:423 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:423.out 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:424 2023-09-30T16:51:39.751 INFO:teuthology.orchestra.run.smithi052.stdout:424.out 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:425 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:425.out 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:426 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:426.out 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:427 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:427.out 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:428 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:428.out 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:429 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:429.out 2023-09-30T16:51:39.752 INFO:teuthology.orchestra.run.smithi052.stdout:430 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:430.out 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:431 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:431.out 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:432 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:432.out 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:433 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:433.out 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:434 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:434.out 2023-09-30T16:51:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:435 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:435.out 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:436 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:436.out 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:437 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:437.out 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:438 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:438.out 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:439 2023-09-30T16:51:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:439.out 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:440 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:440.out 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:441 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:441.out 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:442 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:442.out 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:443 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:443.out 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:444 2023-09-30T16:51:39.755 INFO:teuthology.orchestra.run.smithi052.stdout:444.out 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:445 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:445.out 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:446 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:446.out 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:447 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:447.out 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:448 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:448.out 2023-09-30T16:51:39.756 INFO:teuthology.orchestra.run.smithi052.stdout:449 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:449.out 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:450 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:450.out 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:451 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:451.out 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:452 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:452.out 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:453 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:453.out 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:454 2023-09-30T16:51:39.757 INFO:teuthology.orchestra.run.smithi052.stdout:454.out 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:455 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:455.out 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:456 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:456.out 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:457 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:457.out 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:458 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:458.out 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:459 2023-09-30T16:51:39.758 INFO:teuthology.orchestra.run.smithi052.stdout:459.out 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:460 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:460.out 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:461 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:461.out 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:462 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:462.out 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:463 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:463.out 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:464 2023-09-30T16:51:39.759 INFO:teuthology.orchestra.run.smithi052.stdout:464.out 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:465 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:465.out 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:466 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:466.out 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:467 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:467.out 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:468 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:468.out 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:469 2023-09-30T16:51:39.760 INFO:teuthology.orchestra.run.smithi052.stdout:469.out 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:470 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:470.out 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:472 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:472.out 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:473 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:473.out 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:474 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:474.out 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:475 2023-09-30T16:51:39.761 INFO:teuthology.orchestra.run.smithi052.stdout:475.out 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:476 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:476.out 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:477 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:477.out 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:478 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:478.out 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:479 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:479.out 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:480 2023-09-30T16:51:39.762 INFO:teuthology.orchestra.run.smithi052.stdout:480.out 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:481 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:481.out 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:482 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:482.out 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:483 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:483.out 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:484 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:484.out 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:485 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:485.out 2023-09-30T16:51:39.763 INFO:teuthology.orchestra.run.smithi052.stdout:486 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:486.out 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:487 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:487.out 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:488 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:488.out 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:489 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:489.out 2023-09-30T16:51:39.764 INFO:teuthology.orchestra.run.smithi052.stdout:490 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:490.out 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:491 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:491.out 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:492 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:492.out 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:493 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:493.out 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:494 2023-09-30T16:51:39.765 INFO:teuthology.orchestra.run.smithi052.stdout:494.out 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:495 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:495.out 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:496 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:496.out 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:497 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:497.out 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:498 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:498.out 2023-09-30T16:51:39.766 INFO:teuthology.orchestra.run.smithi052.stdout:499 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:499.out 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:500 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:500.out 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:501 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:501.out 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:502 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:502.out 2023-09-30T16:51:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:503 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:503.out 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:504 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:504.out 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:505 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:505.out 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:506 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:506.out 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:507 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:507.out 2023-09-30T16:51:39.768 INFO:teuthology.orchestra.run.smithi052.stdout:508 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:508.out 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:509 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:509.out 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:510 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:510.out 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:511 2023-09-30T16:51:39.769 INFO:teuthology.orchestra.run.smithi052.stdout:511.out 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:512 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:512.out 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:513 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:513.out 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:514 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:514.out 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:515 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:515.out 2023-09-30T16:51:39.770 INFO:teuthology.orchestra.run.smithi052.stdout:516 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:516.out 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:517 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:517.out 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:518 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:518.out 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:519 2023-09-30T16:51:39.771 INFO:teuthology.orchestra.run.smithi052.stdout:519.out 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:520 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:520.out 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:521 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:521.out 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:522 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:522.out 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:523 2023-09-30T16:51:39.772 INFO:teuthology.orchestra.run.smithi052.stdout:523.out 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:524 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:524.out 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:525 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:525.out 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:526 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:526.out 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:527 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:527.out 2023-09-30T16:51:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:528 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:528.out 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:529 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:529.out 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:530 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:530.out 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:531 2023-09-30T16:51:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:531.out 2023-09-30T16:51:39.775 INFO:teuthology.orchestra.run.smithi052.stdout:532 2023-09-30T16:51:39.775 INFO:teuthology.orchestra.run.smithi052.stdout:532.out 2023-09-30T16:51:39.775 INFO:teuthology.orchestra.run.smithi052.stdout:533 2023-09-30T16:51:39.775 INFO:teuthology.orchestra.run.smithi052.stdout:533.out 2023-09-30T16:51:39.775 INFO:teuthology.orchestra.run.smithi052.stdout:534 2023-09-30T16:51:39.775 INFO:teuthology.orchestra.run.smithi052.stdout:534.out 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:535 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:535.out 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:536 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:536.out 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:537 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:537.out 2023-09-30T16:51:39.776 INFO:teuthology.orchestra.run.smithi052.stdout:538 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:538.out 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:539 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:539.out 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:540 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:540.out 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:541 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:541.out 2023-09-30T16:51:39.777 INFO:teuthology.orchestra.run.smithi052.stdout:542 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:542.out 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:543 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:543.out 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:544 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:544.out 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:545 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:545.out 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:546 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:546.out 2023-09-30T16:51:39.778 INFO:teuthology.orchestra.run.smithi052.stdout:547 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:547.out 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:548 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:548.out 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:549 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:549.out 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:550 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:550.out 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:551 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:551.out 2023-09-30T16:51:39.779 INFO:teuthology.orchestra.run.smithi052.stdout:552 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:552.out 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:553 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:553.out 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:554 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:554.out 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:555 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:555.out 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:556 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:556.out 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:557 2023-09-30T16:51:39.780 INFO:teuthology.orchestra.run.smithi052.stdout:557.out 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:558 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:558.out 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:559 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:559.out 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:560 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:560.out 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:561 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:561.out 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:562 2023-09-30T16:51:39.781 INFO:teuthology.orchestra.run.smithi052.stdout:562.out 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:563 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:563.out 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:564 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:564.out 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:565 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:565.out 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:566 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:566.out 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:567 2023-09-30T16:51:39.782 INFO:teuthology.orchestra.run.smithi052.stdout:567.out 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:568 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:568.out 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:569 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:569.out 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:570 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:570.out 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:571 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:571.out 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:572 2023-09-30T16:51:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:572.out 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:573 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:573.out 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:574 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:574.out 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:575 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:575.out 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:576 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:576.out 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:577 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:577.out 2023-09-30T16:51:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:578 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:578.out 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:579 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:579.out 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:580 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:580.out 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:581 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:581.out 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:582 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:582.out 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:583 2023-09-30T16:51:39.785 INFO:teuthology.orchestra.run.smithi052.stdout:583.out 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:584 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:584.out 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:585 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:585.out 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:586 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:586.out 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:587 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:587.out 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:588 2023-09-30T16:51:39.786 INFO:teuthology.orchestra.run.smithi052.stdout:588.out 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:589 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:589.out 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:590 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:590.out 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:591 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:591.out 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:592 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:592.out 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:593 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:593.out 2023-09-30T16:51:39.787 INFO:teuthology.orchestra.run.smithi052.stdout:594 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:594.out 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:595 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:595.out 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:596 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:596.out 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:597 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:597.out 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:598 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:598.out 2023-09-30T16:51:39.788 INFO:teuthology.orchestra.run.smithi052.stdout:599 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:599.out 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:600 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:600.out 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:601 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:601.out 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:602 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:602.out 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:603 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:603.out 2023-09-30T16:51:39.789 INFO:teuthology.orchestra.run.smithi052.stdout:604 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:604.out 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:605 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:605.out 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:606 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:606.out 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:607 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:607.out 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:608 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:608.out 2023-09-30T16:51:39.790 INFO:teuthology.orchestra.run.smithi052.stdout:609 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:609.out 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:610 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:610.out 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:611 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:611.out 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:612 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:612.out 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:613 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:613.out 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:614 2023-09-30T16:51:39.791 INFO:teuthology.orchestra.run.smithi052.stdout:614.out 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:615 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:615.out 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:616 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:616.out 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:617 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:617.out 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:618 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:618.out 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:619 2023-09-30T16:51:39.792 INFO:teuthology.orchestra.run.smithi052.stdout:619.out 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:620 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:620.out 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:621 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:621.out 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:622 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:622.out 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:623 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:623.out 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:624 2023-09-30T16:51:39.793 INFO:teuthology.orchestra.run.smithi052.stdout:624.out 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:625 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:625.out 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:626 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:626.out 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:627 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:627.out 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:628 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:628.out 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:629 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:629.out 2023-09-30T16:51:39.794 INFO:teuthology.orchestra.run.smithi052.stdout:630 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:630.out 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:631 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:631.out 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:632 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:632.out 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:633 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:633.out 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:634 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:634.out 2023-09-30T16:51:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:635 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:635.out 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:636 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:636.out 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:637 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:637.out 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:638 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:638.out 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:639 2023-09-30T16:51:39.796 INFO:teuthology.orchestra.run.smithi052.stdout:639.out 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:640 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:640.out 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:641 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:641.out 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:642 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:642.out 2023-09-30T16:51:39.797 INFO:teuthology.orchestra.run.smithi052.stdout:643 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:643.out 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:644 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:644.out 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:645 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:645.out 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:646 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:646.out 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:647 2023-09-30T16:51:39.798 INFO:teuthology.orchestra.run.smithi052.stdout:647.out 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:648 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:648.out 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:649 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:649.out 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:650 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:650.out 2023-09-30T16:51:39.799 INFO:teuthology.orchestra.run.smithi052.stdout:651 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:651.out 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:652 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:652.out 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:653 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:653.out 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:654 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:654.out 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:655 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:655.out 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:656 2023-09-30T16:51:39.800 INFO:teuthology.orchestra.run.smithi052.stdout:656.out 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:657 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:657.out 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:658 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:658.out 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:659 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:659.out 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:660 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:660.out 2023-09-30T16:51:39.801 INFO:teuthology.orchestra.run.smithi052.stdout:661 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:661.out 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:662 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:662.out 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:663 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:663.out 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:664 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:664.out 2023-09-30T16:51:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:665 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:665.out 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:666 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:666.out 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:667 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:667.out 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:668 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:668.out 2023-09-30T16:51:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:669 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:669.out 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:670 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:670.out 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:671 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:671.out 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:672 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:672.out 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:673 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:673.out 2023-09-30T16:51:39.804 INFO:teuthology.orchestra.run.smithi052.stdout:674 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:674.out 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:675 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:675.out 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:676 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:676.out 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:677 2023-09-30T16:51:39.805 INFO:teuthology.orchestra.run.smithi052.stdout:677.out 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:678 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:678.out 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:679 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:679.out 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:680 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:680.out 2023-09-30T16:51:39.806 INFO:teuthology.orchestra.run.smithi052.stdout:681 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:681.out 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:682 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:682.out 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:683 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:683.out 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:684 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:684.out 2023-09-30T16:51:39.807 INFO:teuthology.orchestra.run.smithi052.stdout:685 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:685.out 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:686 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:686.out 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:687 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:687.out 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:688 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:688.out 2023-09-30T16:51:39.808 INFO:teuthology.orchestra.run.smithi052.stdout:689 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:689.out 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:690 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:690.out 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:691 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:691.out 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:692 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:692.out 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:693 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:693.out 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:694 2023-09-30T16:51:39.809 INFO:teuthology.orchestra.run.smithi052.stdout:694.out 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:695 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:695.out 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:696 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:696.out 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:697 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:697.out 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:698 2023-09-30T16:51:39.810 INFO:teuthology.orchestra.run.smithi052.stdout:698.out 2023-09-30T16:51:39.811 INFO:teuthology.orchestra.run.smithi052.stdout:699 2023-09-30T16:51:39.811 INFO:teuthology.orchestra.run.smithi052.stdout:699.out 2023-09-30T16:51:39.811 INFO:teuthology.orchestra.run.smithi052.stdout:700 2023-09-30T16:51:39.811 INFO:teuthology.orchestra.run.smithi052.stdout:700.out 2023-09-30T16:51:39.811 INFO:teuthology.orchestra.run.smithi052.stdout:701 2023-09-30T16:51:39.811 INFO:teuthology.orchestra.run.smithi052.stdout:701.out 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:702 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:702.out 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:703 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:703.out 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:704 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:704.out 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:705 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:705.out 2023-09-30T16:51:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:706 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:706.out 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:707 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:707.out 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:708 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:708.out 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:709 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:709.out 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:710 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:710.out 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:711 2023-09-30T16:51:39.813 INFO:teuthology.orchestra.run.smithi052.stdout:711.out 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:712 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:712.out 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:713 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:713.out 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:714 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:714.out 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:715 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:715.out 2023-09-30T16:51:39.814 INFO:teuthology.orchestra.run.smithi052.stdout:716 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:716.out 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:717 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:717.out 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:718 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:718.out 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:719 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:719.out 2023-09-30T16:51:39.815 INFO:teuthology.orchestra.run.smithi052.stdout:720 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:720.out 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:721 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:721.out 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:722 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:722.out 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:723 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:723.out 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:724 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:724.out 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:725 2023-09-30T16:51:39.816 INFO:teuthology.orchestra.run.smithi052.stdout:725.out 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:726 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:726.out 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:727 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:727.out 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:728 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:728.out 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:729 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:729.out 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:730 2023-09-30T16:51:39.817 INFO:teuthology.orchestra.run.smithi052.stdout:730.out 2023-09-30T16:51:39.818 INFO:teuthology.orchestra.run.smithi052.stdout:731 2023-09-30T16:51:39.818 INFO:teuthology.orchestra.run.smithi052.stdout:731.out 2023-09-30T16:51:39.818 INFO:teuthology.orchestra.run.smithi052.stdout:group.list 2023-09-30T16:51:39.818 INFO:teuthology.orchestra.run.smithi052.stdout:Makefile 2023-09-30T16:51:39.819 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-09-30T16:51:40.066 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:51:40.073 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:51:40.073 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:42.551 INFO:teuthology.orchestra.run.smithi052.stdout:generic/001 2s 2023-09-30T16:51:42.558 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/001 2023-09-30T16:51:42.559 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:51:42.562 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:42.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[47157]: fuse finished with error 0 and tester_r 0 2023-09-30T16:51:42.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:51:42.573 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-09-30T16:51:42.797 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:51:42.801 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:51:42.802 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:43.519 INFO:teuthology.orchestra.run.smithi052.stdout:generic/002 1s 2023-09-30T16:51:43.526 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/002 2023-09-30T16:51:43.526 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:51:43.529 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:43.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:51:43.539 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-09-30T16:51:43.763 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:51:43.767 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:51:43.767 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:43.866 INFO:teuthology.orchestra.run.smithi052.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T16:51:43.869 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/003 2023-09-30T16:51:43.869 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/003 2023-09-30T16:51:43.869 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:51:43.871 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:43.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:51:43.880 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-09-30T16:51:44.052 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:51:44.056 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:51:44.056 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:44.165 INFO:teuthology.orchestra.run.smithi052.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-09-30T16:51:44.169 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/004 2023-09-30T16:51:44.169 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/004 2023-09-30T16:51:44.169 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:51:44.171 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:44.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:51:44.179 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-09-30T16:51:44.355 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:51:44.359 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:51:44.359 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:45.140 INFO:teuthology.orchestra.run.smithi052.stdout:generic/005 1s 2023-09-30T16:51:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/005 2023-09-30T16:51:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:51:45.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:45.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:51:45.160 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-09-30T16:51:45.411 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:51:45.415 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:51:45.416 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:51:48.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:51:48.411 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:52:18.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:52:18.482 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:52:48.552 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:52:48.556 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:52:59.049 INFO:teuthology.orchestra.run.smithi052.stdout:generic/006 74s 2023-09-30T16:52:59.057 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/006 2023-09-30T16:52:59.057 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:52:59.061 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:52:59.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:52:59.074 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-09-30T16:52:59.317 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:52:59.322 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:52:59.322 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:53:18.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:53:18.602 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:53:48.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:53:48.651 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:54:18.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:54:18.749 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:54:48.852 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:54:48.855 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:55:19.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:55:19.353 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:55:43.268 INFO:teuthology.orchestra.run.smithi052.stdout:generic/007 164s 2023-09-30T16:55:43.275 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/007 2023-09-30T16:55:43.275 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:55:43.279 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:43.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:55:43.292 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-09-30T16:55:43.560 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:55:43.564 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:55:43.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:45.361 INFO:teuthology.orchestra.run.smithi052.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-30T16:55:45.368 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/008 2023-09-30T16:55:45.368 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/008 2023-09-30T16:55:45.368 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:55:45.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:45.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:55:45.385 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-09-30T16:55:45.619 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:55:45.624 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:55:45.624 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:47.235 INFO:teuthology.orchestra.run.smithi052.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-30T16:55:47.241 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/009 2023-09-30T16:55:47.241 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/009 2023-09-30T16:55:47.241 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:55:47.245 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:47.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:55:47.258 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-09-30T16:55:47.453 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:55:47.458 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:55:47.458 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:47.587 INFO:teuthology.orchestra.run.smithi052.stdout:generic/010 [not run] /tmp/tmp.qvcny3LNTMxfstests-dev/src/dbtest not built 2023-09-30T16:55:47.592 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/010 2023-09-30T16:55:47.592 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/010 2023-09-30T16:55:47.592 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:55:47.595 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:47.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:55:47.605 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-09-30T16:55:47.819 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:55:47.823 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:55:47.823 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:55:49.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:55:49.434 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:56:19.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:56:19.489 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:56:49.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:56:49.530 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:56:52.889 INFO:teuthology.orchestra.run.smithi052.stdout:generic/011 65s 2023-09-30T16:56:52.897 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/011 2023-09-30T16:56:52.897 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:56:52.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:56:52.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:56:52.913 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-09-30T16:56:53.144 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:56:53.148 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:56:53.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:56:54.532 INFO:teuthology.orchestra.run.smithi052.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T16:56:54.536 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/012 2023-09-30T16:56:54.536 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/012 2023-09-30T16:56:54.537 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:56:54.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:56:54.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:56:54.550 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-09-30T16:56:54.806 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:56:54.811 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:56:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:57:19.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:57:19.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:57:49.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:57:49.881 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:58:19.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:58:19.998 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:58:38.298 INFO:teuthology.orchestra.run.smithi052.stdout:generic/013 104s 2023-09-30T16:58:38.348 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/013 2023-09-30T16:58:38.348 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T16:58:38.351 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:58:38.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T16:58:38.366 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-09-30T16:58:38.631 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T16:58:38.638 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T16:58:38.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T16:58:50.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:58:50.117 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T16:58:50.153 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T16:58:50.153+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44046) UID: 0 2023-09-30T16:58:50.154 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T16:58:50.157+0000 7f6d9b131640 -1 Fail to open '/proc/44046/cmdline' error = (2) No such file or directory 2023-09-30T16:58:50.154 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T16:58:50.157+0000 7f6d9b131640 -1 received signal: Hangup from (PID: 44046) UID: 0 2023-09-30T17:02:33.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:02:33.693 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:03:03.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:03:03.767 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:03:34.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:03:34.150 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:03:58.631 INFO:teuthology.orchestra.run.smithi052.stdout:generic/014 320s 2023-09-30T17:03:58.641 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/014 2023-09-30T17:03:58.641 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:03:58.643 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:03:58.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:03:58.666 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-09-30T17:03:58.946 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:03:58.950 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:03:58.950 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:03:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:03:59.101 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/015 2023-09-30T17:03:59.101 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/015 2023-09-30T17:03:59.101 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:03:59.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:03:59.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:03:59.116 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-09-30T17:03:59.426 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:03:59.430 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:03:59.431 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:00.864 INFO:teuthology.orchestra.run.smithi052.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:04:00.869 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/016 2023-09-30T17:04:00.869 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/016 2023-09-30T17:04:00.869 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:00.876 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:00.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:00.893 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi052.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/017 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/017 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:01.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:01.640 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-09-30T17:04:01.910 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:01.916 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:01.916 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:02.077 INFO:teuthology.orchestra.run.smithi052.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:02.082 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/018 2023-09-30T17:04:02.082 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/018 2023-09-30T17:04:02.082 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:02.084 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:02.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:02.095 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-09-30T17:04:02.385 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:02.390 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:02.390 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi052.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/019 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/019 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:02.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:02.542 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-09-30T17:04:02.845 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:02.850 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:02.850 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:04.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:04:04.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:04:14.615 INFO:teuthology.orchestra.run.smithi052.stdout:generic/020 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/020.out.bad) 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/020.out 2023-09-30 16:50:24.670064556 +0000 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/020.out.bad 2023-09-30 17:04:14.613419852 +0000 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -47,9 +47,13 @@ 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: user.snrub="fish2\012" 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: *** really long value 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: -0000000 00 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: -* 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: -ATTRSIZE 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: +attr_set: No space left on device 2023-09-30T17:04:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: +Could not set "long_attr" for 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: +attr_get: No data available 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: +Could not get "long_attr" for 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: +0000000 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: +attr_remove: No data available 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: +Could not remove "long_attr" for 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: *** set/get/remove really long names (expect failure) 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: attr_set: Invalid argument 2023-09-30T17:04:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-09-30T17:04:14.619 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/020 2023-09-30T17:04:14.619 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/020 2023-09-30T17:04:14.619 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T17:04:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:14.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:04:14.638 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T17:04:14.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T17:04:14.639 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-09-30T17:04:15.173 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:15.177 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:15.178 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi052.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/021 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/021 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:16.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:16.645 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-09-30T17:04:17.216 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:17.221 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:17.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:18.707 INFO:teuthology.orchestra.run.smithi052.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:04:18.712 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/022 2023-09-30T17:04:18.712 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/022 2023-09-30T17:04:18.712 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:18.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:18.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:18.725 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-09-30T17:04:19.235 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:19.240 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:19.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:21.142 INFO:teuthology.orchestra.run.smithi052.stdout:generic/023 2s 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/023 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:21.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:21.314 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi052.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/024 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/024 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:21.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:21.970 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-09-30T17:04:22.528 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:22.532 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:22.764 INFO:teuthology.orchestra.run.smithi052.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-09-30T17:04:22.772 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/025 2023-09-30T17:04:22.779 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/025 2023-09-30T17:04:22.779 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:22.780 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:22.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:22.786 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-09-30T17:04:23.362 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:23.369 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:23.401 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:23.565 INFO:teuthology.orchestra.run.smithi052.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T17:04:23.569 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/026 2023-09-30T17:04:23.569 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/026 2023-09-30T17:04:23.569 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:23.571 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:23.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:23.587 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-09-30T17:04:23.869 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:23.875 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:23.875 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:24.028 INFO:teuthology.orchestra.run.smithi052.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/027 2023-09-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/027 2023-09-30T17:04:24.031 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:24.043 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:24.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:24.066 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-09-30T17:04:24.325 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:24.333 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:24.333 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:29.534 INFO:teuthology.orchestra.run.smithi052.stdout:generic/028 5s 2023-09-30T17:04:29.585 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/028 2023-09-30T17:04:29.585 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:29.588 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:29.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:29.641 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-09-30T17:04:29.937 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:29.954 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:29.954 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:30.115 INFO:teuthology.orchestra.run.smithi052.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:30.119 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/029 2023-09-30T17:04:30.119 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/029 2023-09-30T17:04:30.119 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:30.121 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:30.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:30.134 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-09-30T17:04:30.401 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:30.406 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:30.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:30.549 INFO:teuthology.orchestra.run.smithi052.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:30.553 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/030 2023-09-30T17:04:30.553 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/030 2023-09-30T17:04:30.553 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:30.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:30.565 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-09-30T17:04:30.849 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:30.854 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:30.855 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:31.012 INFO:teuthology.orchestra.run.smithi052.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:31.016 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/031 2023-09-30T17:04:31.016 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/031 2023-09-30T17:04:31.017 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:31.019 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:31.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:31.031 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-09-30T17:04:31.326 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:31.330 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:31.330 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:31.468 INFO:teuthology.orchestra.run.smithi052.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:31.472 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/032 2023-09-30T17:04:31.472 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/032 2023-09-30T17:04:31.472 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:31.475 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:31.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:31.486 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-09-30T17:04:31.714 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:31.719 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:31.874 INFO:teuthology.orchestra.run.smithi052.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:31.878 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/033 2023-09-30T17:04:31.878 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/033 2023-09-30T17:04:31.878 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:31.880 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:31.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:31.902 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi052.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:32.361 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/034 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/034 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:32.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:32.385 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-09-30T17:04:32.667 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:32.938 INFO:teuthology.orchestra.run.smithi052.stdout:generic/035 0s 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/035 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:32.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:32.975 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:33.529 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:34.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:04:34.322 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:04:43.971 INFO:teuthology.orchestra.run.smithi052.stdout:generic/036 10s 2023-09-30T17:04:43.980 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/036 2023-09-30T17:04:43.980 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:43.982 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:43.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:43.993 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-09-30T17:04:44.493 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:44.498 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:44.662 INFO:teuthology.orchestra.run.smithi052.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:44.667 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/037 2023-09-30T17:04:44.668 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/037 2023-09-30T17:04:44.668 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:44.674 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:44.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:44.698 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-09-30T17:04:44.977 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:45.120 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:45.120 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:45.134 INFO:teuthology.orchestra.run.smithi052.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:45.138 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/038 2023-09-30T17:04:45.138 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/038 2023-09-30T17:04:45.139 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:45.141 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:45.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:45.151 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:45.620 INFO:teuthology.orchestra.run.smithi052.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:45.625 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/039 2023-09-30T17:04:45.625 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/039 2023-09-30T17:04:45.625 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:45.627 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:45.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:45.643 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-09-30T17:04:45.921 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:45.926 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi052.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/040 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/040 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:46.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:46.138 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-09-30T17:04:46.388 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:46.393 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:46.393 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:46.569 INFO:teuthology.orchestra.run.smithi052.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:46.573 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/041 2023-09-30T17:04:46.573 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/041 2023-09-30T17:04:46.573 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:46.580 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:46.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:46.590 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-09-30T17:04:46.850 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:46.947 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:46.948 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:47.026 INFO:teuthology.orchestra.run.smithi052.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:47.031 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/042 2023-09-30T17:04:47.031 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/042 2023-09-30T17:04:47.031 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:47.034 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:47.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:47.047 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-09-30T17:04:47.327 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:47.332 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:47.332 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:47.489 INFO:teuthology.orchestra.run.smithi052.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:47.497 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/043 2023-09-30T17:04:47.498 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/043 2023-09-30T17:04:47.498 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:47.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:47.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:47.521 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-09-30T17:04:47.768 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:47.772 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:47.772 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:47.945 INFO:teuthology.orchestra.run.smithi052.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:47.950 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/044 2023-09-30T17:04:47.950 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/044 2023-09-30T17:04:47.950 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:47.952 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:47.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:47.963 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-09-30T17:04:48.245 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:48.249 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:48.249 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:48.410 INFO:teuthology.orchestra.run.smithi052.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:48.414 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/045 2023-09-30T17:04:48.415 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/045 2023-09-30T17:04:48.415 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:48.418 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:48.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:48.429 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-09-30T17:04:48.656 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:48.663 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:48.663 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:48.844 INFO:teuthology.orchestra.run.smithi052.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:48.847 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/046 2023-09-30T17:04:48.847 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/046 2023-09-30T17:04:48.848 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:48.850 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:48.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:48.861 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-09-30T17:04:49.122 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:49.130 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:49.130 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:49.271 INFO:teuthology.orchestra.run.smithi052.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:49.277 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/047 2023-09-30T17:04:49.278 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/047 2023-09-30T17:04:49.278 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:49.282 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:49.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:49.294 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-09-30T17:04:49.573 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:49.578 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:49.579 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:49.723 INFO:teuthology.orchestra.run.smithi052.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:49.728 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/048 2023-09-30T17:04:49.728 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/048 2023-09-30T17:04:49.729 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:49.730 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:49.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:49.748 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-09-30T17:04:50.066 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:50.071 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:50.071 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:50.214 INFO:teuthology.orchestra.run.smithi052.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:50.222 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/049 2023-09-30T17:04:50.223 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/049 2023-09-30T17:04:50.223 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:50.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:50.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:50.240 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-09-30T17:04:50.560 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:50.565 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:50.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:50.745 INFO:teuthology.orchestra.run.smithi052.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:50.748 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/050 2023-09-30T17:04:50.749 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/050 2023-09-30T17:04:50.749 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:50.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:50.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:50.772 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-09-30T17:04:51.040 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:51.045 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:51.045 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:51.191 INFO:teuthology.orchestra.run.smithi052.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:51.200 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/051 2023-09-30T17:04:51.200 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/051 2023-09-30T17:04:51.200 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:51.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:51.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:51.213 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-09-30T17:04:51.494 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:51.498 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:51.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:51.658 INFO:teuthology.orchestra.run.smithi052.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:51.662 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/052 2023-09-30T17:04:51.662 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/052 2023-09-30T17:04:51.662 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:51.664 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:51.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:51.675 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-09-30T17:04:51.959 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:51.964 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:51.964 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:52.117 INFO:teuthology.orchestra.run.smithi052.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:52.122 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/053 2023-09-30T17:04:52.122 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/053 2023-09-30T17:04:52.122 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:52.124 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:52.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:52.140 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-09-30T17:04:52.408 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:52.413 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:52.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:52.569 INFO:teuthology.orchestra.run.smithi052.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:52.572 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/054 2023-09-30T17:04:52.572 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/054 2023-09-30T17:04:52.572 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:52.575 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:52.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:52.591 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-09-30T17:04:52.845 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:52.853 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:52.853 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:53.004 INFO:teuthology.orchestra.run.smithi052.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:53.010 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/055 2023-09-30T17:04:53.010 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/055 2023-09-30T17:04:53.010 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:53.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:53.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:53.034 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-09-30T17:04:53.270 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:53.274 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:53.275 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:53.448 INFO:teuthology.orchestra.run.smithi052.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:53.452 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/056 2023-09-30T17:04:53.452 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/056 2023-09-30T17:04:53.452 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:53.455 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:53.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:53.475 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-09-30T17:04:53.748 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:53.752 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:53.752 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:53.914 INFO:teuthology.orchestra.run.smithi052.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:53.918 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/057 2023-09-30T17:04:53.918 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/057 2023-09-30T17:04:53.918 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:53.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:53.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:53.932 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-09-30T17:04:54.232 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:54.236 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:54.236 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:55.609 INFO:teuthology.orchestra.run.smithi052.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:04:55.617 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/058 2023-09-30T17:04:55.618 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/058 2023-09-30T17:04:55.618 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:55.626 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:55.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:55.641 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-09-30T17:04:56.217 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:56.221 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:56.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:56.394 INFO:teuthology.orchestra.run.smithi052.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:04:56.398 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/059 2023-09-30T17:04:56.398 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/059 2023-09-30T17:04:56.398 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:56.401 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:56.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:56.412 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-09-30T17:04:56.685 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:56.690 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:56.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:58.091 INFO:teuthology.orchestra.run.smithi052.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:04:58.095 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/060 2023-09-30T17:04:58.096 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/060 2023-09-30T17:04:58.096 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:04:58.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:04:58.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:04:58.108 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-09-30T17:04:58.632 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:04:58.642 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:04:58.642 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:00.091 INFO:teuthology.orchestra.run.smithi052.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:05:00.095 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/061 2023-09-30T17:05:00.095 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/061 2023-09-30T17:05:00.096 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:00.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:00.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:00.203 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-09-30T17:05:00.648 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:00.650 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:00.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:00.807 INFO:teuthology.orchestra.run.smithi052.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:00.813 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/062 2023-09-30T17:05:00.813 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/062 2023-09-30T17:05:00.813 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:00.815 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:00.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:00.833 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-09-30T17:05:01.121 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:01.125 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:02.549 INFO:teuthology.orchestra.run.smithi052.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T17:05:02.553 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/063 2023-09-30T17:05:02.553 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/063 2023-09-30T17:05:02.554 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:02.556 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:02.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:02.576 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-09-30T17:05:03.127 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:03.137 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:03.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:03.300 INFO:teuthology.orchestra.run.smithi052.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:03.304 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/064 2023-09-30T17:05:03.304 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/064 2023-09-30T17:05:03.304 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:03.306 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:03.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:03.319 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-09-30T17:05:03.606 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:03.611 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:03.611 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:03.786 INFO:teuthology.orchestra.run.smithi052.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:03.790 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/065 2023-09-30T17:05:03.790 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/065 2023-09-30T17:05:03.790 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:03.793 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:03.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:03.803 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-09-30T17:05:04.069 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:04.074 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:04.074 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:04.234 INFO:teuthology.orchestra.run.smithi052.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:04.241 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/066 2023-09-30T17:05:04.241 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/066 2023-09-30T17:05:04.241 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:04.243 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:04.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:04.253 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-09-30T17:05:04.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:05:04.848 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:04.848 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:05.331 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:05.491 INFO:teuthology.orchestra.run.smithi052.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:05.491 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/067 2023-09-30T17:05:05.491 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/067 2023-09-30T17:05:05.491 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:05.492 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:05.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:05.492 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-09-30T17:05:05.493 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:05:05.760 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:05.765 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:05.765 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:05.926 INFO:teuthology.orchestra.run.smithi052.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:05.931 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/068 2023-09-30T17:05:05.931 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/068 2023-09-30T17:05:05.931 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:05.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:05.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:05.948 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-09-30T17:05:06.227 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:06.232 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:06.232 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:06.386 INFO:teuthology.orchestra.run.smithi052.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:05:06.389 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/069 2023-09-30T17:05:06.390 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/069 2023-09-30T17:05:06.390 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:05:06.392 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:06.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:05:06.401 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-09-30T17:05:06.666 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:05:06.671 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:05:06.671 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:05:35.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:05:35.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:06:05.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:06:05.826 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:06:35.891 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:06:35.916 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:07:05.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:07:06.029 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:07:12.465 INFO:teuthology.orchestra.run.smithi052.stdout:generic/070 126s 2023-09-30T17:07:12.476 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/070 2023-09-30T17:07:12.513 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:07:12.514 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:12.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:07:12.515 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-09-30T17:07:13.024 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:07:13.028 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:07:13.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:07:13.168 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/071 2023-09-30T17:07:13.168 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/071 2023-09-30T17:07:13.169 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:07:13.175 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:13.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:07:13.190 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-09-30T17:07:13.450 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:07:13.454 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:07:13.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:14.946 INFO:teuthology.orchestra.run.smithi052.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-30T17:07:14.950 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/072 2023-09-30T17:07:14.951 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/072 2023-09-30T17:07:14.951 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:07:14.953 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:14.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:07:14.969 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-09-30T17:07:15.237 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:07:15.242 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:07:15.242 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:15.410 INFO:teuthology.orchestra.run.smithi052.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:07:15.414 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/073 2023-09-30T17:07:15.414 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/073 2023-09-30T17:07:15.414 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:07:15.416 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:15.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:07:15.433 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-09-30T17:07:15.714 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:07:15.719 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:07:15.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:07:36.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:07:36.077 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:08:06.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:08:06.245 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:08:36.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:08:36.310 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:09:06.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:09:06.416 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:09:36.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:09:36.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:10:06.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:10:06.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:10:36.650 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:10:36.776 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:11:09.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:11:09.362 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:11:40.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:11:40.536 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:12:10.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:12:10.582 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:12:40.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:12:40.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:13:10.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:13:10.747 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:13:41.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:13:41.003 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:14:11.058 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:14:11.060 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:14:41.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:14:41.108 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:15:11.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:15:11.559 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:15:41.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:15:41.615 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:16:11.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:16:11.769 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:16:41.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:16:41.853 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:17:12.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:17:12.765 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:17:42.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:17:42.888 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:18:13.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:18:13.019 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:18:43.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:18:43.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:19:13.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:19:13.405 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:19:43.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:19:43.713 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:20:13.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:20:13.769 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:20:43.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:20:43.825 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:21:13.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:21:13.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:21:44.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:21:44.012 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:22:14.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:22:14.053 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:22:44.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:22:44.166 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:23:14.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:23:14.414 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:23:44.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:23:44.467 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:24:14.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:24:14.560 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:24:44.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:24:44.624 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:25:14.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:25:14.737 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:25:45.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:25:45.136 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:26:15.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:26:15.192 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:26:45.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:26:45.340 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:27:15.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:27:15.382 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:27:45.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:27:45.432 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:28:15.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:28:15.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:28:46.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:28:46.029 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:29:16.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:29:16.089 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:29:46.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:29:46.202 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:30:16.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:30:16.489 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:30:46.562 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:30:46.564 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:31:16.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:31:16.829 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:31:47.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:31:47.027 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:32:17.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:32:17.076 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:32:47.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:32:47.123 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:33:17.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:33:17.592 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:33:47.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:33:47.639 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:34:17.977 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:34:17.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:34:48.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:34:48.022 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:35:18.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:35:18.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:35:18.206 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T17:35:18.205+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117768) UID: 0 2023-09-30T17:35:18.207 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T17:35:18.205+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117768) UID: 0 2023-09-30T17:35:18.207 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T17:35:18.205+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117768) UID: 0 2023-09-30T17:35:18.207 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T17:35:18.205+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117768) UID: 0 2023-09-30T17:39:02.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:39:02.880 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:39:02.899 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T17:39:02.895+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-09-30T17:39:02.900 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T17:39:02.895+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-09-30T17:39:02.900 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T17:39:02.895+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-09-30T17:39:02.900 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T17:39:02.895+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-09-30T17:39:02.917 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T17:39:02.916+0000 7f3c0f7b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44674) UID: 0 2023-09-30T17:39:02.917 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T17:39:02.916+0000 7f254dda9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44674) UID: 0 2023-09-30T17:39:02.918 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T17:39:02.916+0000 7fd82f759640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44674) UID: 0 2023-09-30T17:39:02.918 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T17:39:02.916+0000 7f4ae803a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44674) UID: 0 2023-09-30T17:39:38.686 INFO:teuthology.orchestra.run.smithi052.stdout:generic/074 1943s 2023-09-30T17:39:39.155 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/074 2023-09-30T17:39:39.155 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:39:39.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:39:39.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:39:39.176 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-09-30T17:39:40.521 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:39:40.527 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:39:40.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:50.911 INFO:teuthology.orchestra.run.smithi052.stdout:generic/075 70s 2023-09-30T17:40:50.917 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/075 2023-09-30T17:40:50.917 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:50.920 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:50.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:50.930 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-09-30T17:40:51.463 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:51.467 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:51.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:51.592 INFO:teuthology.orchestra.run.smithi052.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:51.596 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/076 2023-09-30T17:40:51.596 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/076 2023-09-30T17:40:51.596 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:51.598 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:51.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:51.607 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-09-30T17:40:51.795 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:51.799 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:51.799 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:54.420 INFO:teuthology.orchestra.run.smithi052.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:54.425 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/077 2023-09-30T17:40:54.425 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/077 2023-09-30T17:40:54.425 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:54.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:54.439 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-09-30T17:40:54.633 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:54.637 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:54.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:54.790 INFO:teuthology.orchestra.run.smithi052.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-09-30T17:40:54.794 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/078 2023-09-30T17:40:54.794 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/078 2023-09-30T17:40:54.794 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:54.796 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:54.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:54.805 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-09-30T17:40:55.331 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:55.335 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:55.336 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:55.556 INFO:teuthology.orchestra.run.smithi052.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-09-30T17:40:55.560 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/079 2023-09-30T17:40:55.560 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/079 2023-09-30T17:40:55.560 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:55.563 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:55.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:55.574 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-09-30T17:40:55.755 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:55.759 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:55.759 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:57.969 INFO:teuthology.orchestra.run.smithi052.stdout:generic/080 2s 2023-09-30T17:40:57.978 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/080 2023-09-30T17:40:57.978 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:57.981 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:57.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:57.991 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-09-30T17:40:58.191 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:58.195 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:58.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:58.365 INFO:teuthology.orchestra.run.smithi052.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:58.369 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/081 2023-09-30T17:40:58.369 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/081 2023-09-30T17:40:58.369 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:58.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:58.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:58.381 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-09-30T17:40:58.568 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:58.572 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:58.573 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:58.698 INFO:teuthology.orchestra.run.smithi052.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:58.701 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/082 2023-09-30T17:40:58.702 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/082 2023-09-30T17:40:58.702 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:58.704 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:58.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:58.712 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-09-30T17:40:58.892 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:58.896 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:58.896 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:59.043 INFO:teuthology.orchestra.run.smithi052.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:59.047 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/083 2023-09-30T17:40:59.047 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/083 2023-09-30T17:40:59.047 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:59.049 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:59.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:59.057 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-09-30T17:40:59.219 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:59.223 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:59.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:59.357 INFO:teuthology.orchestra.run.smithi052.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:59.361 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/084 2023-09-30T17:40:59.361 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/084 2023-09-30T17:40:59.361 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:59.363 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:59.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:59.371 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-09-30T17:40:59.553 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:59.556 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:59.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:59.708 INFO:teuthology.orchestra.run.smithi052.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T17:40:59.712 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/085 2023-09-30T17:40:59.712 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/085 2023-09-30T17:40:59.712 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:40:59.715 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:40:59.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:40:59.723 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-09-30T17:40:59.915 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:40:59.919 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:40:59.919 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:05.614 INFO:teuthology.orchestra.run.smithi052.stdout:generic/086 6s 2023-09-30T17:41:06.045 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/086 2023-09-30T17:41:06.045 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:41:06.050 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:06.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:41:06.140 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-09-30T17:41:08.875 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:41:08.880 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:41:08.880 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:09.498 INFO:teuthology.orchestra.run.smithi052.stdout:generic/087 1s 2023-09-30T17:41:09.503 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/087 2023-09-30T17:41:09.504 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:41:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:09.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:41:09.515 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-09-30T17:41:10.102 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:41:10.106 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:41:10.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:10.360 INFO:teuthology.orchestra.run.smithi052.stdout:generic/088 0s 2023-09-30T17:41:10.366 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/088 2023-09-30T17:41:10.366 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T17:41:10.368 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:10.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T17:41:10.379 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-09-30T17:41:10.915 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T17:41:10.919 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T17:41:10.919 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T17:41:57.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:41:57.960 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:42:28.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:42:28.033 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:42:58.082 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:42:58.085 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:43:28.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:43:28.209 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:43:58.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:43:58.293 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:44:28.652 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:44:28.658 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:44:58.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:44:58.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:45:28.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:45:28.860 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:45:58.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:45:58.982 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:46:29.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:46:29.278 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:46:59.318 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:46:59.321 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:46:59.340 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T17:46:59.340+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44715) UID: 0 2023-09-30T17:46:59.341 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T17:46:59.340+0000 7f6d9b131640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44715) UID: 0 2023-09-30T17:49:42.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:49:42.602 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:50:12.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:50:12.741 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:50:42.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:50:42.864 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:51:13.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:51:13.217 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:51:43.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:51:43.268 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:52:13.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:52:13.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:52:43.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:52:43.597 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:53:13.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:53:13.694 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:53:43.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:53:43.800 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:53:43.845 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T17:53:43.845+0000 7f6d9b131640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44749) UID: 0 2023-09-30T17:53:43.847 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T17:53:43.845+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44749) UID: 0 2023-09-30T17:55:43.485 INFO:teuthology.orchestra.run.smithi186.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2023-09-30T17:55:43.485 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: stdin: file size changed while zipping 2023-09-30T17:56:15.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:56:15.778 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:56:46.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:56:46.079 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:57:16.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:57:16.122 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:57:46.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:57:46.213 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:58:16.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:58:16.335 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:58:46.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:58:46.441 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:59:16.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:59:16.489 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:59:46.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T17:59:46.854 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:00:16.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:00:16.893 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:00:46.962 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:00:46.965 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:00:46.983 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T18:00:46.982+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44789) UID: 0 2023-09-30T18:00:46.983 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T18:00:46.982+0000 7f6d9b131640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44789) UID: 0 2023-09-30T18:03:20.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:03:20.342 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:03:50.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:03:50.387 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:03:50.407 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T18:03:50.402+0000 7f254dda9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44800) UID: 0 2023-09-30T18:03:50.407 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T18:03:50.402+0000 7f3c0f7b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44800) UID: 0 2023-09-30T18:03:50.407 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T18:03:50.402+0000 7f4ae803a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44800) UID: 0 2023-09-30T18:03:50.407 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T18:03:50.402+0000 7fd82f759640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44800) UID: 0 2023-09-30T18:06:50.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:06:50.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:07:20.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:07:20.229 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:07:50.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:07:50.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:07:50.506 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T18:07:50.506+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44818) UID: 0 2023-09-30T18:07:50.507 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T18:07:50.506+0000 7f6d9b131640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44818) UID: 0 2023-09-30T18:10:25.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:10:25.466 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:10:55.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:10:55.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:11:25.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:11:25.806 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:11:55.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:11:55.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:12:26.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:12:26.040 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:12:35.538 INFO:teuthology.orchestra.run.smithi052.stdout:generic/089 1885s 2023-09-30T18:12:35.545 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/089 2023-09-30T18:12:35.546 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:12:35.549 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:12:35.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:12:35.594 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-09-30T18:12:36.130 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:12:36.134 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:12:36.134 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:12:36.310 INFO:teuthology.orchestra.run.smithi052.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:12:36.314 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/090 2023-09-30T18:12:36.314 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/090 2023-09-30T18:12:36.314 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:12:36.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:12:36.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:12:36.324 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-09-30T18:12:36.509 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:12:36.513 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:12:36.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:12:56.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:12:56.274 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:13:26.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:13:26.323 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:13:56.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:13:56.367 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:14:26.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:14:26.523 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:14:56.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:14:56.577 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:15:26.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:15:26.618 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:15:56.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:15:56.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:16:26.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:16:26.780 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:16:56.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:16:56.853 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:17:26.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:17:26.951 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:17:37.716 INFO:teuthology.orchestra.run.smithi052.stdout:generic/091 301s 2023-09-30T18:17:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/091 2023-09-30T18:17:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:37.728 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:37.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:37.741 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-09-30T18:17:38.306 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:38.310 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:38.310 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:38.493 INFO:teuthology.orchestra.run.smithi052.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T18:17:38.496 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/092 2023-09-30T18:17:38.497 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/092 2023-09-30T18:17:38.497 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:38.499 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:38.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:38.507 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-09-30T18:17:39.005 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:39.009 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:39.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:39.767 INFO:teuthology.orchestra.run.smithi052.stdout:generic/093 0s 2023-09-30T18:17:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/093 2023-09-30T18:17:39.774 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:39.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:39.786 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-09-30T18:17:40.323 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:40.327 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:40.327 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:40.436 INFO:teuthology.orchestra.run.smithi052.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:17:40.439 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/094 2023-09-30T18:17:40.440 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/094 2023-09-30T18:17:40.440 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:40.442 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:40.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:40.450 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-09-30T18:17:40.630 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:40.634 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:40.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:40.732 INFO:teuthology.orchestra.run.smithi052.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:17:40.735 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/095 2023-09-30T18:17:40.735 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/095 2023-09-30T18:17:40.736 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:40.738 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:40.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:40.745 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-09-30T18:17:40.917 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:40.920 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:40.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:41.096 INFO:teuthology.orchestra.run.smithi052.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:17:41.100 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/096 2023-09-30T18:17:41.100 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/096 2023-09-30T18:17:41.100 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:41.102 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:41.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:41.110 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-09-30T18:17:41.310 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:41.314 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:41.314 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:42.063 INFO:teuthology.orchestra.run.smithi052.stdout:generic/097 1s 2023-09-30T18:17:42.068 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/097 2023-09-30T18:17:42.068 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:42.070 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:42.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:42.078 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-09-30T18:17:42.250 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:42.254 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:42.254 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:42.353 INFO:teuthology.orchestra.run.smithi052.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:17:42.356 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/098 2023-09-30T18:17:42.356 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/098 2023-09-30T18:17:42.356 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:42.359 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:42.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:42.367 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-09-30T18:17:42.549 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:42.553 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:42.554 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T18:17:42.721 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/099 2023-09-30T18:17:42.721 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/099 2023-09-30T18:17:42.721 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:17:42.723 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:42.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:17:42.731 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-09-30T18:17:42.925 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:17:42.929 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:17:42.929 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:17:56.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:17:57.000 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:18:27.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:18:27.048 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:18:27.071 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T18:18:27.067+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146342) UID: 0 2023-09-30T18:18:27.072 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T18:18:27.067+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146342) UID: 0 2023-09-30T18:18:27.072 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T18:18:27.067+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146342) UID: 0 2023-09-30T18:18:27.072 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T18:18:27.067+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146342) UID: 0 2023-09-30T18:18:42.907 INFO:teuthology.orchestra.run.smithi052.stdout:generic/100 60s 2023-09-30T18:18:42.914 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/100 2023-09-30T18:18:42.914 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:42.917 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:42.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:42.967 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-09-30T18:18:43.706 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:43.710 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:43.710 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:43.824 INFO:teuthology.orchestra.run.smithi052.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:43.827 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/101 2023-09-30T18:18:43.827 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/101 2023-09-30T18:18:43.828 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:43.830 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:43.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:43.837 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-09-30T18:18:44.022 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:44.026 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:44.026 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:44.168 INFO:teuthology.orchestra.run.smithi052.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:44.172 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/102 2023-09-30T18:18:44.172 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/102 2023-09-30T18:18:44.172 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:44.174 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:44.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:44.182 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-09-30T18:18:44.377 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:44.381 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:44.382 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:44.483 INFO:teuthology.orchestra.run.smithi052.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:44.486 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/103 2023-09-30T18:18:44.486 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/103 2023-09-30T18:18:44.486 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:44.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:44.496 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-09-30T18:18:44.686 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:44.689 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:44.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:44.808 INFO:teuthology.orchestra.run.smithi052.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:44.811 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/104 2023-09-30T18:18:44.811 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/104 2023-09-30T18:18:44.811 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:44.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:44.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:44.821 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-09-30T18:18:45.014 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:45.018 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:45.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:45.121 INFO:teuthology.orchestra.run.smithi052.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:45.125 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/105 2023-09-30T18:18:45.125 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/105 2023-09-30T18:18:45.125 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:45.127 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:45.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:45.135 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-09-30T18:18:45.317 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:45.321 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:45.321 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:45.436 INFO:teuthology.orchestra.run.smithi052.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:45.439 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/106 2023-09-30T18:18:45.439 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/106 2023-09-30T18:18:45.439 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:45.442 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:45.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:45.450 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-09-30T18:18:45.634 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:45.638 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:45.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:45.755 INFO:teuthology.orchestra.run.smithi052.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:45.759 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/107 2023-09-30T18:18:45.759 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/107 2023-09-30T18:18:45.759 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:45.761 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:45.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:45.769 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-09-30T18:18:45.961 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:45.965 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:45.965 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:46.409 INFO:teuthology.orchestra.run.smithi052.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:46.415 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/108 2023-09-30T18:18:46.415 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/108 2023-09-30T18:18:46.415 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:46.419 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:46.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:46.430 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-09-30T18:18:46.638 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:46.642 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:46.643 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:46.748 INFO:teuthology.orchestra.run.smithi052.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:18:46.751 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/109 2023-09-30T18:18:46.751 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/109 2023-09-30T18:18:46.751 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:46.754 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:46.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:46.762 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-09-30T18:18:46.958 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:46.962 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:46.962 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:47.297 INFO:teuthology.orchestra.run.smithi052.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T18:18:47.301 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/110 2023-09-30T18:18:47.302 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/110 2023-09-30T18:18:47.302 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:47.304 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:47.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:47.313 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-09-30T18:18:47.857 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:47.861 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:47.861 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:48.061 INFO:teuthology.orchestra.run.smithi052.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T18:18:48.064 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/111 2023-09-30T18:18:48.065 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/111 2023-09-30T18:18:48.065 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:18:48.067 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:18:48.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:18:48.075 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-09-30T18:18:48.608 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:18:48.612 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:18:48.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:20:19.312 INFO:teuthology.orchestra.run.smithi052.stdout:generic/112 91s 2023-09-30T18:20:19.317 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/112 2023-09-30T18:20:19.318 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:20:19.320 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:20:19.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:20:19.330 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-09-30T18:20:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:20:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:20:19.880 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:09.615 INFO:teuthology.orchestra.run.smithi052.stdout:generic/113 50s 2023-09-30T18:21:09.643 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/113 2023-09-30T18:21:09.643 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:09.646 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:09.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:09.659 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-09-30T18:21:10.603 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:10.609 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:10.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:11.308 INFO:teuthology.orchestra.run.smithi052.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-09-30T18:21:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/114 2023-09-30T18:21:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/114 2023-09-30T18:21:11.314 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:11.318 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:11.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:11.331 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-09-30T18:21:11.571 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:11.576 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:11.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:11.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:21:11.683 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:21:12.138 INFO:teuthology.orchestra.run.smithi052.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T18:21:12.143 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/115 2023-09-30T18:21:12.143 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/115 2023-09-30T18:21:12.143 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:12.147 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:12.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:12.158 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-09-30T18:21:12.733 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:12.737 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:12.737 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:12.898 INFO:teuthology.orchestra.run.smithi052.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T18:21:12.901 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/116 2023-09-30T18:21:12.901 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/116 2023-09-30T18:21:12.902 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:12.904 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:12.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:12.912 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-09-30T18:21:13.436 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:13.441 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:13.441 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:13.572 INFO:teuthology.orchestra.run.smithi052.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:21:13.575 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/117 2023-09-30T18:21:13.575 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/117 2023-09-30T18:21:13.576 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:13.578 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:13.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:13.586 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-09-30T18:21:13.761 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:13.765 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:13.765 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:13.932 INFO:teuthology.orchestra.run.smithi052.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T18:21:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/118 2023-09-30T18:21:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/118 2023-09-30T18:21:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:13.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:13.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:13.946 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-09-30T18:21:14.478 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:14.482 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:14.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:14.641 INFO:teuthology.orchestra.run.smithi052.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T18:21:14.645 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/119 2023-09-30T18:21:14.645 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/119 2023-09-30T18:21:14.645 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:14.647 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:14.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:14.655 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-09-30T18:21:15.203 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:15.207 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:15.207 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:15.308 INFO:teuthology.orchestra.run.smithi052.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:21:15.312 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/120 2023-09-30T18:21:15.312 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/120 2023-09-30T18:21:15.312 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:15.314 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:15.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:15.323 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-09-30T18:21:15.497 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:15.501 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:15.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:15.657 INFO:teuthology.orchestra.run.smithi052.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T18:21:15.660 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/121 2023-09-30T18:21:15.661 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/121 2023-09-30T18:21:15.661 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:15.663 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:15.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:15.671 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-09-30T18:21:16.189 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:16.193 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:16.193 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:16.355 INFO:teuthology.orchestra.run.smithi052.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T18:21:16.358 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/122 2023-09-30T18:21:16.358 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/122 2023-09-30T18:21:16.358 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:16.360 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:16.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:16.369 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-09-30T18:21:16.885 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:16.889 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:generic/123 1s 2023-09-30T18:21:17.493 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/123 2023-09-30T18:21:17.493 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:17.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:17.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:17.503 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-09-30T18:21:18.029 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:18.033 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:18.033 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:18.141 INFO:teuthology.orchestra.run.smithi052.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:21:18.145 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/124 2023-09-30T18:21:18.145 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/124 2023-09-30T18:21:18.146 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:21:18.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:18.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:21:18.157 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-09-30T18:21:18.343 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:21:18.346 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:21:18.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:21:42.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:21:42.107 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:22:12.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:22:12.513 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:22:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:generic/125 61s 2023-09-30T18:22:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/125 2023-09-30T18:22:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:22:19.884 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:22:19.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:22:19.897 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-09-30T18:22:20.445 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:22:20.449 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:22:20.449 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:22:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:generic/126 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/126.out.bad) 2023-09-30T18:22:21.200 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/126.out 2023-09-30 16:50:24.678064485 +0000 2023-09-30T18:22:21.200 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/126.out.bad 2023-09-30 18:22:21.192338995 +0000 2023-09-30T18:22:21.200 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,7 +1,7 @@ 2023-09-30T18:22:21.200 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 126 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-09-30T18:22:21.201 INFO:teuthology.orchestra.run.smithi052.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-09-30T18:22:21.203 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/126 2023-09-30T18:22:21.203 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/126 2023-09-30T18:22:21.203 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T18:22:21.205 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:22:21.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T18:22:21.214 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T18:22:21.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T18:22:21.214 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-09-30T18:22:21.718 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:22:21.722 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:22:21.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:22:42.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:22:42.564 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:23:12.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:23:12.696 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:23:42.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:23:42.820 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:24:12.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:24:12.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:24:43.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:24:43.034 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:25:13.077 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:25:13.081 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:25:43.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:25:43.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:26:13.252 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:26:13.255 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:26:43.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:26:43.328 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:27:13.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:27:13.389 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:27:43.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:27:43.458 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:28:13.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:28:13.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:28:43.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:28:43.600 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:29:13.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:29:13.728 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:29:44.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:29:44.027 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:30:14.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:30:14.159 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:30:44.204 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:30:44.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:31:14.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:31:14.286 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:31:44.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:31:44.333 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:32:14.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:32:14.412 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:32:44.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:32:44.614 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:33:14.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:33:14.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:33:44.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:33:44.707 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:34:14.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:34:14.780 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:34:44.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:34:44.902 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:35:14.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:35:14.951 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:35:45.077 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:35:45.081 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:36:15.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:36:15.123 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:36:45.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:36:45.172 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:37:15.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:37:15.241 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:37:45.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:37:45.446 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:38:15.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:38:15.528 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:38:45.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:38:45.651 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:39:15.962 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:39:15.964 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:39:15.986 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T18:39:15.983+0000 7f254dda9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44999) UID: 0 2023-09-30T18:39:15.986 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T18:39:15.983+0000 7f3c0f7b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44999) UID: 0 2023-09-30T18:39:15.987 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T18:39:15.983+0000 7f4ae803a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44999) UID: 0 2023-09-30T18:39:15.987 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T18:39:15.983+0000 7fd82f759640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44999) UID: 0 2023-09-30T18:41:45.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:41:45.575 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:42:15.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:42:15.664 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:42:45.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:42:45.762 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:43:15.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:43:15.884 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:43:45.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:43:45.924 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:44:16.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:44:16.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:44:46.191 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:44:46.194 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:45:16.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:45:16.369 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:45:46.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:45:46.661 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:46:16.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:46:16.707 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:46:46.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:46:46.801 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:47:16.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:47:16.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:47:47.065 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:47:47.068 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:48:17.124 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:48:17.128 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:48:47.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:48:47.182 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:49:17.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:49:17.264 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:49:47.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:49:47.329 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:50:17.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:50:17.427 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:50:47.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:50:47.541 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:51:17.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:51:17.588 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:51:47.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:51:47.630 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:52:17.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:52:17.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:52:47.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:52:47.839 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:53:17.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:53:17.954 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:53:17.977 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T18:53:17.977+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45078) UID: 0 2023-09-30T18:53:17.977 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T18:53:17.977+0000 7f6d9b131640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45078) UID: 0 2023-09-30T18:54:10.176 INFO:teuthology.orchestra.run.smithi052.stdout:generic/127 1909s 2023-09-30T18:54:10.184 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/127 2023-09-30T18:54:10.184 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:54:10.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:10.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:54:10.202 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-09-30T18:54:10.792 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:54:10.797 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:54:10.797 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:10.911 INFO:teuthology.orchestra.run.smithi052.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:54:10.915 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/128 2023-09-30T18:54:10.915 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/128 2023-09-30T18:54:10.915 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:54:10.918 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:10.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:54:10.926 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-09-30T18:54:11.105 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:54:11.109 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:54:11.109 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:11.212 INFO:teuthology.orchestra.run.smithi052.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:54:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/129 2023-09-30T18:54:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/129 2023-09-30T18:54:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:54:11.218 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:11.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:54:11.226 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-09-30T18:54:11.408 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:54:11.412 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:54:11.412 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:11.513 INFO:teuthology.orchestra.run.smithi052.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:54:11.517 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/130 2023-09-30T18:54:11.517 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/130 2023-09-30T18:54:11.517 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:54:11.519 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:11.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:54:11.528 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-09-30T18:54:11.733 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:54:11.737 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:54:11.737 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:13.262 INFO:teuthology.orchestra.run.smithi052.stdout:generic/131 2s 2023-09-30T18:54:13.269 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/131 2023-09-30T18:54:13.269 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:54:13.272 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:13.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:54:13.283 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-09-30T18:54:13.847 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:54:13.851 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:54:13.851 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:13.952 INFO:teuthology.orchestra.run.smithi052.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T18:54:13.955 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/132 2023-09-30T18:54:13.956 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/132 2023-09-30T18:54:13.956 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T18:54:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:54:13.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T18:54:13.967 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-09-30T18:54:14.144 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T18:54:14.149 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T18:54:14.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T18:55:46.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:55:46.920 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:56:16.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:56:16.982 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:56:47.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:56:47.031 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:57:17.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:57:17.163 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:57:47.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:57:47.227 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:58:17.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:58:17.357 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:58:47.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:58:47.407 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:59:17.452 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:59:17.455 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:59:47.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T18:59:47.504 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:00:17.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:00:17.596 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:00:47.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:00:47.892 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:01:17.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:01:17.961 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:01:48.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:01:48.068 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:02:18.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:02:18.341 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:02:48.401 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:02:48.404 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:03:15.206 INFO:teuthology.orchestra.run.smithi052.stdout:generic/133 541s 2023-09-30T19:03:15.214 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/133 2023-09-30T19:03:15.214 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:15.218 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:15.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:15.231 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-09-30T19:03:15.787 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:15.791 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:15.791 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:15.955 INFO:teuthology.orchestra.run.smithi052.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:15.959 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/134 2023-09-30T19:03:15.959 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/134 2023-09-30T19:03:15.959 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:15.961 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:15.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:15.969 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-09-30T19:03:16.582 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:16.593 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:16.593 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:16.818 INFO:teuthology.orchestra.run.smithi052.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:16.823 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/135 2023-09-30T19:03:16.823 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/135 2023-09-30T19:03:16.823 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:16.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:16.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:16.837 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-09-30T19:03:17.048 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:17.052 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:17.053 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:17.262 INFO:teuthology.orchestra.run.smithi052.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:17.265 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/136 2023-09-30T19:03:17.266 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/136 2023-09-30T19:03:17.266 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:17.268 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:17.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:17.277 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-09-30T19:03:17.801 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:17.805 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:17.805 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:17.967 INFO:teuthology.orchestra.run.smithi052.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:17.972 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/137 2023-09-30T19:03:17.972 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/137 2023-09-30T19:03:17.972 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:17.974 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:17.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:17.982 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-09-30T19:03:18.491 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:03:18.493 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:03:18.509 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:18.513 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:18.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/138 2023-09-30T19:03:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/138 2023-09-30T19:03:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:18.675 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:18.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:18.683 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-09-30T19:03:19.223 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:19.227 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:19.390 INFO:teuthology.orchestra.run.smithi052.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:19.392 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/139 2023-09-30T19:03:19.392 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/139 2023-09-30T19:03:19.392 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:19.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:19.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:19.403 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-09-30T19:03:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:19.953 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:20.113 INFO:teuthology.orchestra.run.smithi052.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:20.117 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/140 2023-09-30T19:03:20.117 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/140 2023-09-30T19:03:20.117 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:20.119 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:20.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:20.128 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-09-30T19:03:20.647 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:20.651 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:20.652 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:20.751 INFO:teuthology.orchestra.run.smithi052.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:20.755 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/141 2023-09-30T19:03:20.755 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/141 2023-09-30T19:03:20.755 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:20.757 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:20.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:20.765 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-09-30T19:03:20.949 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:20.953 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:21.124 INFO:teuthology.orchestra.run.smithi052.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:21.128 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/142 2023-09-30T19:03:21.128 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/142 2023-09-30T19:03:21.128 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:21.130 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:21.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:21.138 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-09-30T19:03:21.647 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:21.652 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:21.652 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:21.807 INFO:teuthology.orchestra.run.smithi052.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:21.811 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/143 2023-09-30T19:03:21.811 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/143 2023-09-30T19:03:21.811 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:21.813 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:21.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:21.821 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-09-30T19:03:22.370 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:22.537 INFO:teuthology.orchestra.run.smithi052.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:22.540 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/144 2023-09-30T19:03:22.540 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/144 2023-09-30T19:03:22.540 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:22.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:22.551 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-09-30T19:03:23.047 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:23.051 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:23.051 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:23.206 INFO:teuthology.orchestra.run.smithi052.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:23.209 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/145 2023-09-30T19:03:23.209 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/145 2023-09-30T19:03:23.209 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:23.211 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:23.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:23.219 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-09-30T19:03:23.736 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:23.739 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:23.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:23.905 INFO:teuthology.orchestra.run.smithi052.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:23.909 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/146 2023-09-30T19:03:23.909 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/146 2023-09-30T19:03:23.909 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:23.911 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:23.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:23.919 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-09-30T19:03:24.490 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:24.494 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:24.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:24.659 INFO:teuthology.orchestra.run.smithi052.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:24.662 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/147 2023-09-30T19:03:24.663 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/147 2023-09-30T19:03:24.663 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:24.665 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:24.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:24.673 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-09-30T19:03:25.200 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:25.204 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:25.204 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:25.365 INFO:teuthology.orchestra.run.smithi052.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:25.369 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/148 2023-09-30T19:03:25.369 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/148 2023-09-30T19:03:25.370 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:25.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:25.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:25.382 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-09-30T19:03:25.908 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:25.911 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:25.911 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:26.077 INFO:teuthology.orchestra.run.smithi052.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:26.081 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/149 2023-09-30T19:03:26.081 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/149 2023-09-30T19:03:26.081 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:26.083 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:26.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:26.091 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-09-30T19:03:26.611 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:26.615 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:26.615 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:26.771 INFO:teuthology.orchestra.run.smithi052.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:26.776 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/150 2023-09-30T19:03:26.776 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/150 2023-09-30T19:03:26.776 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:26.779 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:26.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:26.787 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-09-30T19:03:27.329 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:27.333 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:27.333 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:27.496 INFO:teuthology.orchestra.run.smithi052.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:27.500 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/151 2023-09-30T19:03:27.500 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/151 2023-09-30T19:03:27.500 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:27.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:27.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:27.510 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-09-30T19:03:27.999 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:28.003 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:28.003 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:28.162 INFO:teuthology.orchestra.run.smithi052.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:28.166 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/152 2023-09-30T19:03:28.166 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/152 2023-09-30T19:03:28.166 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:28.168 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:28.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:28.176 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-09-30T19:03:28.732 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:28.736 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:28.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:28.910 INFO:teuthology.orchestra.run.smithi052.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:28.914 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/153 2023-09-30T19:03:28.914 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/153 2023-09-30T19:03:28.914 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:28.916 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:28.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:28.924 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-09-30T19:03:29.468 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:29.472 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:29.472 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:29.662 INFO:teuthology.orchestra.run.smithi052.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:29.666 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/154 2023-09-30T19:03:29.666 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/154 2023-09-30T19:03:29.666 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:29.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:29.676 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-09-30T19:03:30.209 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:30.213 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:30.213 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:30.435 INFO:teuthology.orchestra.run.smithi052.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:30.439 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/155 2023-09-30T19:03:30.439 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/155 2023-09-30T19:03:30.439 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:30.442 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:30.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:30.451 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-09-30T19:03:30.972 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:30.976 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:30.976 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:31.225 INFO:teuthology.orchestra.run.smithi052.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:31.228 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/156 2023-09-30T19:03:31.229 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/156 2023-09-30T19:03:31.229 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:31.231 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:31.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:31.240 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-09-30T19:03:31.796 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:31.800 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:31.800 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:31.960 INFO:teuthology.orchestra.run.smithi052.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:31.963 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/157 2023-09-30T19:03:31.964 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/157 2023-09-30T19:03:31.964 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:31.966 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:31.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:31.974 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-09-30T19:03:32.520 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:32.524 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:32.524 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/158 2023-09-30T19:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/158 2023-09-30T19:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:32.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:32.702 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-09-30T19:03:33.248 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:33.252 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:33.252 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:33.428 INFO:teuthology.orchestra.run.smithi052.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-09-30T19:03:33.432 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/159 2023-09-30T19:03:33.432 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/159 2023-09-30T19:03:33.432 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:33.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:33.443 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-09-30T19:03:33.640 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:33.644 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:33.821 INFO:teuthology.orchestra.run.smithi052.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-09-30T19:03:33.825 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/160 2023-09-30T19:03:33.825 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/160 2023-09-30T19:03:33.825 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:33.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:33.836 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-09-30T19:03:34.011 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:34.015 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:34.115 INFO:teuthology.orchestra.run.smithi052.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:34.118 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/161 2023-09-30T19:03:34.118 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/161 2023-09-30T19:03:34.119 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:34.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:34.129 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-09-30T19:03:34.314 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:34.318 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:34.417 INFO:teuthology.orchestra.run.smithi052.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:34.420 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/162 2023-09-30T19:03:34.420 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/162 2023-09-30T19:03:34.421 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:34.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:34.430 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-09-30T19:03:34.611 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:34.616 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:34.718 INFO:teuthology.orchestra.run.smithi052.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:34.722 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/163 2023-09-30T19:03:34.722 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/163 2023-09-30T19:03:34.722 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:34.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:34.732 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-09-30T19:03:34.928 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:34.932 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:34.932 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.034 INFO:teuthology.orchestra.run.smithi052.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:35.038 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/164 2023-09-30T19:03:35.038 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/164 2023-09-30T19:03:35.038 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:35.040 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:35.048 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-09-30T19:03:35.228 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:35.233 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:35.233 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.335 INFO:teuthology.orchestra.run.smithi052.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:35.339 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/165 2023-09-30T19:03:35.339 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/165 2023-09-30T19:03:35.339 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:35.341 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:35.349 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-09-30T19:03:35.528 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:35.532 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:35.532 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.634 INFO:teuthology.orchestra.run.smithi052.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:35.639 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/166 2023-09-30T19:03:35.639 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/166 2023-09-30T19:03:35.639 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:35.642 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:35.651 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-09-30T19:03:35.832 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:35.837 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:35.837 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.939 INFO:teuthology.orchestra.run.smithi052.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:35.943 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/167 2023-09-30T19:03:35.943 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/167 2023-09-30T19:03:35.943 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:35.945 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:35.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:35.953 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-09-30T19:03:36.128 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:36.132 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:36.132 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:36.237 INFO:teuthology.orchestra.run.smithi052.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:36.241 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/168 2023-09-30T19:03:36.241 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/168 2023-09-30T19:03:36.241 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:36.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:36.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:36.252 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-09-30T19:03:36.461 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:36.465 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:36.465 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:36.636 INFO:teuthology.orchestra.run.smithi052.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:36.640 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/169 2023-09-30T19:03:36.640 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/169 2023-09-30T19:03:36.640 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:36.643 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:36.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:36.652 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-09-30T19:03:36.848 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:36.852 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:36.852 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:36.954 INFO:teuthology.orchestra.run.smithi052.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:36.958 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/170 2023-09-30T19:03:36.958 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/170 2023-09-30T19:03:36.958 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:36.960 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:36.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:36.968 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-09-30T19:03:37.156 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:37.160 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:37.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:37.278 INFO:teuthology.orchestra.run.smithi052.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:37.282 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/171 2023-09-30T19:03:37.282 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/171 2023-09-30T19:03:37.282 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:37.284 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:37.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:37.292 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-09-30T19:03:37.489 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:37.493 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:37.493 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:37.603 INFO:teuthology.orchestra.run.smithi052.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:37.607 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/172 2023-09-30T19:03:37.607 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/172 2023-09-30T19:03:37.607 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:37.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:37.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:37.618 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-09-30T19:03:37.815 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:37.819 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:37.820 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:37.925 INFO:teuthology.orchestra.run.smithi052.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:37.928 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/173 2023-09-30T19:03:37.928 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/173 2023-09-30T19:03:37.929 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:37.931 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:37.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:37.939 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-09-30T19:03:38.122 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:38.126 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:38.126 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:38.242 INFO:teuthology.orchestra.run.smithi052.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:38.246 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/174 2023-09-30T19:03:38.246 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/174 2023-09-30T19:03:38.246 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:38.248 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:38.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:38.256 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-09-30T19:03:38.448 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:38.452 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:38.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:38.563 INFO:teuthology.orchestra.run.smithi052.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:38.567 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/175 2023-09-30T19:03:38.567 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/175 2023-09-30T19:03:38.567 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:38.569 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:38.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:38.577 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-09-30T19:03:38.785 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:38.789 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:38.789 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:38.932 INFO:teuthology.orchestra.run.smithi052.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:38.937 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/176 2023-09-30T19:03:38.937 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/176 2023-09-30T19:03:38.937 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:38.939 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:38.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:38.949 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-09-30T19:03:39.154 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:39.158 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:39.158 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:39.482 INFO:teuthology.orchestra.run.smithi052.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:39.488 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/177 2023-09-30T19:03:39.488 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/177 2023-09-30T19:03:39.488 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:39.492 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:39.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:39.504 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-09-30T19:03:39.718 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:39.723 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:39.723 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:39.920 INFO:teuthology.orchestra.run.smithi052.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:39.924 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/178 2023-09-30T19:03:39.925 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/178 2023-09-30T19:03:39.925 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:39.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:39.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:39.937 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-09-30T19:03:40.471 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:40.475 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:40.475 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:40.632 INFO:teuthology.orchestra.run.smithi052.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/179 2023-09-30T19:03:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/179 2023-09-30T19:03:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:40.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:40.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:40.646 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-09-30T19:03:41.208 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:41.213 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:41.213 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:41.386 INFO:teuthology.orchestra.run.smithi052.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:41.390 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/180 2023-09-30T19:03:41.390 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/180 2023-09-30T19:03:41.390 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:41.392 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:41.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:41.400 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-09-30T19:03:41.931 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:41.935 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:41.935 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:42.094 INFO:teuthology.orchestra.run.smithi052.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:42.098 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/181 2023-09-30T19:03:42.098 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/181 2023-09-30T19:03:42.098 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:42.100 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:42.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:42.108 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-09-30T19:03:42.671 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:42.675 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:42.675 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:42.834 INFO:teuthology.orchestra.run.smithi052.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T19:03:42.838 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/182 2023-09-30T19:03:42.838 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/182 2023-09-30T19:03:42.838 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:42.840 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:42.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:42.848 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-09-30T19:03:43.380 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:43.385 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:43.485 INFO:teuthology.orchestra.run.smithi052.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:43.488 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/183 2023-09-30T19:03:43.488 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/183 2023-09-30T19:03:43.489 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:43.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:43.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:43.499 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-09-30T19:03:43.683 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:43.687 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:43.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:43.846 INFO:teuthology.orchestra.run.smithi052.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/184.out.bad) 2023-09-30T19:03:43.848 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/184.out 2023-09-30 16:50:24.682064448 +0000 2023-09-30T19:03:43.848 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/184.out.bad 2023-09-30 19:03:43.846429081 +0000 2023-09-30T19:03:43.848 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1 +1,2 @@ 2023-09-30T19:03:43.848 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 184 2023-09-30T19:03:43.848 INFO:teuthology.orchestra.run.smithi052.stdout: +/tmp/tmp.qvcny3LNTMxfstests-dev/tests/generic/184: line 23: /tmp/tmp.NXbAzGS4G1test/null: Permission denied 2023-09-30T19:03:43.850 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/184 2023-09-30T19:03:43.851 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/184 2023-09-30T19:03:43.851 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:03:43.853 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:43.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:03:43.860 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:03:43.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:03:43.861 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-09-30T19:03:44.040 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:44.044 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:44.044 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:44.148 INFO:teuthology.orchestra.run.smithi052.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:44.151 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/185 2023-09-30T19:03:44.151 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/185 2023-09-30T19:03:44.151 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:44.153 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:44.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:44.162 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-09-30T19:03:44.341 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:44.345 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:44.345 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:44.446 INFO:teuthology.orchestra.run.smithi052.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:44.450 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/186 2023-09-30T19:03:44.450 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/186 2023-09-30T19:03:44.450 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:44.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:44.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:44.461 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-09-30T19:03:44.657 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:44.659 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:44.659 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:44.758 INFO:teuthology.orchestra.run.smithi052.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:44.762 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/187 2023-09-30T19:03:44.762 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/187 2023-09-30T19:03:44.762 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:44.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:44.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:44.858 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-09-30T19:03:45.097 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:45.101 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:45.101 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:45.252 INFO:teuthology.orchestra.run.smithi052.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:45.255 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/188 2023-09-30T19:03:45.255 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/188 2023-09-30T19:03:45.256 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:45.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:45.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:45.267 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-09-30T19:03:45.448 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:45.452 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:45.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:45.553 INFO:teuthology.orchestra.run.smithi052.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:45.557 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/189 2023-09-30T19:03:45.557 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/189 2023-09-30T19:03:45.557 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:45.559 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:45.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:45.567 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-09-30T19:03:45.756 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:45.760 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:45.760 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:45.871 INFO:teuthology.orchestra.run.smithi052.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:45.874 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/190 2023-09-30T19:03:45.874 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/190 2023-09-30T19:03:45.875 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:45.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:45.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:45.885 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-09-30T19:03:46.089 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:46.093 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:46.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:46.202 INFO:teuthology.orchestra.run.smithi052.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:46.206 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/191 2023-09-30T19:03:46.206 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/191 2023-09-30T19:03:46.206 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:46.208 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:46.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:46.217 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-09-30T19:03:46.420 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:46.424 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:46.424 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:46.532 INFO:teuthology.orchestra.run.smithi052.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-09-30T19:03:46.535 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/192 2023-09-30T19:03:46.536 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/192 2023-09-30T19:03:46.536 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:46.538 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:46.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:46.546 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-09-30T19:03:46.724 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:46.728 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:46.728 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:47.525 INFO:teuthology.orchestra.run.smithi052.stdout:generic/193 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/193.out.bad) 2023-09-30T19:03:47.527 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/193.out 2023-09-30 16:50:24.682064448 +0000 2023-09-30T19:03:47.527 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/193.out.bad 2023-09-30 19:03:47.526385285 +0000 2023-09-30T19:03:47.527 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -24,7 +24,6 @@ 2023-09-30T19:03:47.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:47.527 INFO:teuthology.orchestra.run.smithi052.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-09-30T19:03:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: user: chmod a+r on root owned file (should fail) 2023-09-30T19:03:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-09-30T19:03:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: check that the sgid bit is cleared 2023-09-30T19:03:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: -rw-rw-rw- 2023-09-30T19:03:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: check that suid bit is not cleared 2023-09-30T19:03:47.529 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/193 2023-09-30T19:03:47.529 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/193 2023-09-30T19:03:47.529 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:03:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:47.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:03:47.540 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:03:47.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:03:47.540 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-09-30T19:03:48.097 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:48.101 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:48.101 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:48.201 INFO:teuthology.orchestra.run.smithi052.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:48.205 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/194 2023-09-30T19:03:48.205 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/194 2023-09-30T19:03:48.205 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:48.208 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:48.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:48.221 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-09-30T19:03:48.408 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:48.412 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:48.412 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:48.515 INFO:teuthology.orchestra.run.smithi052.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:48.518 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/195 2023-09-30T19:03:48.519 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/195 2023-09-30T19:03:48.519 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:48.521 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:48.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:48.529 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-09-30T19:03:48.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:03:48.576 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:03:48.753 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:48.758 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:48.758 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:48.862 INFO:teuthology.orchestra.run.smithi052.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:48.866 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/196 2023-09-30T19:03:48.866 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/196 2023-09-30T19:03:48.867 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:48.868 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:48.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:48.877 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-09-30T19:03:49.065 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:49.069 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:49.070 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:49.176 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/197 2023-09-30T19:03:49.176 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/197 2023-09-30T19:03:49.176 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:49.179 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:49.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:49.188 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-09-30T19:03:49.388 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:49.392 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:49.393 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:50.420 INFO:teuthology.orchestra.run.smithi052.stdout:generic/198 1s 2023-09-30T19:03:50.428 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/198 2023-09-30T19:03:50.428 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:50.432 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:50.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:50.444 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-09-30T19:03:50.996 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:51.000 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:51.000 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:51.144 INFO:teuthology.orchestra.run.smithi052.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:51.147 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/199 2023-09-30T19:03:51.148 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/199 2023-09-30T19:03:51.148 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:51.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:51.567 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-09-30T19:03:51.805 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:51.810 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:51.810 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:51.913 INFO:teuthology.orchestra.run.smithi052.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:51.917 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/200 2023-09-30T19:03:51.917 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/200 2023-09-30T19:03:51.917 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:51.919 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:51.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:51.927 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-09-30T19:03:52.124 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:52.128 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:52.128 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:52.228 INFO:teuthology.orchestra.run.smithi052.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:52.232 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/201 2023-09-30T19:03:52.232 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/201 2023-09-30T19:03:52.232 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:52.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:52.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:52.243 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-09-30T19:03:52.446 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:52.450 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:52.450 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:52.554 INFO:teuthology.orchestra.run.smithi052.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:52.558 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/202 2023-09-30T19:03:52.558 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/202 2023-09-30T19:03:52.558 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:52.560 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:52.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:52.569 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-09-30T19:03:52.769 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:52.774 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:52.774 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:52.875 INFO:teuthology.orchestra.run.smithi052.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:52.879 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/203 2023-09-30T19:03:52.879 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/203 2023-09-30T19:03:52.879 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:52.881 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:52.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:52.890 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-09-30T19:03:53.085 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:53.088 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:53.089 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:54.364 INFO:teuthology.orchestra.run.smithi052.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:54.370 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/204 2023-09-30T19:03:54.370 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/204 2023-09-30T19:03:54.370 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:54.375 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:54.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:54.389 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-09-30T19:03:54.621 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:54.625 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:54.626 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:54.756 INFO:teuthology.orchestra.run.smithi052.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:54.760 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/205 2023-09-30T19:03:54.760 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/205 2023-09-30T19:03:54.761 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:54.763 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:54.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:54.774 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-09-30T19:03:54.997 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:55.002 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:55.002 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:55.121 INFO:teuthology.orchestra.run.smithi052.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:03:55.125 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/206 2023-09-30T19:03:55.125 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/206 2023-09-30T19:03:55.125 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:03:55.128 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:03:55.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:03:55.137 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-09-30T19:03:55.331 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:03:55.335 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:03:55.335 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:04:18.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:04:18.648 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:04:30.412 INFO:teuthology.orchestra.run.smithi052.stdout:generic/207 35s 2023-09-30T19:04:30.420 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/207 2023-09-30T19:04:30.420 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:04:30.423 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:04:30.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:04:30.435 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-09-30T19:04:30.997 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:04:31.001 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:04:31.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:04:48.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:04:48.787 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:05:18.891 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:05:18.894 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:05:48.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:05:48.941 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:06:18.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:06:18.989 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:06:49.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:06:49.121 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:07:19.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:07:19.242 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:07:49.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:07:49.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:07:51.423 INFO:teuthology.orchestra.run.smithi052.stdout:generic/208 200s 2023-09-30T19:07:51.430 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/208 2023-09-30T19:07:51.430 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:07:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:07:51.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:07:51.444 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-09-30T19:07:52.039 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:07:52.044 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:07:52.044 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:13.947 INFO:teuthology.orchestra.run.smithi052.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/209.out.bad) 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/209.out 2023-09-30 16:50:24.682064448 +0000 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/209.out.bad 2023-09-30 19:08:13.919223718 +0000 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,2 +1,2 @@ 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 209 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: -test ran for 30 seconds without error 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: +reader found old byte at pos 4096 2023-09-30T19:08:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: \ No newline at end of file 2023-09-30T19:08:14.149 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/209 2023-09-30T19:08:14.149 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/209 2023-09-30T19:08:14.149 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:08:14.166 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:14.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:08:14.183 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:08:14.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:08:14.184 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-09-30T19:08:14.499 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:14.503 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:14.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:14.837 INFO:teuthology.orchestra.run.smithi052.stdout:generic/210 0s 2023-09-30T19:08:14.844 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/210 2023-09-30T19:08:14.845 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:14.848 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:14.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:14.859 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-09-30T19:08:15.368 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:15.372 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:15.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:15.769 INFO:teuthology.orchestra.run.smithi052.stdout:generic/211 0s 2023-09-30T19:08:15.775 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/211 2023-09-30T19:08:15.775 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:15.778 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:15.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:15.788 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-09-30T19:08:15.983 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:15.987 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:15.987 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:16.280 INFO:teuthology.orchestra.run.smithi052.stdout:generic/212 1s 2023-09-30T19:08:16.286 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/212 2023-09-30T19:08:16.286 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:16.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:16.300 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-09-30T19:08:16.496 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:16.500 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:16.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:16.966 INFO:teuthology.orchestra.run.smithi052.stdout:generic/213 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/213.out.bad) 2023-09-30T19:08:16.968 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/213.out 2023-09-30 16:50:24.682064448 +0000 2023-09-30T19:08:16.968 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/213.out.bad 2023-09-30 19:08:16.963187689 +0000 2023-09-30T19:08:16.968 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,4 +1,3 @@ 2023-09-30T19:08:16.968 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 213 2023-09-30T19:08:16.968 INFO:teuthology.orchestra.run.smithi052.stdout: We should get: fallocate: No space left on device 2023-09-30T19:08:16.968 INFO:teuthology.orchestra.run.smithi052.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-09-30T19:08:16.969 INFO:teuthology.orchestra.run.smithi052.stdout: -fallocate: No space left on device 2023-09-30T19:08:16.970 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/213 2023-09-30T19:08:16.970 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/213 2023-09-30T19:08:16.970 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:08:16.973 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:16.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:08:16.983 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:08:16.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:08:16.983 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-09-30T19:08:17.567 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:17.571 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:17.571 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:18.133 INFO:teuthology.orchestra.run.smithi052.stdout:generic/214 1s 2023-09-30T19:08:18.139 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/214 2023-09-30T19:08:18.139 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:18.142 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:18.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:18.158 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-09-30T19:08:18.822 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:18.827 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:18.827 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:19.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:08:19.437 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:08:22.082 INFO:teuthology.orchestra.run.smithi052.stdout:generic/215 4s 2023-09-30T19:08:22.087 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/215 2023-09-30T19:08:22.087 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:22.090 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:22.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:22.102 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-09-30T19:08:22.384 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:22.389 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:22.389 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:22.555 INFO:teuthology.orchestra.run.smithi052.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:22.559 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/216 2023-09-30T19:08:22.559 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/216 2023-09-30T19:08:22.559 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:22.562 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:22.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:22.575 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-09-30T19:08:22.853 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:22.857 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:22.857 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:23.018 INFO:teuthology.orchestra.run.smithi052.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:23.021 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/217 2023-09-30T19:08:23.022 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/217 2023-09-30T19:08:23.022 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:23.024 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:23.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:23.035 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-09-30T19:08:23.311 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:23.316 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:23.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:24.400 INFO:teuthology.orchestra.run.smithi052.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:24.875 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/218 2023-09-30T19:08:24.875 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/218 2023-09-30T19:08:24.875 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:24.932 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:24.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:24.961 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-09-30T19:08:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:25.832 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:25.832 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:26.021 INFO:teuthology.orchestra.run.smithi052.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:26.025 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/219 2023-09-30T19:08:26.026 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/219 2023-09-30T19:08:26.026 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:26.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:26.041 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-09-30T19:08:26.426 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:26.431 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:26.431 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:26.656 INFO:teuthology.orchestra.run.smithi052.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:26.660 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/220 2023-09-30T19:08:26.660 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/220 2023-09-30T19:08:26.660 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:26.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:26.674 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-09-30T19:08:26.937 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:26.942 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:26.943 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:28.188 INFO:teuthology.orchestra.run.smithi052.stdout:generic/221 2s 2023-09-30T19:08:28.198 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/221 2023-09-30T19:08:28.198 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:28.200 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:28.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:28.211 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-09-30T19:08:28.507 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:28.511 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:28.511 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:28.693 INFO:teuthology.orchestra.run.smithi052.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:28.698 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/222 2023-09-30T19:08:28.698 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/222 2023-09-30T19:08:28.698 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:28.705 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:28.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:28.718 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-09-30T19:08:29.032 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:29.036 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:29.037 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:29.204 INFO:teuthology.orchestra.run.smithi052.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:29.214 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/223 2023-09-30T19:08:29.214 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/223 2023-09-30T19:08:29.214 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:29.217 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:29.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:29.238 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-09-30T19:08:29.549 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:29.554 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:29.554 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:29.702 INFO:teuthology.orchestra.run.smithi052.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:29.707 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/224 2023-09-30T19:08:29.707 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/224 2023-09-30T19:08:29.707 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:29.715 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:29.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:29.725 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-09-30T19:08:30.016 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:30.022 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:30.314 INFO:teuthology.orchestra.run.smithi052.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:30.318 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/225 2023-09-30T19:08:30.318 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/225 2023-09-30T19:08:30.318 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:30.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:30.332 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-09-30T19:08:30.628 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:30.634 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:30.784 INFO:teuthology.orchestra.run.smithi052.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:30.789 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/226 2023-09-30T19:08:30.789 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/226 2023-09-30T19:08:30.789 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:30.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:30.802 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-09-30T19:08:31.111 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:31.116 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:31.116 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:31.294 INFO:teuthology.orchestra.run.smithi052.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:31.298 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/227 2023-09-30T19:08:31.298 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/227 2023-09-30T19:08:31.298 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:31.301 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:31.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:31.317 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-09-30T19:08:31.594 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:31.610 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:31.610 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:32.022 INFO:teuthology.orchestra.run.smithi052.stdout:generic/228 1s 2023-09-30T19:08:32.028 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/228 2023-09-30T19:08:32.028 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:32.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:32.044 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-09-30T19:08:32.687 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:32.913 INFO:teuthology.orchestra.run.smithi052.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:32.917 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/229 2023-09-30T19:08:32.917 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/229 2023-09-30T19:08:32.917 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:32.920 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:32.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:32.942 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-09-30T19:08:33.228 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:33.243 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:33.243 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:33.403 INFO:teuthology.orchestra.run.smithi052.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:33.407 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/230 2023-09-30T19:08:33.408 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/230 2023-09-30T19:08:33.408 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:33.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:33.418 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-09-30T19:08:33.677 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:33.682 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:33.853 INFO:teuthology.orchestra.run.smithi052.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:33.863 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/231 2023-09-30T19:08:33.863 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/231 2023-09-30T19:08:33.863 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:33.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:33.879 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-09-30T19:08:34.207 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:34.212 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:34.463 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/232 2023-09-30T19:08:34.463 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/232 2023-09-30T19:08:34.463 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:34.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:34.479 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-09-30T19:08:34.764 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:34.768 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:34.915 INFO:teuthology.orchestra.run.smithi052.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:34.921 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/233 2023-09-30T19:08:34.921 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/233 2023-09-30T19:08:34.921 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:34.924 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:34.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:34.939 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-09-30T19:08:35.180 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:35.185 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:35.185 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:35.347 INFO:teuthology.orchestra.run.smithi052.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:35.351 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/234 2023-09-30T19:08:35.351 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/234 2023-09-30T19:08:35.352 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:35.354 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:35.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:35.367 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-09-30T19:08:35.659 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:35.664 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:35.664 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:35.812 INFO:teuthology.orchestra.run.smithi052.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:35.815 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/235 2023-09-30T19:08:35.816 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/235 2023-09-30T19:08:35.816 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:35.818 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:35.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:35.834 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-09-30T19:08:36.129 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:36.133 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:36.133 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:37.695 INFO:teuthology.orchestra.run.smithi052.stdout:generic/236 1s 2023-09-30T19:08:37.701 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/236 2023-09-30T19:08:37.701 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:37.703 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:37.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:37.736 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-09-30T19:08:38.352 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:38.357 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:38.357 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:38.670 INFO:teuthology.orchestra.run.smithi052.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T19:08:38.676 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/237 2023-09-30T19:08:38.676 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/237 2023-09-30T19:08:38.676 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:38.678 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:38.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:38.688 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-09-30T19:08:38.998 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:39.007 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:39.007 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:39.159 INFO:teuthology.orchestra.run.smithi052.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:08:39.163 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/238 2023-09-30T19:08:39.163 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/238 2023-09-30T19:08:39.163 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:08:39.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:39.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:08:39.180 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-09-30T19:08:39.450 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:08:39.454 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:08:39.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:08:49.489 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:08:49.492 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:09:19.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:09:19.597 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:09:50.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:09:50.006 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:10:20.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:10:20.058 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:10:50.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:10:50.161 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:11:18.912 INFO:teuthology.orchestra.run.smithi052.stdout:generic/239 159s 2023-09-30T19:11:18.923 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/239 2023-09-30T19:11:18.923 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:11:18.940 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:11:18.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:11:18.952 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-09-30T19:11:19.633 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:11:19.637 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:11:19.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:11:20.322 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:11:20.325 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:11:23.397 INFO:teuthology.orchestra.run.smithi052.stdout:generic/240 4s 2023-09-30T19:11:23.413 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/240 2023-09-30T19:11:23.414 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:11:23.416 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:11:23.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:11:23.430 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-09-30T19:11:24.042 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:11:24.047 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:11:24.047 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:11:50.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:11:50.788 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:12:20.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:12:20.871 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:12:37.681 INFO:teuthology.orchestra.run.smithi052.stdout:generic/241 73s 2023-09-30T19:12:37.689 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/241 2023-09-30T19:12:37.689 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:12:37.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:37.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:12:37.704 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-09-30T19:12:38.370 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:12:38.377 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:12:38.377 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:38.581 INFO:teuthology.orchestra.run.smithi052.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:12:38.585 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/242 2023-09-30T19:12:38.585 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/242 2023-09-30T19:12:38.585 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:12:38.588 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:38.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:12:38.604 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-09-30T19:12:38.908 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:12:38.912 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:12:38.912 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:39.081 INFO:teuthology.orchestra.run.smithi052.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:12:39.085 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/243 2023-09-30T19:12:39.085 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/243 2023-09-30T19:12:39.085 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:12:39.087 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:39.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:12:39.096 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-09-30T19:12:39.359 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:12:39.365 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:12:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:39.518 INFO:teuthology.orchestra.run.smithi052.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-30T19:12:39.522 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/244 2023-09-30T19:12:39.526 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/244 2023-09-30T19:12:39.526 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:12:39.526 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:39.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:12:39.535 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-09-30T19:12:39.795 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:12:39.802 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:12:39.802 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:40.131 INFO:teuthology.orchestra.run.smithi052.stdout:generic/245 1s 2023-09-30T19:12:40.136 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/245 2023-09-30T19:12:40.137 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:12:40.139 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:40.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:12:40.148 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-09-30T19:12:40.785 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:12:40.789 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:12:40.789 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:41.036 INFO:teuthology.orchestra.run.smithi052.stdout:generic/246 1s 2023-09-30T19:12:41.048 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/246 2023-09-30T19:12:41.048 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:12:41.055 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:41.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:12:41.072 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-09-30T19:12:41.686 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:12:41.692 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:12:41.692 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:12:50.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:12:50.935 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:13:21.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:13:21.121 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:13:21.136 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T19:13:21.138+0000 7f3c0f7b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45195) UID: 0 2023-09-30T19:13:21.136 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T19:13:21.138+0000 7f254dda9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45195) UID: 0 2023-09-30T19:13:21.136 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T19:13:21.138+0000 7fd82f759640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45195) UID: 0 2023-09-30T19:13:21.137 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T19:13:21.138+0000 7f4ae803a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45195) UID: 0 2023-09-30T19:13:30.610 INFO:teuthology.orchestra.run.smithi052.stdout:generic/247 49s 2023-09-30T19:13:30.617 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/247 2023-09-30T19:13:30.617 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:30.619 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:30.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:30.634 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-09-30T19:13:30.872 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:30.877 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:30.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:31.136 INFO:teuthology.orchestra.run.smithi052.stdout:generic/248 1s 2023-09-30T19:13:31.145 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/248 2023-09-30T19:13:31.146 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:31.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:31.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:31.159 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-09-30T19:13:31.430 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:31.435 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:31.435 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:33.788 INFO:teuthology.orchestra.run.smithi052.stdout:generic/249 2s 2023-09-30T19:13:33.794 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/249 2023-09-30T19:13:33.794 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:33.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:33.810 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-09-30T19:13:34.428 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:34.433 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:34.685 INFO:teuthology.orchestra.run.smithi052.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:34.691 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/250 2023-09-30T19:13:34.691 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/250 2023-09-30T19:13:34.692 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:34.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:34.707 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-09-30T19:13:34.981 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:34.985 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:34.985 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:35.135 INFO:teuthology.orchestra.run.smithi052.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:35.139 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/251 2023-09-30T19:13:35.139 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/251 2023-09-30T19:13:35.139 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:35.142 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:35.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:35.152 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-09-30T19:13:35.411 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:35.416 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:35.416 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:35.578 INFO:teuthology.orchestra.run.smithi052.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:35.582 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/252 2023-09-30T19:13:35.582 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/252 2023-09-30T19:13:35.583 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:35.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:35.601 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-09-30T19:13:35.844 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:35.849 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:35.849 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:35.993 INFO:teuthology.orchestra.run.smithi052.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:35.997 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/253 2023-09-30T19:13:35.997 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/253 2023-09-30T19:13:35.997 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:36.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:36.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:36.013 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-09-30T19:13:36.285 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:36.290 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:36.290 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:36.441 INFO:teuthology.orchestra.run.smithi052.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:36.446 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/254 2023-09-30T19:13:36.446 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/254 2023-09-30T19:13:36.446 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:36.448 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:36.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:36.464 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-09-30T19:13:36.699 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:36.703 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:36.703 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:38.084 INFO:teuthology.orchestra.run.smithi052.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T19:13:38.092 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/255 2023-09-30T19:13:38.092 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/255 2023-09-30T19:13:38.092 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:38.095 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:38.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:38.105 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-09-30T19:13:38.770 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:38.774 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:38.774 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:40.024 INFO:teuthology.orchestra.run.smithi052.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:40.028 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/256 2023-09-30T19:13:40.028 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/256 2023-09-30T19:13:40.028 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:40.030 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:40.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:40.044 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-09-30T19:13:40.324 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:40.329 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:40.330 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:42.410 INFO:teuthology.orchestra.run.smithi052.stdout:generic/257 2s 2023-09-30T19:13:42.416 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/257 2023-09-30T19:13:42.416 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:42.418 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:42.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:42.432 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-09-30T19:13:43.070 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:43.074 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:43.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:43.377 INFO:teuthology.orchestra.run.smithi052.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/258.out.bad) 2023-09-30T19:13:43.384 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/258.out 2023-09-30 16:50:24.686064413 +0000 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/258.out.bad 2023-09-30 19:13:43.347058718 +0000 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,5 +1,6 @@ 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 258 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: Creating file with timestamp of Jan 1, 1960 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: Testing for negative seconds since epoch 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: -Remounting to flush cache 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: -Testing for negative seconds since epoch 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: +Timestamp wrapped: 3979351756 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: +Timestamp wrapped 2023-09-30T19:13:43.385 INFO:teuthology.orchestra.run.smithi052.stdout: +(see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/258.full for details) 2023-09-30T19:13:43.387 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/258 2023-09-30T19:13:43.388 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/258 2023-09-30T19:13:43.388 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:13:43.390 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:43.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:13:43.402 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:13:43.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:13:43.403 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-09-30T19:13:43.675 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:43.679 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:43.679 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:43.833 INFO:teuthology.orchestra.run.smithi052.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:43.836 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/259 2023-09-30T19:13:43.837 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/259 2023-09-30T19:13:43.837 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:43.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:43.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:43.850 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-09-30T19:13:44.109 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:44.114 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:44.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:44.276 INFO:teuthology.orchestra.run.smithi052.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:44.280 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/260 2023-09-30T19:13:44.280 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/260 2023-09-30T19:13:44.281 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:44.283 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:44.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:44.293 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-09-30T19:13:44.591 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:44.596 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:44.758 INFO:teuthology.orchestra.run.smithi052.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:44.763 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/261 2023-09-30T19:13:44.763 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/261 2023-09-30T19:13:44.763 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:44.765 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:44.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:44.779 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-09-30T19:13:45.024 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:45.028 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:45.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:45.181 INFO:teuthology.orchestra.run.smithi052.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:13:45.186 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/262 2023-09-30T19:13:45.186 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/262 2023-09-30T19:13:45.186 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:13:45.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:13:45.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:13:45.203 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-09-30T19:13:45.498 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:13:45.504 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:13:45.504 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:36.216 INFO:teuthology.orchestra.run.smithi052.stdout:generic/263 111s 2023-09-30T19:15:36.223 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/263 2023-09-30T19:15:36.223 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:36.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:36.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:36.239 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-09-30T19:15:36.820 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:36.824 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:36.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:36.955 INFO:teuthology.orchestra.run.smithi052.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:36.959 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/264 2023-09-30T19:15:36.959 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/264 2023-09-30T19:15:36.959 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:36.961 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:36.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:36.970 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-09-30T19:15:37.156 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:37.160 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:37.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:37.310 INFO:teuthology.orchestra.run.smithi052.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:37.315 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/265 2023-09-30T19:15:37.315 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/265 2023-09-30T19:15:37.315 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:37.318 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:37.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:37.326 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-09-30T19:15:37.521 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:37.525 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:37.526 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:37.658 INFO:teuthology.orchestra.run.smithi052.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:37.661 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/266 2023-09-30T19:15:37.661 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/266 2023-09-30T19:15:37.661 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:37.664 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:37.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:37.672 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-09-30T19:15:37.869 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:37.873 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:37.873 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:38.054 INFO:teuthology.orchestra.run.smithi052.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:38.058 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/267 2023-09-30T19:15:38.058 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/267 2023-09-30T19:15:38.058 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:38.060 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:38.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:38.068 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-09-30T19:15:38.246 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:38.250 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:38.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:38.366 INFO:teuthology.orchestra.run.smithi052.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:38.369 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/268 2023-09-30T19:15:38.369 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/268 2023-09-30T19:15:38.369 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:38.371 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:38.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:38.380 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-09-30T19:15:38.560 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:38.564 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:38.564 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:38.687 INFO:teuthology.orchestra.run.smithi052.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:38.691 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/269 2023-09-30T19:15:38.691 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/269 2023-09-30T19:15:38.691 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:38.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:38.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:38.702 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-09-30T19:15:38.884 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:38.888 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:38.888 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:39.010 INFO:teuthology.orchestra.run.smithi052.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-30T19:15:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/270 2023-09-30T19:15:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/270 2023-09-30T19:15:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:39.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:39.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:39.027 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-09-30T19:15:39.228 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:39.232 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:39.350 INFO:teuthology.orchestra.run.smithi052.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:39.354 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/271 2023-09-30T19:15:39.354 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/271 2023-09-30T19:15:39.354 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:39.357 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:39.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:39.365 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-09-30T19:15:39.545 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:39.548 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:39.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:39.674 INFO:teuthology.orchestra.run.smithi052.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/272 2023-09-30T19:15:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/272 2023-09-30T19:15:39.678 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:39.681 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:39.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:39.688 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-09-30T19:15:39.868 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:39.872 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:39.872 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.003 INFO:teuthology.orchestra.run.smithi052.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:40.007 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/273 2023-09-30T19:15:40.007 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/273 2023-09-30T19:15:40.007 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:40.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:40.018 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-09-30T19:15:40.203 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:40.207 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:40.207 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.309 INFO:teuthology.orchestra.run.smithi052.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:40.313 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/274 2023-09-30T19:15:40.313 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/274 2023-09-30T19:15:40.313 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:40.315 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:40.324 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-09-30T19:15:40.508 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:40.512 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:40.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.628 INFO:teuthology.orchestra.run.smithi052.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:40.632 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/275 2023-09-30T19:15:40.632 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/275 2023-09-30T19:15:40.632 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:40.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:40.642 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-09-30T19:15:40.812 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:40.816 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:40.816 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.939 INFO:teuthology.orchestra.run.smithi052.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:40.942 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/276 2023-09-30T19:15:40.942 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/276 2023-09-30T19:15:40.943 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:40.945 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:40.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:40.953 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-09-30T19:15:41.136 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:41.140 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:41.140 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:41.250 INFO:teuthology.orchestra.run.smithi052.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:41.254 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/277 2023-09-30T19:15:41.254 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/277 2023-09-30T19:15:41.254 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:41.256 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:41.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:41.265 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-09-30T19:15:41.452 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:41.456 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:41.457 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:41.570 INFO:teuthology.orchestra.run.smithi052.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:41.573 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/278 2023-09-30T19:15:41.573 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/278 2023-09-30T19:15:41.574 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:41.576 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:41.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:41.585 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-09-30T19:15:41.776 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:41.780 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:41.780 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:41.911 INFO:teuthology.orchestra.run.smithi052.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:41.914 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/279 2023-09-30T19:15:41.914 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/279 2023-09-30T19:15:41.914 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:41.917 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:41.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:41.924 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-09-30T19:15:42.107 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:42.112 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:42.112 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:42.263 INFO:teuthology.orchestra.run.smithi052.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:42.266 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/280 2023-09-30T19:15:42.266 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/280 2023-09-30T19:15:42.267 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:42.269 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:42.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:42.278 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-09-30T19:15:42.455 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:42.459 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:42.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:42.574 INFO:teuthology.orchestra.run.smithi052.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:42.578 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/281 2023-09-30T19:15:42.578 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/281 2023-09-30T19:15:42.578 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:42.580 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:42.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:42.589 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-09-30T19:15:42.772 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:42.776 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:42.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:42.898 INFO:teuthology.orchestra.run.smithi052.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:42.902 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/282 2023-09-30T19:15:42.902 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/282 2023-09-30T19:15:42.902 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:42.904 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:42.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:42.913 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-09-30T19:15:43.081 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:43.085 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:43.085 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:43.202 INFO:teuthology.orchestra.run.smithi052.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:43.206 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/283 2023-09-30T19:15:43.206 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/283 2023-09-30T19:15:43.206 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:43.208 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:43.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:43.217 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-09-30T19:15:43.404 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:43.409 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:43.409 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:43.564 INFO:teuthology.orchestra.run.smithi052.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:15:43.568 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/284 2023-09-30T19:15:43.569 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/284 2023-09-30T19:15:43.569 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:43.572 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:43.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:43.579 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-09-30T19:15:43.765 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:43.769 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:43.769 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:46.699 INFO:teuthology.orchestra.run.smithi052.stdout:generic/285 3s 2023-09-30T19:15:46.705 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/285 2023-09-30T19:15:46.705 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:15:46.708 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:15:46.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:15:46.719 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-09-30T19:15:47.325 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:15:47.340 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:15:47.341 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:16:03.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:16:03.220 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:16:33.389 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:16:33.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:17:03.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:17:03.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:17:16.729 INFO:teuthology.orchestra.run.smithi052.stdout:generic/286 89s 2023-09-30T19:17:16.737 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/286 2023-09-30T19:17:16.737 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:16.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:16.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:16.799 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-09-30T19:17:17.430 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:17.434 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:17.435 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:17.633 INFO:teuthology.orchestra.run.smithi052.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:17.636 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/287 2023-09-30T19:17:17.637 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/287 2023-09-30T19:17:17.637 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:17.639 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:17.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:17.647 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-09-30T19:17:17.833 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:17.837 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:17.838 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:17.945 INFO:teuthology.orchestra.run.smithi052.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:17.949 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/288 2023-09-30T19:17:17.949 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/288 2023-09-30T19:17:17.949 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:17.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:17.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:17.960 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-09-30T19:17:18.144 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:18.148 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:18.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:18.252 INFO:teuthology.orchestra.run.smithi052.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:18.256 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/289 2023-09-30T19:17:18.256 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/289 2023-09-30T19:17:18.256 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:18.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:18.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:18.267 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-09-30T19:17:18.439 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:18.443 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:18.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/290 2023-09-30T19:17:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/290 2023-09-30T19:17:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:18.550 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:18.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:18.558 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-09-30T19:17:18.745 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:18.750 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:18.750 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:18.853 INFO:teuthology.orchestra.run.smithi052.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:18.869 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/291 2023-09-30T19:17:18.869 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/291 2023-09-30T19:17:18.869 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:18.869 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:18.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:18.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-09-30T19:17:19.080 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:19.084 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:19.084 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:19.192 INFO:teuthology.orchestra.run.smithi052.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:19.195 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/292 2023-09-30T19:17:19.196 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/292 2023-09-30T19:17:19.196 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:19.198 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:19.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:19.206 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-09-30T19:17:19.388 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:19.392 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:19.495 INFO:teuthology.orchestra.run.smithi052.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:19.499 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/293 2023-09-30T19:17:19.499 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/293 2023-09-30T19:17:19.499 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:19.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:19.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:19.509 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-09-30T19:17:19.694 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:19.698 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:19.699 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/294 2023-09-30T19:17:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/294 2023-09-30T19:17:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:19.812 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:19.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:19.821 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-09-30T19:17:20.008 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:20.012 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:20.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:20.118 INFO:teuthology.orchestra.run.smithi052.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:20.122 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/295 2023-09-30T19:17:20.122 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/295 2023-09-30T19:17:20.122 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:20.124 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:20.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:20.133 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-09-30T19:17:20.312 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:20.316 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:20.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:20.423 INFO:teuthology.orchestra.run.smithi052.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:20.427 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/296 2023-09-30T19:17:20.427 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/296 2023-09-30T19:17:20.427 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:20.429 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:20.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:20.437 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-09-30T19:17:20.641 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:20.645 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:20.645 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:20.767 INFO:teuthology.orchestra.run.smithi052.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:20.771 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/297 2023-09-30T19:17:20.771 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/297 2023-09-30T19:17:20.771 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:20.773 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:20.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:20.781 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-09-30T19:17:20.980 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:20.984 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:20.984 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:21.091 INFO:teuthology.orchestra.run.smithi052.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:21.095 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/298 2023-09-30T19:17:21.096 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/298 2023-09-30T19:17:21.096 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:21.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:21.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:21.107 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-09-30T19:17:21.304 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:21.308 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:21.415 INFO:teuthology.orchestra.run.smithi052.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:21.419 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/299 2023-09-30T19:17:21.419 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/299 2023-09-30T19:17:21.419 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:21.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:21.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:21.430 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-09-30T19:17:21.612 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:21.616 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:21.616 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:21.715 INFO:teuthology.orchestra.run.smithi052.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:21.719 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/300 2023-09-30T19:17:21.719 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/300 2023-09-30T19:17:21.719 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:21.721 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:21.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:21.730 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-09-30T19:17:21.899 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:21.903 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:21.904 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:22.048 INFO:teuthology.orchestra.run.smithi052.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:22.051 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/301 2023-09-30T19:17:22.051 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/301 2023-09-30T19:17:22.052 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:22.054 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:22.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:22.063 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-09-30T19:17:22.256 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:22.261 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:22.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:22.363 INFO:teuthology.orchestra.run.smithi052.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:22.367 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/302 2023-09-30T19:17:22.367 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/302 2023-09-30T19:17:22.367 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:22.369 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:22.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:22.379 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-09-30T19:17:22.573 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:22.577 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:22.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:22.801 INFO:teuthology.orchestra.run.smithi052.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:17:22.805 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/303 2023-09-30T19:17:22.805 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/303 2023-09-30T19:17:22.805 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:22.807 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:22.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:22.815 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-09-30T19:17:23.355 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:23.359 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:23.360 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:23.513 INFO:teuthology.orchestra.run.smithi052.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T19:17:23.517 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/304 2023-09-30T19:17:23.517 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/304 2023-09-30T19:17:23.517 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:23.519 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:23.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:23.527 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-09-30T19:17:24.050 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:24.054 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:24.054 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:24.262 INFO:teuthology.orchestra.run.smithi052.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:24.266 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/305 2023-09-30T19:17:24.266 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/305 2023-09-30T19:17:24.266 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:24.268 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:24.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:24.276 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-09-30T19:17:24.464 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:24.468 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:24.469 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:24.645 INFO:teuthology.orchestra.run.smithi052.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:24.657 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/306 2023-09-30T19:17:24.658 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/306 2023-09-30T19:17:24.658 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:24.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:24.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:24.660 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-09-30T19:17:24.881 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:24.900 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:24.900 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:25.012 INFO:teuthology.orchestra.run.smithi052.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:17:25.015 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/307 2023-09-30T19:17:25.015 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/307 2023-09-30T19:17:25.015 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:25.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:25.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:25.026 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-09-30T19:17:25.188 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:25.319 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:25.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:25.339 INFO:teuthology.orchestra.run.smithi052.stdout:generic/308 0s 2023-09-30T19:17:25.443 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/308 2023-09-30T19:17:25.443 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:25.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:25.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:25.444 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-09-30T19:17:25.855 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:25.860 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:25.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:27.082 INFO:teuthology.orchestra.run.smithi052.stdout:generic/309 2s 2023-09-30T19:17:27.089 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/309 2023-09-30T19:17:27.089 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:17:27.093 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:27.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:17:27.104 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-09-30T19:17:27.669 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:17:27.673 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:17:27.673 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:17:33.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:17:33.644 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:18:03.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:18:03.727 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:18:33.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:18:33.989 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:19:04.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:19:04.038 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:19:09.015 INFO:teuthology.orchestra.run.smithi052.stdout:generic/310 101s 2023-09-30T19:19:09.023 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/310 2023-09-30T19:19:09.023 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:09.026 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:09.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:09.076 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-09-30T19:19:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:09.293 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:09.293 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:09.775 INFO:teuthology.orchestra.run.smithi052.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:09.783 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/311 2023-09-30T19:19:09.783 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/311 2023-09-30T19:19:09.783 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:09.794 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:09.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:09.823 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-09-30T19:19:10.096 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:10.100 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:10.101 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:10.234 INFO:teuthology.orchestra.run.smithi052.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:10.238 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/312 2023-09-30T19:19:10.238 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/312 2023-09-30T19:19:10.238 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:10.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:10.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:10.248 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-09-30T19:19:10.448 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:10.452 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:10.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:14.820 INFO:teuthology.orchestra.run.smithi052.stdout:generic/313 4s 2023-09-30T19:19:14.828 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/313 2023-09-30T19:19:14.828 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:14.832 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:14.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:14.846 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-09-30T19:19:15.080 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:15.086 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:15.086 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:15.629 INFO:teuthology.orchestra.run.smithi052.stdout:generic/314 0s 2023-09-30T19:19:15.727 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/314 2023-09-30T19:19:15.728 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:15.728 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:15.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:15.728 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-09-30T19:19:15.981 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:15.986 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:15.986 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:16.964 INFO:teuthology.orchestra.run.smithi052.stdout:generic/315 1s 2023-09-30T19:19:16.971 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/315 2023-09-30T19:19:16.972 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:16.975 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:16.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:16.987 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-09-30T19:19:17.559 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:17.563 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:17.563 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:19.348 INFO:teuthology.orchestra.run.smithi052.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T19:19:19.354 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/316 2023-09-30T19:19:19.354 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/316 2023-09-30T19:19:19.354 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:19.358 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:19.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:19.369 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-09-30T19:19:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:19.982 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:19.982 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:20.159 INFO:teuthology.orchestra.run.smithi052.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:20.164 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/317 2023-09-30T19:19:20.164 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/317 2023-09-30T19:19:20.164 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:20.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:20.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:20.177 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-09-30T19:19:20.383 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:20.387 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:20.387 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:20.496 INFO:teuthology.orchestra.run.smithi052.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:20.501 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/318 2023-09-30T19:19:20.501 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/318 2023-09-30T19:19:20.501 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:20.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:20.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:20.514 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-09-30T19:19:20.709 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:20.713 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:20.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:20.866 INFO:teuthology.orchestra.run.smithi052.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T19:19:20.869 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/319 2023-09-30T19:19:20.869 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/319 2023-09-30T19:19:20.869 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:20.872 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:20.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:20.880 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-09-30T19:19:21.076 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:21.080 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:21.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:21.180 INFO:teuthology.orchestra.run.smithi052.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:21.184 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/320 2023-09-30T19:19:21.184 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/320 2023-09-30T19:19:21.184 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:21.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:21.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:21.195 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-09-30T19:19:21.368 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:21.372 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:21.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:21.524 INFO:teuthology.orchestra.run.smithi052.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:21.529 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/321 2023-09-30T19:19:21.529 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/321 2023-09-30T19:19:21.529 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:21.532 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:21.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:21.541 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-09-30T19:19:21.752 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:21.756 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:21.878 INFO:teuthology.orchestra.run.smithi052.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:19:21.882 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/322 2023-09-30T19:19:21.882 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/322 2023-09-30T19:19:21.882 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:19:21.884 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:21.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:19:21.893 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-09-30T19:19:22.094 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:19:22.099 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:19:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:19:34.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:19:34.369 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:20:04.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:20:04.424 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:20:34.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:20:34.741 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:21:04.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:21:04.788 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:21:23.331 INFO:teuthology.orchestra.run.smithi052.stdout:generic/323 121s 2023-09-30T19:21:23.337 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/323 2023-09-30T19:21:23.338 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:23.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:23.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:23.358 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-09-30T19:21:23.912 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:23.916 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:23.916 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.024 INFO:teuthology.orchestra.run.smithi052.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:24.027 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/324 2023-09-30T19:21:24.027 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/324 2023-09-30T19:21:24.027 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:24.030 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:24.038 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-09-30T19:21:24.219 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:24.223 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:24.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.362 INFO:teuthology.orchestra.run.smithi052.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:24.365 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/325 2023-09-30T19:21:24.366 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/325 2023-09-30T19:21:24.366 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:24.368 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:24.376 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-09-30T19:21:24.552 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:24.556 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:24.556 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.660 INFO:teuthology.orchestra.run.smithi052.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:24.664 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/326 2023-09-30T19:21:24.664 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/326 2023-09-30T19:21:24.664 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:24.666 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:24.675 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-09-30T19:21:24.843 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:24.847 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:24.847 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:24.955 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/327 2023-09-30T19:21:24.955 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/327 2023-09-30T19:21:24.955 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:24.957 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:24.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:24.966 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-09-30T19:21:25.145 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:25.149 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:25.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:25.254 INFO:teuthology.orchestra.run.smithi052.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:25.258 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/328 2023-09-30T19:21:25.258 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/328 2023-09-30T19:21:25.258 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:25.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:25.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:25.268 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-09-30T19:21:25.475 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:25.480 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:25.480 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:25.607 INFO:teuthology.orchestra.run.smithi052.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:25.611 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/329 2023-09-30T19:21:25.611 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/329 2023-09-30T19:21:25.611 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:25.614 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:25.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:25.622 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-09-30T19:21:25.812 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:25.816 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:25.817 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:25.923 INFO:teuthology.orchestra.run.smithi052.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:25.927 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/330 2023-09-30T19:21:25.927 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/330 2023-09-30T19:21:25.927 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:25.929 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:25.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:25.937 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-09-30T19:21:26.115 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:26.120 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:26.120 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:26.238 INFO:teuthology.orchestra.run.smithi052.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:26.242 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/331 2023-09-30T19:21:26.243 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/331 2023-09-30T19:21:26.243 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:26.245 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:26.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:26.254 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-09-30T19:21:26.458 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:26.463 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:26.463 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:26.569 INFO:teuthology.orchestra.run.smithi052.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:26.572 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/332 2023-09-30T19:21:26.573 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/332 2023-09-30T19:21:26.573 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:26.575 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:26.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:26.583 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-09-30T19:21:26.788 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:26.792 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:26.792 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:26.939 INFO:teuthology.orchestra.run.smithi052.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:26.943 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/333 2023-09-30T19:21:26.943 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/333 2023-09-30T19:21:26.943 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:26.946 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:26.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:26.955 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-09-30T19:21:27.157 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:27.163 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:27.163 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:27.273 INFO:teuthology.orchestra.run.smithi052.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:27.277 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/334 2023-09-30T19:21:27.277 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/334 2023-09-30T19:21:27.277 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:27.279 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:27.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:27.288 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-09-30T19:21:27.476 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:27.481 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:27.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:27.607 INFO:teuthology.orchestra.run.smithi052.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:27.611 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/335 2023-09-30T19:21:27.611 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/335 2023-09-30T19:21:27.611 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:27.614 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:27.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:27.622 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-09-30T19:21:27.813 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:27.816 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:27.931 INFO:teuthology.orchestra.run.smithi052.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:27.935 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/336 2023-09-30T19:21:27.935 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/336 2023-09-30T19:21:27.935 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:27.937 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:27.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:27.946 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-09-30T19:21:28.132 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:28.136 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:28.136 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:28.257 INFO:teuthology.orchestra.run.smithi052.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:28.261 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/337 2023-09-30T19:21:28.261 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/337 2023-09-30T19:21:28.261 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:28.264 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:28.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:28.272 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-09-30T19:21:28.460 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:28.464 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:28.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:28.598 INFO:teuthology.orchestra.run.smithi052.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:28.602 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/338 2023-09-30T19:21:28.602 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/338 2023-09-30T19:21:28.602 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:28.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:28.613 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-09-30T19:21:28.792 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:28.797 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:28.797 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:29.014 INFO:teuthology.orchestra.run.smithi052.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:29.018 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/339 2023-09-30T19:21:29.019 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/339 2023-09-30T19:21:29.019 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:29.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:29.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:29.030 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-09-30T19:21:29.227 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:29.232 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:29.232 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:29.339 INFO:teuthology.orchestra.run.smithi052.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:29.343 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/340 2023-09-30T19:21:29.343 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/340 2023-09-30T19:21:29.343 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:29.346 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:29.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:29.355 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-09-30T19:21:29.554 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:29.558 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:29.559 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:29.727 INFO:teuthology.orchestra.run.smithi052.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:29.731 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/341 2023-09-30T19:21:29.731 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/341 2023-09-30T19:21:29.731 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:29.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:29.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:29.742 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-09-30T19:21:29.955 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:29.960 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:29.960 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:30.136 INFO:teuthology.orchestra.run.smithi052.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:30.141 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/342 2023-09-30T19:21:30.141 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/342 2023-09-30T19:21:30.141 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:30.143 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:30.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:30.152 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-09-30T19:21:30.350 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:30.354 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:30.354 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:30.491 INFO:teuthology.orchestra.run.smithi052.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:30.495 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/343 2023-09-30T19:21:30.495 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/343 2023-09-30T19:21:30.495 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:30.497 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:30.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:30.505 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-09-30T19:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:30.805 INFO:teuthology.orchestra.run.smithi052.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:30.809 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/344 2023-09-30T19:21:30.809 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/344 2023-09-30T19:21:30.809 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:30.811 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:30.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:30.820 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-09-30T19:21:31.012 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:31.017 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:31.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:31.119 INFO:teuthology.orchestra.run.smithi052.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:31.123 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/345 2023-09-30T19:21:31.123 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/345 2023-09-30T19:21:31.123 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:31.125 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:31.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:31.134 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-09-30T19:21:31.312 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:31.317 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:31.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:31.425 INFO:teuthology.orchestra.run.smithi052.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:31.429 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/346 2023-09-30T19:21:31.429 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/346 2023-09-30T19:21:31.429 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:31.431 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:31.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:31.440 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-09-30T19:21:31.619 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:31.624 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:31.624 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:31.823 INFO:teuthology.orchestra.run.smithi052.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:31.828 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/347 2023-09-30T19:21:31.828 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/347 2023-09-30T19:21:31.828 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:31.831 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:31.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:31.840 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-09-30T19:21:32.030 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:32.035 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:32.173 INFO:teuthology.orchestra.run.smithi052.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:32.178 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/348 2023-09-30T19:21:32.178 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/348 2023-09-30T19:21:32.178 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:32.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:32.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:32.191 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-09-30T19:21:32.406 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:32.411 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:32.411 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:33.838 INFO:teuthology.orchestra.run.smithi052.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-30T19:21:33.844 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/349 2023-09-30T19:21:33.844 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/349 2023-09-30T19:21:33.844 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:33.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:33.862 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-09-30T19:21:34.089 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:34.093 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:34.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:21:34.919 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:21:36.365 INFO:teuthology.orchestra.run.smithi052.stdout:generic/350 2s 2023-09-30T19:21:36.372 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/350 2023-09-30T19:21:36.373 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:36.376 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:36.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:36.388 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-09-30T19:21:36.626 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:36.631 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:36.631 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:38.051 INFO:teuthology.orchestra.run.smithi052.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-30T19:21:38.058 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/351 2023-09-30T19:21:38.058 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/351 2023-09-30T19:21:38.059 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:38.062 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:38.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:38.075 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-09-30T19:21:38.695 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:38.699 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:38.853 INFO:teuthology.orchestra.run.smithi052.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:38.858 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/352 2023-09-30T19:21:38.858 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/352 2023-09-30T19:21:38.858 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:38.861 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:38.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:38.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-09-30T19:21:39.070 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:39.075 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:39.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:39.191 INFO:teuthology.orchestra.run.smithi052.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:39.195 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/353 2023-09-30T19:21:39.196 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/353 2023-09-30T19:21:39.196 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:39.198 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:39.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:39.206 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-09-30T19:21:39.396 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:39.400 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:39.500 INFO:teuthology.orchestra.run.smithi052.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:39.504 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/354 2023-09-30T19:21:39.504 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/354 2023-09-30T19:21:39.504 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:39.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:39.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:39.515 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-09-30T19:21:39.717 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:39.722 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:39.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:40.502 INFO:teuthology.orchestra.run.smithi052.stdout:generic/355 1s 2023-09-30T19:21:40.508 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/355 2023-09-30T19:21:40.509 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:40.511 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:40.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:40.521 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-09-30T19:21:41.084 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:41.088 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:41.088 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:41.189 INFO:teuthology.orchestra.run.smithi052.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:41.193 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/356 2023-09-30T19:21:41.193 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/356 2023-09-30T19:21:41.193 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:41.195 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:41.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:41.203 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-09-30T19:21:41.414 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:41.418 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:41.418 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:41.602 INFO:teuthology.orchestra.run.smithi052.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:41.606 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/357 2023-09-30T19:21:41.606 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/357 2023-09-30T19:21:41.606 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:41.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:41.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:41.617 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-09-30T19:21:41.826 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:41.831 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:41.831 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:41.939 INFO:teuthology.orchestra.run.smithi052.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:41.942 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/358 2023-09-30T19:21:41.942 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/358 2023-09-30T19:21:41.942 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:41.945 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:41.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:41.953 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-09-30T19:21:42.135 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:42.139 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:42.140 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:42.239 INFO:teuthology.orchestra.run.smithi052.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:42.243 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/359 2023-09-30T19:21:42.243 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/359 2023-09-30T19:21:42.243 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:42.245 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:42.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:42.253 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-09-30T19:21:42.420 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:42.425 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:42.425 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:42.640 INFO:teuthology.orchestra.run.smithi052.stdout:generic/360 0s 2023-09-30T19:21:42.646 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/360 2023-09-30T19:21:42.646 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:42.649 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:42.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:42.658 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-09-30T19:21:42.853 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:42.856 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:42.856 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:42.983 INFO:teuthology.orchestra.run.smithi052.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:42.987 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/361 2023-09-30T19:21:42.987 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/361 2023-09-30T19:21:42.987 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:42.989 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:42.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:42.997 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-09-30T19:21:43.177 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:43.181 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:43.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:43.296 INFO:teuthology.orchestra.run.smithi052.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:43.300 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/362 2023-09-30T19:21:43.300 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/362 2023-09-30T19:21:43.300 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:43.303 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:43.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:43.311 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-09-30T19:21:43.484 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:43.488 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:43.488 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:43.589 INFO:teuthology.orchestra.run.smithi052.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:43.592 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/363 2023-09-30T19:21:43.593 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/363 2023-09-30T19:21:43.593 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:43.595 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:43.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:43.603 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-09-30T19:21:43.793 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:43.797 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:43.797 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:43.899 INFO:teuthology.orchestra.run.smithi052.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:43.903 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/364 2023-09-30T19:21:43.903 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/364 2023-09-30T19:21:43.903 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:43.905 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:43.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:43.914 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-09-30T19:21:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:44.104 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:44.104 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:44.251 INFO:teuthology.orchestra.run.smithi052.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:44.255 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/365 2023-09-30T19:21:44.255 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/365 2023-09-30T19:21:44.255 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:44.257 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:44.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:44.266 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-09-30T19:21:44.453 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:44.457 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:44.457 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:44.558 INFO:teuthology.orchestra.run.smithi052.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:44.562 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/366 2023-09-30T19:21:44.562 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/366 2023-09-30T19:21:44.562 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:44.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:44.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:44.574 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-09-30T19:21:44.751 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:44.756 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:44.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:44.856 INFO:teuthology.orchestra.run.smithi052.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:44.859 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/367 2023-09-30T19:21:44.859 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/367 2023-09-30T19:21:44.859 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:44.862 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:44.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:44.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-09-30T19:21:45.052 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:45.055 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:45.056 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:45.156 INFO:teuthology.orchestra.run.smithi052.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:45.160 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/368 2023-09-30T19:21:45.160 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/368 2023-09-30T19:21:45.160 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:45.162 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:45.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:45.171 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-09-30T19:21:45.364 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:45.369 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:45.369 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:45.546 INFO:teuthology.orchestra.run.smithi052.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:45.550 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/369 2023-09-30T19:21:45.550 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/369 2023-09-30T19:21:45.551 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:45.553 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:45.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:45.563 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-09-30T19:21:45.768 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:45.773 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:45.773 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:45.878 INFO:teuthology.orchestra.run.smithi052.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:45.883 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/370 2023-09-30T19:21:45.883 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/370 2023-09-30T19:21:45.884 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:45.886 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:45.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:45.894 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-09-30T19:21:46.094 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:46.098 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:46.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:46.201 INFO:teuthology.orchestra.run.smithi052.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:46.205 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/371 2023-09-30T19:21:46.205 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/371 2023-09-30T19:21:46.205 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:46.207 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:46.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:46.215 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-09-30T19:21:46.401 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:46.405 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:46.405 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:46.516 INFO:teuthology.orchestra.run.smithi052.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:46.520 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/372 2023-09-30T19:21:46.520 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/372 2023-09-30T19:21:46.520 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:46.522 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:46.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:46.532 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-09-30T19:21:46.946 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:46.951 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:46.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:47.074 INFO:teuthology.orchestra.run.smithi052.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:47.078 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/373 2023-09-30T19:21:47.078 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/373 2023-09-30T19:21:47.079 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:47.081 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:47.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:47.090 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-09-30T19:21:47.278 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:47.283 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:47.283 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:47.498 INFO:teuthology.orchestra.run.smithi052.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:47.503 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/374 2023-09-30T19:21:47.503 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/374 2023-09-30T19:21:47.503 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:47.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:47.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:47.517 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-09-30T19:21:47.731 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:47.736 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:47.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:47.899 INFO:teuthology.orchestra.run.smithi052.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T19:21:47.903 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/375 2023-09-30T19:21:47.903 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/375 2023-09-30T19:21:47.903 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:47.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:47.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:47.915 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-09-30T19:21:48.109 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:48.113 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:48.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:48.259 INFO:teuthology.orchestra.run.smithi052.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:48.263 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/376 2023-09-30T19:21:48.263 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/376 2023-09-30T19:21:48.263 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:48.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:48.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:48.275 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-09-30T19:21:48.464 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:48.468 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:48.469 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:48.573 INFO:teuthology.orchestra.run.smithi052.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:48.577 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/377 2023-09-30T19:21:48.577 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/377 2023-09-30T19:21:48.577 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:48.579 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:48.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:48.588 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-09-30T19:21:48.768 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:48.772 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:48.772 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:49.020 INFO:teuthology.orchestra.run.smithi052.stdout:generic/378 1s 2023-09-30T19:21:49.026 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/378 2023-09-30T19:21:49.026 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:49.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:49.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:49.037 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-09-30T19:21:49.572 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:49.576 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:49.576 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:49.681 INFO:teuthology.orchestra.run.smithi052.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:49.684 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/379 2023-09-30T19:21:49.684 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/379 2023-09-30T19:21:49.685 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:49.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:49.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:49.695 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-09-30T19:21:49.884 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:49.888 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:49.888 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.003 INFO:teuthology.orchestra.run.smithi052.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:50.007 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/380 2023-09-30T19:21:50.007 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/380 2023-09-30T19:21:50.007 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:50.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:50.018 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-09-30T19:21:50.204 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:50.207 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:50.208 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.309 INFO:teuthology.orchestra.run.smithi052.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:50.313 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/381 2023-09-30T19:21:50.313 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/381 2023-09-30T19:21:50.313 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:50.315 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:50.324 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-09-30T19:21:50.516 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:50.519 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:50.520 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.621 INFO:teuthology.orchestra.run.smithi052.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:50.628 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/382 2023-09-30T19:21:50.628 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/382 2023-09-30T19:21:50.628 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:50.628 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:50.635 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-09-30T19:21:50.808 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:50.812 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:50.812 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.926 INFO:teuthology.orchestra.run.smithi052.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:50.930 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/383 2023-09-30T19:21:50.930 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/383 2023-09-30T19:21:50.930 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:50.932 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:50.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:50.940 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-09-30T19:21:51.129 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:51.134 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:51.245 INFO:teuthology.orchestra.run.smithi052.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-30T19:21:51.248 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/384 2023-09-30T19:21:51.248 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/384 2023-09-30T19:21:51.249 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:51.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:51.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:51.260 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-09-30T19:21:51.448 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:51.452 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:51.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:51.602 INFO:teuthology.orchestra.run.smithi052.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:51.606 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/385 2023-09-30T19:21:51.606 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/385 2023-09-30T19:21:51.606 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:51.608 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:51.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:51.616 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-09-30T19:21:51.802 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:51.806 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:51.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:51.952 INFO:teuthology.orchestra.run.smithi052.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-30T19:21:51.957 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/386 2023-09-30T19:21:51.957 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/386 2023-09-30T19:21:51.957 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:51.959 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:51.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:51.967 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-09-30T19:21:52.167 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:52.171 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:52.172 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:52.281 INFO:teuthology.orchestra.run.smithi052.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:52.285 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/387 2023-09-30T19:21:52.285 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/387 2023-09-30T19:21:52.285 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:52.287 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:52.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:52.296 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-09-30T19:21:52.476 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:52.480 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:52.480 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:52.593 INFO:teuthology.orchestra.run.smithi052.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:52.596 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/388 2023-09-30T19:21:52.596 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/388 2023-09-30T19:21:52.596 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:52.599 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:52.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:52.607 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-09-30T19:21:52.784 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:52.788 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:52.788 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:52.900 INFO:teuthology.orchestra.run.smithi052.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-09-30T19:21:52.904 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/389 2023-09-30T19:21:52.904 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/389 2023-09-30T19:21:52.904 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:52.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:52.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:52.915 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-09-30T19:21:53.108 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:53.113 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:53.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:53.265 INFO:teuthology.orchestra.run.smithi052.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:21:53.269 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/390 2023-09-30T19:21:53.269 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/390 2023-09-30T19:21:53.269 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:21:53.271 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:21:53.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:21:53.280 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-09-30T19:21:53.464 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:21:53.468 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:21:53.468 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:05.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:22:05.051 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:22:35.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:22:35.926 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:22:38.642 INFO:teuthology.orchestra.run.smithi052.stdout:generic/391 45s 2023-09-30T19:22:38.794 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/391 2023-09-30T19:22:38.794 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:38.800 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:38.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:38.832 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-09-30T19:22:40.043 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:40.049 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:40.049 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:40.296 INFO:teuthology.orchestra.run.smithi052.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:40.304 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/392 2023-09-30T19:22:40.309 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/392 2023-09-30T19:22:40.309 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:40.313 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:40.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:40.336 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-09-30T19:22:40.606 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:40.610 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:40.610 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:40.790 INFO:teuthology.orchestra.run.smithi052.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:40.795 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/393 2023-09-30T19:22:40.795 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/393 2023-09-30T19:22:40.795 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:40.799 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:40.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:40.811 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-09-30T19:22:41.075 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:41.079 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:41.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:41.333 INFO:teuthology.orchestra.run.smithi052.stdout:generic/394 0s 2023-09-30T19:22:41.341 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/394 2023-09-30T19:22:41.341 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:41.343 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:41.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:41.362 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-09-30T19:22:42.024 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:42.028 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:42.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:42.236 INFO:teuthology.orchestra.run.smithi052.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:42.240 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/395 2023-09-30T19:22:42.240 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/395 2023-09-30T19:22:42.240 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:42.249 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:42.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:42.260 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-09-30T19:22:42.522 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:42.526 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:42.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:42.712 INFO:teuthology.orchestra.run.smithi052.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/396 2023-09-30T19:22:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/396 2023-09-30T19:22:42.717 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:42.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:42.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:42.752 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-09-30T19:22:43.095 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:43.100 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:43.100 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:43.380 INFO:teuthology.orchestra.run.smithi052.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:43.385 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/397 2023-09-30T19:22:43.385 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/397 2023-09-30T19:22:43.385 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:43.388 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:43.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:43.417 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-09-30T19:22:43.801 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:43.805 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:44.091 INFO:teuthology.orchestra.run.smithi052.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:44.096 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/398 2023-09-30T19:22:44.096 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/398 2023-09-30T19:22:44.096 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:44.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:44.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:44.119 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-09-30T19:22:44.477 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:44.484 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:44.484 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:44.676 INFO:teuthology.orchestra.run.smithi052.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:44.683 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/399 2023-09-30T19:22:44.683 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/399 2023-09-30T19:22:44.683 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:44.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:44.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:44.701 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-09-30T19:22:45.065 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:45.070 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:45.070 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:45.236 INFO:teuthology.orchestra.run.smithi052.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-30T19:22:45.241 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/400 2023-09-30T19:22:45.242 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/400 2023-09-30T19:22:45.242 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:45.248 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:45.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:45.263 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-09-30T19:22:45.493 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:45.497 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:45.497 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:45.612 INFO:teuthology.orchestra.run.smithi052.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:45.616 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/401 2023-09-30T19:22:45.616 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/401 2023-09-30T19:22:45.617 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:45.618 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:45.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:45.627 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-09-30T19:22:45.814 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:45.818 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:45.818 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:45.921 INFO:teuthology.orchestra.run.smithi052.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:45.926 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/402 2023-09-30T19:22:45.926 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/402 2023-09-30T19:22:45.926 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:45.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:45.935 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-09-30T19:22:46.113 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:46.117 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:46.118 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:46.224 INFO:teuthology.orchestra.run.smithi052.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:46.227 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/403 2023-09-30T19:22:46.227 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/403 2023-09-30T19:22:46.227 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:46.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:46.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:46.238 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-09-30T19:22:46.436 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:46.440 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:46.440 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:47.490 INFO:teuthology.orchestra.run.smithi052.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-30T19:22:47.494 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/404 2023-09-30T19:22:47.495 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/404 2023-09-30T19:22:47.495 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:47.497 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:47.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:47.507 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-09-30T19:22:48.073 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:48.077 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:48.077 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:48.275 INFO:teuthology.orchestra.run.smithi052.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:48.279 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/405 2023-09-30T19:22:48.279 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/405 2023-09-30T19:22:48.279 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:48.281 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:48.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:48.289 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-09-30T19:22:48.479 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:48.484 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:48.484 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:48.586 INFO:teuthology.orchestra.run.smithi052.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:48.589 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/406 2023-09-30T19:22:48.590 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/406 2023-09-30T19:22:48.590 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:48.592 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:48.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:48.601 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-09-30T19:22:48.792 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:48.796 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:48.796 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:49.005 INFO:teuthology.orchestra.run.smithi052.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:22:49.009 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/407 2023-09-30T19:22:49.009 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/407 2023-09-30T19:22:49.009 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:49.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:49.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:49.021 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-09-30T19:22:49.573 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:49.577 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:49.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:49.743 INFO:teuthology.orchestra.run.smithi052.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T19:22:49.747 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/408 2023-09-30T19:22:49.747 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/408 2023-09-30T19:22:49.747 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:49.749 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:49.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:49.757 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-09-30T19:22:50.312 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:50.316 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:50.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:50.420 INFO:teuthology.orchestra.run.smithi052.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:50.424 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/409 2023-09-30T19:22:50.424 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/409 2023-09-30T19:22:50.424 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:50.426 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:50.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:50.435 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-09-30T19:22:50.608 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:50.613 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:50.613 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:50.717 INFO:teuthology.orchestra.run.smithi052.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:50.721 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/410 2023-09-30T19:22:50.722 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/410 2023-09-30T19:22:50.722 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:50.724 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:50.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:50.733 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-09-30T19:22:50.904 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:50.907 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:50.908 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.012 INFO:teuthology.orchestra.run.smithi052.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:51.015 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/411 2023-09-30T19:22:51.015 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/411 2023-09-30T19:22:51.016 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:51.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:51.026 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-09-30T19:22:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:51.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.334 INFO:teuthology.orchestra.run.smithi052.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:51.338 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/412 2023-09-30T19:22:51.338 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/412 2023-09-30T19:22:51.338 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:51.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:51.348 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-09-30T19:22:51.525 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:51.528 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:51.528 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.660 INFO:teuthology.orchestra.run.smithi052.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:51.664 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/413 2023-09-30T19:22:51.664 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/413 2023-09-30T19:22:51.664 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:51.666 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:51.675 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-09-30T19:22:51.856 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:51.860 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:51.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.960 INFO:teuthology.orchestra.run.smithi052.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:51.964 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/414 2023-09-30T19:22:51.964 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/414 2023-09-30T19:22:51.964 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:51.966 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:51.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:51.974 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-09-30T19:22:52.163 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:52.167 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:52.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:52.267 INFO:teuthology.orchestra.run.smithi052.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:52.271 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/415 2023-09-30T19:22:52.271 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/415 2023-09-30T19:22:52.271 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:52.273 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:52.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:52.281 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-09-30T19:22:52.490 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:52.494 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:52.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:52.681 INFO:teuthology.orchestra.run.smithi052.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:52.686 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/416 2023-09-30T19:22:52.686 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/416 2023-09-30T19:22:52.686 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:52.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:52.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:52.698 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-09-30T19:22:52.895 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:52.900 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:52.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:53.025 INFO:teuthology.orchestra.run.smithi052.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:53.030 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/417 2023-09-30T19:22:53.031 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/417 2023-09-30T19:22:53.031 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:53.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:53.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:53.043 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-09-30T19:22:53.280 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:53.286 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:53.286 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:53.461 INFO:teuthology.orchestra.run.smithi052.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-09-30T19:22:53.465 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/418 2023-09-30T19:22:53.465 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/418 2023-09-30T19:22:53.465 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:53.468 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:53.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:53.477 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-09-30T19:22:53.686 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:53.690 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:53.691 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:53.831 INFO:teuthology.orchestra.run.smithi052.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:53.834 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/419 2023-09-30T19:22:53.835 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/419 2023-09-30T19:22:53.835 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:53.837 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:53.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:53.846 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-09-30T19:22:54.024 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:54.028 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:54.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:55.449 INFO:teuthology.orchestra.run.smithi052.stdout:generic/420 1s 2023-09-30T19:22:55.456 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/420 2023-09-30T19:22:55.457 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:55.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:55.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:55.472 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-09-30T19:22:56.064 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:56.068 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:56.068 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:56.199 INFO:teuthology.orchestra.run.smithi052.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:56.203 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/421 2023-09-30T19:22:56.203 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/421 2023-09-30T19:22:56.203 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:56.205 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:56.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:56.214 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-09-30T19:22:56.392 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:56.396 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:56.396 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:56.500 INFO:teuthology.orchestra.run.smithi052.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:56.503 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/422 2023-09-30T19:22:56.503 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/422 2023-09-30T19:22:56.504 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:56.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:56.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:56.514 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-09-30T19:22:56.692 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:56.696 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:56.696 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:57.037 INFO:teuthology.orchestra.run.smithi052.stdout:generic/423 1s 2023-09-30T19:22:57.042 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/423 2023-09-30T19:22:57.043 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:57.045 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:57.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:57.054 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-09-30T19:22:57.595 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:57.599 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:57.600 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:57.744 INFO:teuthology.orchestra.run.smithi052.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-09-30T19:22:57.747 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/424 2023-09-30T19:22:57.748 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/424 2023-09-30T19:22:57.748 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:57.750 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:57.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:57.759 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-09-30T19:22:57.949 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:57.953 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:57.953 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:58.062 INFO:teuthology.orchestra.run.smithi052.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:22:58.065 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/425 2023-09-30T19:22:58.065 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/425 2023-09-30T19:22:58.065 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:22:58.067 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:22:58.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:22:58.076 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-09-30T19:22:58.245 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:22:58.249 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:22:58.249 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:23:05.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:23:05.995 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:23:36.049 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:23:36.052 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:24:06.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:24:06.796 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:24:13.473 INFO:teuthology.orchestra.run.smithi052.stdout:generic/426 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/426.out.bad) 2023-09-30T19:24:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/426.out 2023-09-30 16:50:24.698064307 +0000 2023-09-30T19:24:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/426.out.bad 2023-09-30 19:24:13.467132230 +0000 2023-09-30T19:24:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,5 +1,541 @@ 2023-09-30T19:24:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 426 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/426-dir -d 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000488) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000489) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000490) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000491) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000492) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000493) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000494) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000495) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000496) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000497) opened an unlinked file! 2023-09-30T19:24:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000498) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000499) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000500) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000501) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000502) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000503) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000504) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000505) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000506) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000507) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000508) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000509) opened an unlinked file! 2023-09-30T19:24:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000510) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000511) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000512) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000513) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000514) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000515) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000516) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000517) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000518) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000519) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000520) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000521) opened an unlinked file! 2023-09-30T19:24:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000522) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000523) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000524) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000525) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000526) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000527) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000528) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000529) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000530) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000531) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000532) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000533) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000534) opened an unlinked file! 2023-09-30T19:24:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000535) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000536) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000537) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000538) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000539) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000540) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000541) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000542) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000543) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000544) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000545) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000546) opened an unlinked file! 2023-09-30T19:24:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000547) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000548) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000549) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000550) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000551) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000552) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000553) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000554) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000555) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000556) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000557) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000558) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000559) opened an unlinked file! 2023-09-30T19:24:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000560) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000561) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000562) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000563) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000564) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000565) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000566) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000567) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000568) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000569) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000570) opened an unlinked file! 2023-09-30T19:24:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000571) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000572) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000573) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000574) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000575) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000576) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000577) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000578) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000579) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000580) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000581) opened an unlinked file! 2023-09-30T19:24:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000582) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000583) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000584) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000585) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000586) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000587) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000588) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000589) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000590) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000591) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000592) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000593) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000594) opened an unlinked file! 2023-09-30T19:24:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000595) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000596) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000597) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000598) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000599) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000600) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000601) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000602) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000603) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000604) opened an unlinked file! 2023-09-30T19:24:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000605) opened an unlinked file! 2023-09-30T19:24:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000606) opened an unlinked file! 2023-09-30T19:24:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000607) opened an unlinked file! 2023-09-30T19:24:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000608) opened an unlinked file! 2023-09-30T19:24:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000609) opened an unlinked file! 2023-09-30T19:24:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000610) opened an unlinked file! 2023-09-30T19:24:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000611) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000612) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000613) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000614) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000615) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000616) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000617) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000618) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000619) opened an unlinked file! 2023-09-30T19:24:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000620) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000621) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000622) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000623) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000624) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000625) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000626) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000627) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000628) opened an unlinked file! 2023-09-30T19:24:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000629) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000630) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000631) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000632) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000633) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000634) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000635) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000636) opened an unlinked file! 2023-09-30T19:24:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000637) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000638) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000639) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000640) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000641) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000642) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000643) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000644) opened an unlinked file! 2023-09-30T19:24:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000645) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000646) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000647) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000648) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000649) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000650) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000651) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000652) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000653) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000654) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000655) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000656) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000657) opened an unlinked file! 2023-09-30T19:24:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000658) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000659) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000660) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000661) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000662) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000663) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000664) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000665) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000666) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000667) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000668) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000669) opened an unlinked file! 2023-09-30T19:24:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000670) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000671) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000672) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000673) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000674) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000675) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000676) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000677) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000678) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000679) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000680) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000681) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000682) opened an unlinked file! 2023-09-30T19:24:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000683) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000684) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000685) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000686) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000687) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000688) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000689) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000690) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000691) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000692) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000693) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000694) opened an unlinked file! 2023-09-30T19:24:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000695) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000696) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000697) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000698) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000699) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000700) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000701) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000702) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000703) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000704) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000705) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000706) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000707) opened an unlinked file! 2023-09-30T19:24:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000708) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000709) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000710) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000711) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000712) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000713) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000714) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000715) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000716) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000717) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000718) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000719) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000720) opened an unlinked file! 2023-09-30T19:24:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000721) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000722) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000723) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000724) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000725) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000726) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000727) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000728) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000729) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000730) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000731) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000732) opened an unlinked file! 2023-09-30T19:24:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000733) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000734) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000735) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000736) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000737) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000738) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000739) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000740) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000741) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000742) opened an unlinked file! 2023-09-30T19:24:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000743) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000744) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000745) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000746) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000747) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000748) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000749) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000750) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000751) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000752) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000753) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000754) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000755) opened an unlinked file! 2023-09-30T19:24:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000756) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000757) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000758) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000759) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000760) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000761) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000762) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000763) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000764) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000765) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000766) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000767) opened an unlinked file! 2023-09-30T19:24:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000768) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000769) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000770) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000771) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000772) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000773) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000774) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000775) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000776) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000777) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000778) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000779) opened an unlinked file! 2023-09-30T19:24:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000780) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000781) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000782) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000783) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000784) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000785) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000786) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000787) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000788) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000789) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000790) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000791) opened an unlinked file! 2023-09-30T19:24:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000792) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000793) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000794) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000795) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000796) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000797) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000798) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000799) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000800) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000801) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000802) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000803) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000804) opened an unlinked file! 2023-09-30T19:24:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000805) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000806) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000807) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000808) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000809) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000810) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000811) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000812) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000813) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000814) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000815) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000816) opened an unlinked file! 2023-09-30T19:24:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000817) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000818) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000819) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000820) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000821) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000822) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000823) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000824) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000825) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000826) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000827) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000828) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000829) opened an unlinked file! 2023-09-30T19:24:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000830) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000831) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000832) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000833) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000834) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000835) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000836) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000837) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000838) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000839) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000840) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000841) opened an unlinked file! 2023-09-30T19:24:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000842) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000843) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000844) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000845) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000846) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000847) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000848) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000849) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000850) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000851) opened an unlinked file! 2023-09-30T19:24:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000852) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000853) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000854) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000855) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000856) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000857) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000858) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000859) opened an unlinked file! 2023-09-30T19:24:13.528 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000860) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000861) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000862) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000863) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000864) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000865) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000866) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000867) opened an unlinked file! 2023-09-30T19:24:13.529 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000868) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000869) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000870) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000871) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000872) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000873) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000874) opened an unlinked file! 2023-09-30T19:24:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000875) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000876) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000877) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000878) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000879) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000880) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000881) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000882) opened an unlinked file! 2023-09-30T19:24:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000883) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000884) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000885) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000886) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000887) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000888) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000889) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000890) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000891) opened an unlinked file! 2023-09-30T19:24:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000892) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000893) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000894) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000895) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000896) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000897) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000898) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000899) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000900) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000901) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000902) opened an unlinked file! 2023-09-30T19:24:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000903) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000904) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000905) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000906) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000907) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000908) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000909) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000910) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000911) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000912) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000913) opened an unlinked file! 2023-09-30T19:24:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000914) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000915) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000916) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000917) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000918) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000919) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000920) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000921) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000922) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000923) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000924) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000925) opened an unlinked file! 2023-09-30T19:24:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000926) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000927) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000928) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000929) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000930) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000931) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000932) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000933) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000934) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000935) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000936) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000937) opened an unlinked file! 2023-09-30T19:24:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000938) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000939) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000940) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000941) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000942) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000943) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000944) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000945) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000946) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000947) opened an unlinked file! 2023-09-30T19:24:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000948) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000949) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000950) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000951) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000952) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000953) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000954) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000955) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000956) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000957) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000958) opened an unlinked file! 2023-09-30T19:24:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000959) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000960) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000961) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000962) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000963) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000964) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000965) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000966) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000967) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000968) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000969) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000970) opened an unlinked file! 2023-09-30T19:24:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000971) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000972) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000973) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000974) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000975) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000976) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000977) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000978) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000979) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000980) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000981) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000982) opened an unlinked file! 2023-09-30T19:24:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000983) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000984) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000985) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000986) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000987) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000988) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000989) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000990) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000991) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000992) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000993) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000994) opened an unlinked file! 2023-09-30T19:24:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000995) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000996) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000997) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000998) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file000999) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001000) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001001) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001002) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001003) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001004) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001005) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001006) opened an unlinked file! 2023-09-30T19:24:13.542 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001007) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001008) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001009) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001010) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001011) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001012) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001013) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001014) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001015) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001016) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001017) opened an unlinked file! 2023-09-30T19:24:13.543 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001018) opened an unlinked file! 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001019) opened an unlinked file! 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001020) opened an unlinked file! 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001021) opened an unlinked file! 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001022) opened an unlinked file! 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/426-dir/file001023) opened an unlinked file! 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/426-dir 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/426-dir -l 2023-09-30T19:24:13.544 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/426-dir -u 2023-09-30T19:24:13.545 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/426 2023-09-30T19:24:13.545 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/426 2023-09-30T19:24:13.545 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:24:13.549 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:13.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:24:13.642 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:24:13.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:24:13.643 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-09-30T19:24:15.235 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:15.241 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:15.241 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:15.456 INFO:teuthology.orchestra.run.smithi052.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:24:15.461 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/427 2023-09-30T19:24:15.461 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/427 2023-09-30T19:24:15.461 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:15.465 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:15.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:15.475 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-09-30T19:24:15.698 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:15.703 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:15.703 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:15.956 INFO:teuthology.orchestra.run.smithi052.stdout:generic/428 0s 2023-09-30T19:24:15.964 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/428 2023-09-30T19:24:15.964 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:15.968 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:15.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:15.979 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-09-30T19:24:16.208 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:16.212 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:16.375 INFO:teuthology.orchestra.run.smithi052.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:24:16.379 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/429 2023-09-30T19:24:16.379 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/429 2023-09-30T19:24:16.379 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:16.382 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:16.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:16.391 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-09-30T19:24:16.593 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:16.597 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:16.598 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:16.914 INFO:teuthology.orchestra.run.smithi052.stdout:generic/430 0s 2023-09-30T19:24:16.919 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/430 2023-09-30T19:24:16.919 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:16.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:16.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:16.929 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-09-30T19:24:17.492 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:17.496 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:17.496 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:17.764 INFO:teuthology.orchestra.run.smithi052.stdout:generic/431 0s 2023-09-30T19:24:17.769 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/431 2023-09-30T19:24:17.769 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:17.771 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:17.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:17.780 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-09-30T19:24:18.336 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:generic/432 0s 2023-09-30T19:24:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/432 2023-09-30T19:24:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:18.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:18.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:18.648 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-09-30T19:24:19.176 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:19.180 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:19.180 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:19.411 INFO:teuthology.orchestra.run.smithi052.stdout:generic/433 0s 2023-09-30T19:24:19.416 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/433 2023-09-30T19:24:19.417 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:19.419 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:19.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:19.427 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-09-30T19:24:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:19.959 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:20.211 INFO:teuthology.orchestra.run.smithi052.stdout:generic/434 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/434.out.bad) 2023-09-30T19:24:20.213 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/434.out 2023-09-30 16:50:24.702064271 +0000 2023-09-30T19:24:20.213 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/434.out.bad 2023-09-30 19:24:20.207048575 +0000 2023-09-30T19:24:20.213 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -9,6 +9,6 @@ 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: copy_range: Bad file descriptor 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: Try to copy to a device 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: -copy_range: Invalid argument 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: +/tmp/tmp.NXbAzGS4G1test/test-434/dev1: Permission denied 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: Try to copy to a fifo 2023-09-30T19:24:20.214 INFO:teuthology.orchestra.run.smithi052.stdout: copy_range: Invalid argument 2023-09-30T19:24:20.216 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/434 2023-09-30T19:24:20.216 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/434 2023-09-30T19:24:20.216 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:24:20.218 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:20.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:24:20.226 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:24:20.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:24:20.226 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-09-30T19:24:20.760 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:20.764 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:20.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:20.904 INFO:teuthology.orchestra.run.smithi052.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:24:20.907 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/435 2023-09-30T19:24:20.908 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/435 2023-09-30T19:24:20.908 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:20.910 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:20.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:20.919 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-09-30T19:24:21.124 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:21.128 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:21.128 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:23.178 INFO:teuthology.orchestra.run.smithi052.stdout:generic/436 2s 2023-09-30T19:24:23.186 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/436 2023-09-30T19:24:23.186 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:23.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:23.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:23.202 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-09-30T19:24:23.776 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:23.780 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:23.780 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:24.669 INFO:teuthology.orchestra.run.smithi052.stdout:generic/437 1s 2023-09-30T19:24:24.675 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/437 2023-09-30T19:24:24.675 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:24:24.679 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:24.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:24:24.689 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-09-30T19:24:24.923 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:24:24.928 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:24:24.928 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:24:37.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:24:37.429 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:25:07.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:25:07.513 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:25:37.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:25:37.560 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:25:58.660 INFO:teuthology.orchestra.run.smithi052.stdout:generic/438 94s 2023-09-30T19:25:58.667 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/438 2023-09-30T19:25:58.667 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:25:58.670 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:58.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:25:58.682 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-09-30T19:25:58.917 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:25:58.923 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:25:58.923 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:59.055 INFO:teuthology.orchestra.run.smithi052.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:25:59.060 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/439 2023-09-30T19:25:59.060 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/439 2023-09-30T19:25:59.060 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:25:59.062 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:59.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:25:59.072 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-09-30T19:25:59.308 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:25:59.313 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:25:59.313 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:59.452 INFO:teuthology.orchestra.run.smithi052.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:25:59.456 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/440 2023-09-30T19:25:59.456 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/440 2023-09-30T19:25:59.456 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:25:59.458 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:59.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:25:59.467 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-09-30T19:25:59.656 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:25:59.660 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:25:59.660 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:59.826 INFO:teuthology.orchestra.run.smithi052.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:25:59.830 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/441 2023-09-30T19:25:59.830 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/441 2023-09-30T19:25:59.830 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:25:59.832 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:25:59.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:25:59.841 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-09-30T19:26:00.036 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:00.041 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:00.041 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:00.166 INFO:teuthology.orchestra.run.smithi052.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:00.170 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/442 2023-09-30T19:26:00.170 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/442 2023-09-30T19:26:00.171 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:00.173 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:00.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:00.182 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-09-30T19:26:00.369 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:00.373 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:00.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:00.546 INFO:teuthology.orchestra.run.smithi052.stdout:generic/443 0s 2023-09-30T19:26:00.552 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/443 2023-09-30T19:26:00.552 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:00.554 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:00.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:00.562 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-09-30T19:26:00.743 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:00.748 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:00.748 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:00.915 INFO:teuthology.orchestra.run.smithi052.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T19:26:00.919 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/444 2023-09-30T19:26:00.919 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/444 2023-09-30T19:26:00.919 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:00.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:00.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:00.929 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-09-30T19:26:01.136 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:01.140 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:01.140 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:03.279 INFO:teuthology.orchestra.run.smithi052.stdout:generic/445 2s 2023-09-30T19:26:03.287 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/445 2023-09-30T19:26:03.287 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:03.291 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:03.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:03.304 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-09-30T19:26:03.901 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:03.906 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:03.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:04.016 INFO:teuthology.orchestra.run.smithi052.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:04.020 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/446 2023-09-30T19:26:04.020 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/446 2023-09-30T19:26:04.020 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:04.022 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:04.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:04.030 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-09-30T19:26:04.220 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:04.224 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:04.224 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:04.335 INFO:teuthology.orchestra.run.smithi052.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:04.338 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/447 2023-09-30T19:26:04.339 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/447 2023-09-30T19:26:04.339 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:04.341 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:04.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:04.349 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-09-30T19:26:04.542 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:04.546 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:04.546 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:06.516 INFO:teuthology.orchestra.run.smithi052.stdout:generic/448 2s 2023-09-30T19:26:06.524 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/448 2023-09-30T19:26:06.524 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:06.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:06.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:06.540 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-09-30T19:26:07.109 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:07.113 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:07.113 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:07.217 INFO:teuthology.orchestra.run.smithi052.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:07.220 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/449 2023-09-30T19:26:07.220 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/449 2023-09-30T19:26:07.220 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:07.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:07.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:07.231 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-09-30T19:26:07.436 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:07.440 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:07.440 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:07.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:26:07.665 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:26:09.431 INFO:teuthology.orchestra.run.smithi052.stdout:generic/450 2s 2023-09-30T19:26:09.439 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/450 2023-09-30T19:26:09.439 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:09.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:09.458 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-09-30T19:26:10.061 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:10.244 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:10.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:10.552 INFO:teuthology.orchestra.run.smithi052.stdout:generic/451 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/451.out.bad) 2023-09-30T19:26:10.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:26:10.612 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/451.out 2023-09-30 16:50:24.702064271 +0000 2023-09-30T19:26:10.612 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/451.out.bad 2023-09-30 19:26:10.553681950 +0000 2023-09-30T19:26:10.612 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,2 +1,5 @@ 2023-09-30T19:26:10.612 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 451 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout: +get stale data from buffer read 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout: +000a0000 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout: Silence is golden 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/451 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/451 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:26:10.613 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:10.613 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:26:10.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:26:10.614 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-09-30T19:26:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:11.127 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:11.127 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:11.253 INFO:teuthology.orchestra.run.smithi052.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:11.289 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/452 2023-09-30T19:26:11.289 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/452 2023-09-30T19:26:11.289 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:11.290 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:11.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:11.291 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-09-30T19:26:11.491 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:11.495 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:11.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:11.595 INFO:teuthology.orchestra.run.smithi052.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:11.630 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/453 2023-09-30T19:26:11.630 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/453 2023-09-30T19:26:11.631 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:11.631 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:11.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:11.631 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-09-30T19:26:11.831 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:11.836 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:11.836 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:11.935 INFO:teuthology.orchestra.run.smithi052.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:11.984 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/454 2023-09-30T19:26:11.984 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/454 2023-09-30T19:26:11.984 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:11.984 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:11.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:11.984 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-09-30T19:26:12.182 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:12.186 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:12.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:12.387 INFO:teuthology.orchestra.run.smithi052.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:12.467 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/455 2023-09-30T19:26:12.467 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/455 2023-09-30T19:26:12.467 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:12.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:12.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:12.467 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-09-30T19:26:12.672 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:12.677 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:12.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:12.815 INFO:teuthology.orchestra.run.smithi052.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:12.818 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/456 2023-09-30T19:26:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/456 2023-09-30T19:26:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:12.821 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:12.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:12.829 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-09-30T19:26:13.016 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:13.020 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:13.020 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:13.240 INFO:teuthology.orchestra.run.smithi052.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:13.260 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/457 2023-09-30T19:26:13.260 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/457 2023-09-30T19:26:13.260 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:13.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:13.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:13.261 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-09-30T19:26:13.449 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:13.453 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:13.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:13.559 INFO:teuthology.orchestra.run.smithi052.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:13.583 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/458 2023-09-30T19:26:13.583 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/458 2023-09-30T19:26:13.583 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:13.583 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:13.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:13.584 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-09-30T19:26:13.796 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:13.800 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:13.800 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:14.094 INFO:teuthology.orchestra.run.smithi052.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:14.099 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/459 2023-09-30T19:26:14.100 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/459 2023-09-30T19:26:14.100 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:14.103 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:14.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:14.116 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-09-30T19:26:14.369 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:14.451 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:14.451 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:14.515 INFO:teuthology.orchestra.run.smithi052.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:14.561 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/460 2023-09-30T19:26:14.561 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/460 2023-09-30T19:26:14.561 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:14.562 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:14.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:14.562 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-09-30T19:26:14.772 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:14.776 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:14.777 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:14.938 INFO:teuthology.orchestra.run.smithi052.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:15.088 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/461 2023-09-30T19:26:15.089 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/461 2023-09-30T19:26:15.089 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:15.089 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:15.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:15.089 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-09-30T19:26:15.477 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:15.509 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:15.509 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:15.622 INFO:teuthology.orchestra.run.smithi052.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:15.627 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/462 2023-09-30T19:26:15.627 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/462 2023-09-30T19:26:15.627 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:15.630 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:15.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:15.681 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-09-30T19:26:15.909 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:15.914 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:15.914 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:16.131 INFO:teuthology.orchestra.run.smithi052.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-30T19:26:16.155 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/463 2023-09-30T19:26:16.155 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/463 2023-09-30T19:26:16.155 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:16.155 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:16.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:16.156 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-09-30T19:26:16.710 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:16.714 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:16.768 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:16.821 INFO:teuthology.orchestra.run.smithi052.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:16.824 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/464 2023-09-30T19:26:16.824 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/464 2023-09-30T19:26:16.824 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:16.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:16.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:16.835 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-09-30T19:26:17.007 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:17.075 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:17.076 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:37.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:26:37.773 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:26:40.740 INFO:teuthology.orchestra.run.smithi052.stdout:generic/465 23s 2023-09-30T19:26:40.751 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/465 2023-09-30T19:26:40.751 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:40.755 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:40.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:40.892 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-09-30T19:26:41.304 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:41.309 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:41.310 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:41.422 INFO:teuthology.orchestra.run.smithi052.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:41.425 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/466 2023-09-30T19:26:41.425 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/466 2023-09-30T19:26:41.425 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:41.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:41.435 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-09-30T19:26:41.632 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:41.636 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:41.636 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:48.983 INFO:teuthology.orchestra.run.smithi052.stdout:generic/467 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/467.out.bad) 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/467.out 2023-09-30 16:50:24.702064271 +0000 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/467.out.bad 2023-09-30 19:26:48.969207479 +0000 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,5 +1,15 @@ 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 467 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000000) opened an unlinked file! 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000001) opened an unlinked file! 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000002) opened an unlinked file! 2023-09-30T19:26:49.000 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000003) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000004) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000005) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000006) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000007) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000008) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: +open_by_handle(/tmp/tmp.NXbAzGS4G1test/467-dir/file000009) opened an unlinked file! 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-09-30T19:26:49.001 INFO:teuthology.orchestra.run.smithi052.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-09-30T19:26:49.012 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/467 2023-09-30T19:26:49.012 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/467 2023-09-30T19:26:49.012 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:26:49.055 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:49.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:26:49.128 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:26:49.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:26:49.128 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-09-30T19:26:50.717 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:50.722 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:50.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:50.994 INFO:teuthology.orchestra.run.smithi052.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:50.999 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/468 2023-09-30T19:26:50.999 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/468 2023-09-30T19:26:50.999 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:51.003 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:51.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:51.014 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-09-30T19:26:51.241 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:51.246 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:51.247 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:54.579 INFO:teuthology.orchestra.run.smithi052.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-30T19:26:54.584 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/469 2023-09-30T19:26:54.585 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/469 2023-09-30T19:26:54.585 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:54.589 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:54.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:54.601 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-09-30T19:26:55.198 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:55.203 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:55.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:55.397 INFO:teuthology.orchestra.run.smithi052.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:55.403 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/470 2023-09-30T19:26:55.403 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/470 2023-09-30T19:26:55.403 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:55.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:55.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:55.417 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-09-30T19:26:55.654 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:55.659 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:55.659 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:55.832 INFO:teuthology.orchestra.run.smithi052.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:55.837 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/472 2023-09-30T19:26:55.837 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/472 2023-09-30T19:26:55.837 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:55.840 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:55.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:55.850 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-09-30T19:26:56.083 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:56.088 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:56.088 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:56.325 INFO:teuthology.orchestra.run.smithi052.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-30T19:26:56.330 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/473 2023-09-30T19:26:56.330 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/473 2023-09-30T19:26:56.330 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:56.333 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:56.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:56.343 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-09-30T19:26:56.566 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:56.571 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:56.571 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:56.761 INFO:teuthology.orchestra.run.smithi052.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:56.765 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/474 2023-09-30T19:26:56.766 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/474 2023-09-30T19:26:56.766 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:56.769 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:56.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:56.779 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-09-30T19:26:56.995 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:57.000 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:57.000 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:57.134 INFO:teuthology.orchestra.run.smithi052.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/475 2023-09-30T19:26:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/475 2023-09-30T19:26:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:57.141 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:57.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:57.150 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-09-30T19:26:57.346 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:57.350 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:57.350 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:57.470 INFO:teuthology.orchestra.run.smithi052.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:26:57.474 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/476 2023-09-30T19:26:57.474 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/476 2023-09-30T19:26:57.475 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:26:57.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:26:57.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:26:57.485 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-09-30T19:26:57.703 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:26:57.707 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:26:57.707 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:05.976 INFO:teuthology.orchestra.run.smithi052.stdout:generic/477 8s 2023-09-30T19:27:06.136 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/477 2023-09-30T19:27:06.137 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:06.142 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:06.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:06.200 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-09-30T19:27:07.571 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:07.576 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:07.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:07.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:27:07.827 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:27:18.323 INFO:teuthology.orchestra.run.smithi052.stdout:generic/478 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/478.out.bad) 2023-09-30T19:27:18.326 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/478.out 2023-09-30 16:50:24.702064271 +0000 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/478.out.bad 2023-09-30 19:27:18.320845392 +0000 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -3,14 +3,14 @@ 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: get wrlck 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: get wrlck 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: -lock could be placed 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: +get wrlck 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: get wrlck 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.327 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: get wrlck 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: -lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: +get wrlck 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -25,7 +25,7 @@ 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: get wrlck 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.328 INFO:teuthology.orchestra.run.smithi052.stdout: -lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: +get wrlck 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -37,7 +37,7 @@ 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: get rdlck 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: get rdlck 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: -lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: +get rdlck 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: get rdlck 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.329 INFO:teuthology.orchestra.run.smithi052.stdout: get rdlck 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -46,7 +46,7 @@ 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: get rdlck 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: get rdlck 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: -lock could be placed 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: +get rdlck 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.330 INFO:teuthology.orchestra.run.smithi052.stdout: lock could be placed 2023-09-30T19:27:18.331 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/478 2023-09-30T19:27:18.331 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/478 2023-09-30T19:27:18.331 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:27:18.334 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:18.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:27:18.346 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:27:18.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:27:18.347 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-09-30T19:27:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:18.594 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:18.769 INFO:teuthology.orchestra.run.smithi052.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/479 2023-09-30T19:27:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/479 2023-09-30T19:27:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:18.777 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:18.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:18.787 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-09-30T19:27:19.009 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:19.014 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:19.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:19.152 INFO:teuthology.orchestra.run.smithi052.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:19.156 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/480 2023-09-30T19:27:19.157 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/480 2023-09-30T19:27:19.157 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:19.159 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:19.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:19.169 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-09-30T19:27:19.374 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:19.379 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:19.516 INFO:teuthology.orchestra.run.smithi052.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:19.520 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/481 2023-09-30T19:27:19.520 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/481 2023-09-30T19:27:19.520 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:19.523 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:19.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:19.532 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-09-30T19:27:19.739 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:19.743 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:19.743 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/482 2023-09-30T19:27:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/482 2023-09-30T19:27:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:19.977 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:19.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:19.986 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-09-30T19:27:20.194 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:20.198 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:20.198 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:20.323 INFO:teuthology.orchestra.run.smithi052.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:20.326 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/483 2023-09-30T19:27:20.327 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/483 2023-09-30T19:27:20.327 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:20.329 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:20.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:20.337 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-09-30T19:27:20.533 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:20.537 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:20.537 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:20.664 INFO:teuthology.orchestra.run.smithi052.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:20.668 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/484 2023-09-30T19:27:20.668 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/484 2023-09-30T19:27:20.668 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:20.670 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:20.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:20.682 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-09-30T19:27:20.864 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:20.868 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:20.868 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:21.850 INFO:teuthology.orchestra.run.smithi052.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-30T19:27:21.856 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/485 2023-09-30T19:27:21.856 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/485 2023-09-30T19:27:21.856 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:21.859 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:21.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:21.869 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-09-30T19:27:22.416 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:22.420 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:22.420 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:22.609 INFO:teuthology.orchestra.run.smithi052.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:22.613 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/486 2023-09-30T19:27:22.613 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/486 2023-09-30T19:27:22.613 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:22.615 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:22.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:22.623 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-09-30T19:27:22.812 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:22.816 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:22.816 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:22.938 INFO:teuthology.orchestra.run.smithi052.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:22.942 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/487 2023-09-30T19:27:22.942 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/487 2023-09-30T19:27:22.942 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:22.945 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:22.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:22.952 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-09-30T19:27:23.136 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:23.140 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:23.140 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:23.242 INFO:teuthology.orchestra.run.smithi052.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:23.246 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/488 2023-09-30T19:27:23.246 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/488 2023-09-30T19:27:23.246 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:23.248 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:23.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:23.256 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-09-30T19:27:23.436 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:23.440 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:23.440 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:23.583 INFO:teuthology.orchestra.run.smithi052.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:23.586 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/489 2023-09-30T19:27:23.586 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/489 2023-09-30T19:27:23.586 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:23.589 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:23.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:23.596 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-09-30T19:27:23.792 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:23.796 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:23.796 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:25.570 INFO:teuthology.orchestra.run.smithi052.stdout:generic/490 2s 2023-09-30T19:27:25.578 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/490 2023-09-30T19:27:25.578 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:25.582 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:25.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:25.594 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-09-30T19:27:26.182 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:26.187 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:26.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:26.313 INFO:teuthology.orchestra.run.smithi052.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:26.317 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/491 2023-09-30T19:27:26.317 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/491 2023-09-30T19:27:26.318 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:26.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:26.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:26.328 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-09-30T19:27:26.520 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:26.524 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:26.524 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:26.623 INFO:teuthology.orchestra.run.smithi052.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:26.627 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/492 2023-09-30T19:27:26.627 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/492 2023-09-30T19:27:26.627 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:26.629 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:26.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:26.637 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-09-30T19:27:26.821 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:26.825 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:26.825 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:26.932 INFO:teuthology.orchestra.run.smithi052.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:26.936 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/493 2023-09-30T19:27:26.936 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/493 2023-09-30T19:27:26.936 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:26.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:26.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:26.947 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-09-30T19:27:27.145 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:27.149 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:27.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:27.254 INFO:teuthology.orchestra.run.smithi052.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:27.258 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/494 2023-09-30T19:27:27.258 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/494 2023-09-30T19:27:27.259 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:27.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:27.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:27.269 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-09-30T19:27:27.460 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:27.464 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:27.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:27.565 INFO:teuthology.orchestra.run.smithi052.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:27.569 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/495 2023-09-30T19:27:27.569 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/495 2023-09-30T19:27:27.569 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:27.571 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:27.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:27.579 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-09-30T19:27:27.743 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:27.747 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:27.747 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:27.855 INFO:teuthology.orchestra.run.smithi052.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:27.858 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/496 2023-09-30T19:27:27.858 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/496 2023-09-30T19:27:27.858 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:27.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:27.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:27.868 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-09-30T19:27:28.064 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:28.068 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:28.068 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:28.178 INFO:teuthology.orchestra.run.smithi052.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:28.182 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/497 2023-09-30T19:27:28.182 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/497 2023-09-30T19:27:28.182 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:28.184 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:28.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:28.193 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-09-30T19:27:28.377 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:28.382 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:28.382 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:28.507 INFO:teuthology.orchestra.run.smithi052.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:28.511 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/498 2023-09-30T19:27:28.511 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/498 2023-09-30T19:27:28.511 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:28.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:28.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:28.521 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-09-30T19:27:28.711 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:28.715 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:28.715 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:28.817 INFO:teuthology.orchestra.run.smithi052.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:28.820 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/499 2023-09-30T19:27:28.820 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/499 2023-09-30T19:27:28.820 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:28.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:28.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:28.832 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-09-30T19:27:28.999 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:29.003 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:29.004 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:29.187 INFO:teuthology.orchestra.run.smithi052.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:29.191 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/500 2023-09-30T19:27:29.191 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/500 2023-09-30T19:27:29.191 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:29.193 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:29.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:29.202 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-09-30T19:27:29.376 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:29.381 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:29.381 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:29.494 INFO:teuthology.orchestra.run.smithi052.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:29.498 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/501 2023-09-30T19:27:29.498 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/501 2023-09-30T19:27:29.498 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:29.501 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:29.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:29.509 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-09-30T19:27:29.682 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:29.686 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:29.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:29.811 INFO:teuthology.orchestra.run.smithi052.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:29.815 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/502 2023-09-30T19:27:29.815 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/502 2023-09-30T19:27:29.815 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:29.818 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:29.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:29.826 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-09-30T19:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:30.131 INFO:teuthology.orchestra.run.smithi052.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:30.135 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/503 2023-09-30T19:27:30.135 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/503 2023-09-30T19:27:30.135 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:30.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:30.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:30.146 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-09-30T19:27:30.328 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:30.332 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:30.532 INFO:teuthology.orchestra.run.smithi052.stdout:generic/504 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/504.out.bad) 2023-09-30T19:27:30.534 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/504.out 2023-09-30 16:50:24.706064236 +0000 2023-09-30T19:27:30.534 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/504.out.bad 2023-09-30 19:27:30.528694905 +0000 2023-09-30T19:27:30.534 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,2 +1,3 @@ 2023-09-30T19:27:30.534 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 504 2023-09-30T19:27:30.534 INFO:teuthology.orchestra.run.smithi052.stdout: +lock info not found 2023-09-30T19:27:30.534 INFO:teuthology.orchestra.run.smithi052.stdout: Silence is golden 2023-09-30T19:27:30.536 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/504 2023-09-30T19:27:30.536 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/504 2023-09-30T19:27:30.536 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-09-30T19:27:30.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:30.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T19:27:30.548 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-30T19:27:30.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-30T19:27:30.549 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-09-30T19:27:30.736 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:30.740 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:30.845 INFO:teuthology.orchestra.run.smithi052.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:30.849 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/505 2023-09-30T19:27:30.849 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/505 2023-09-30T19:27:30.849 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:30.852 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:30.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:30.860 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-09-30T19:27:31.042 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:31.046 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:31.047 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:31.175 INFO:teuthology.orchestra.run.smithi052.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:31.179 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/506 2023-09-30T19:27:31.179 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/506 2023-09-30T19:27:31.179 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:31.182 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:31.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:31.190 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-09-30T19:27:31.381 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:31.385 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:31.386 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:31.610 INFO:teuthology.orchestra.run.smithi052.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-09-30T19:27:31.613 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/507 2023-09-30T19:27:31.613 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/507 2023-09-30T19:27:31.614 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:31.616 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:31.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:31.624 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-09-30T19:27:31.810 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:31.813 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:31.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:31.969 INFO:teuthology.orchestra.run.smithi052.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-09-30T19:27:31.973 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/508 2023-09-30T19:27:31.973 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/508 2023-09-30T19:27:31.973 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:31.976 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:31.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:31.985 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-09-30T19:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:32.315 INFO:teuthology.orchestra.run.smithi052.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:32.319 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/509 2023-09-30T19:27:32.319 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/509 2023-09-30T19:27:32.319 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:32.321 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:32.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:32.329 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-09-30T19:27:32.508 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:32.512 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:32.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:32.640 INFO:teuthology.orchestra.run.smithi052.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:32.644 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/510 2023-09-30T19:27:32.644 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/510 2023-09-30T19:27:32.644 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:32.646 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:32.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:32.655 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-09-30T19:27:32.865 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:32.870 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:32.870 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.034 INFO:teuthology.orchestra.run.smithi052.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:33.038 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/511 2023-09-30T19:27:33.038 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/511 2023-09-30T19:27:33.038 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:33.040 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:33.049 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-09-30T19:27:33.242 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:33.247 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:33.247 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.366 INFO:teuthology.orchestra.run.smithi052.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:33.370 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/512 2023-09-30T19:27:33.370 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/512 2023-09-30T19:27:33.370 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:33.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:33.380 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-09-30T19:27:33.580 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:33.585 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.690 INFO:teuthology.orchestra.run.smithi052.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:33.694 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/513 2023-09-30T19:27:33.695 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/513 2023-09-30T19:27:33.695 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:33.705 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-09-30T19:27:33.877 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:33.881 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:33.986 INFO:teuthology.orchestra.run.smithi052.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:33.990 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/514 2023-09-30T19:27:33.990 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/514 2023-09-30T19:27:33.990 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:34.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:34.000 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-09-30T19:27:34.177 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:34.181 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:34.286 INFO:teuthology.orchestra.run.smithi052.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:34.290 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/515 2023-09-30T19:27:34.290 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/515 2023-09-30T19:27:34.291 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:34.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:34.301 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-09-30T19:27:34.505 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:34.509 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:34.683 INFO:teuthology.orchestra.run.smithi052.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-30T19:27:34.687 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/516 2023-09-30T19:27:34.687 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/516 2023-09-30T19:27:34.687 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:34.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:34.698 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-09-30T19:27:35.255 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:35.259 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:35.259 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:35.360 INFO:teuthology.orchestra.run.smithi052.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:35.364 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/517 2023-09-30T19:27:35.364 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/517 2023-09-30T19:27:35.364 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:35.366 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:35.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:35.374 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-09-30T19:27:35.552 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:35.557 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:35.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:35.694 INFO:teuthology.orchestra.run.smithi052.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/518 2023-09-30T19:27:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/518 2023-09-30T19:27:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:35.700 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:35.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:35.708 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-09-30T19:27:35.887 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:35.890 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:35.890 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:35.993 INFO:teuthology.orchestra.run.smithi052.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:35.997 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/519 2023-09-30T19:27:35.997 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/519 2023-09-30T19:27:35.997 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:35.999 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:36.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:36.007 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-09-30T19:27:36.197 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:36.202 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:36.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:36.331 INFO:teuthology.orchestra.run.smithi052.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T19:27:36.335 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/520 2023-09-30T19:27:36.335 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/520 2023-09-30T19:27:36.335 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T19:27:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:36.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T19:27:36.345 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-09-30T19:27:36.548 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T19:27:36.552 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T19:27:36.552 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T19:27:37.991 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:27:37.994 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:28:08.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:28:08.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:28:38.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:28:38.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:29:08.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:29:08.612 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:29:38.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:29:38.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:30:08.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:30:08.740 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:30:38.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:30:38.791 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:31:09.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:31:09.134 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:31:39.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:31:39.180 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:32:09.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:32:09.291 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:32:39.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:32:39.387 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:33:09.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:33:09.694 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:33:39.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:33:39.950 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:34:09.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:34:09.997 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:34:40.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:34:40.083 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:35:10.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:35:10.142 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:35:40.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:35:40.241 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:36:10.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:36:10.288 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:36:40.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:36:40.428 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:37:10.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:37:10.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:37:40.613 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:37:40.616 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:38:10.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:38:10.680 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:38:40.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:38:40.962 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:39:11.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:39:11.067 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:39:41.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:39:41.165 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:40:11.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:40:11.212 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:40:41.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:40:41.260 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:41:11.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:41:11.367 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:41:41.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:41:41.498 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:42:11.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:42:11.621 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:42:11.641 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T19:42:11.645+0000 7f254dda9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45368) UID: 0 2023-09-30T19:42:11.642 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T19:42:11.645+0000 7f3c0f7b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45368) UID: 0 2023-09-30T19:42:11.642 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T19:42:11.645+0000 7f4ae803a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45368) UID: 0 2023-09-30T19:42:11.642 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T19:42:11.645+0000 7fd82f759640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45368) UID: 0 2023-09-30T19:44:16.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:44:16.599 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:44:47.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:44:47.055 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:45:17.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:45:17.102 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:45:47.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:45:47.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:46:17.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:46:17.265 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:46:47.392 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:46:47.395 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:47:17.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:47:17.456 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:47:47.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:47:47.700 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:48:17.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:48:17.746 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:48:47.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:48:47.845 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:49:17.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:49:17.917 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:49:48.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:49:48.024 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:50:18.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:50:18.139 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:50:48.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:50:48.213 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:51:18.279 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:51:18.282 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:51:48.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:51:48.422 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:52:18.650 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:52:18.657 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:52:48.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:52:48.709 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:53:18.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:53:18.857 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:53:48.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:53:48.904 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:54:18.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:54:18.986 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:54:49.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:54:49.092 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:55:19.186 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:55:19.189 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:55:49.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:55:49.330 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:56:19.373 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:56:19.376 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:56:49.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:56:49.423 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:56:49.441 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T19:56:49.442+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363212) UID: 0 2023-09-30T19:56:49.442 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T19:56:49.442+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363212) UID: 0 2023-09-30T19:56:49.442 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T19:56:49.442+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363212) UID: 0 2023-09-30T19:56:49.442 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T19:56:49.442+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363212) UID: 0 2023-09-30T19:59:15.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:59:15.531 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:59:45.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T19:59:45.594 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:00:15.713 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:00:15.717 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:00:45.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:00:45.840 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:01:15.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:01:15.928 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:01:46.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:01:46.060 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:02:16.105 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:02:16.108 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:02:46.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:02:46.159 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:03:16.232 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:03:16.235 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:03:46.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:03:46.342 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:04:16.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:04:16.473 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:04:46.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:04:46.528 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:05:16.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:05:16.601 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:05:46.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:05:46.649 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:06:16.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:06:16.967 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:06:47.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:06:47.012 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:07:17.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:07:17.182 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:07:47.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:07:47.315 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:08:17.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:08:17.362 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:08:47.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:08:47.420 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:09:17.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:09:17.559 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:09:47.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:09:47.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:10:18.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:10:18.053 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:10:48.107 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:10:48.110 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:11:18.197 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:11:18.200 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:11:48.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:11:48.246 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:12:18.291 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:12:18.295 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:12:48.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:12:48.400 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:13:18.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:13:18.453 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:13:48.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:13:48.587 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:14:18.747 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:14:18.750 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:14:48.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:14:48.816 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:15:18.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:15:18.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:15:49.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:15:49.005 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:16:19.065 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:16:19.068 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:16:49.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:16:49.191 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:17:19.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:17:19.330 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:17:49.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:17:49.579 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:18:19.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:18:19.626 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:18:49.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:18:49.757 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:19:19.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:19:19.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:19:49.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:19:49.969 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:20:20.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:20:20.037 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:20:50.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:20:50.164 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:21:20.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:21:20.220 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:21:50.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:21:50.266 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:22:20.387 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:22:20.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:22:50.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:22:50.505 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:23:20.552 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:23:20.555 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:23:50.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:23:50.667 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:24:20.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:24:20.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:24:50.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:24:50.786 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:25:20.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:25:20.886 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:25:50.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:25:50.949 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:26:21.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:26:21.240 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:26:51.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:26:51.295 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:27:21.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:27:21.342 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:27:51.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:27:51.399 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:28:21.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:28:21.445 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:28:51.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:28:51.502 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:29:21.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:29:21.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:29:51.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:29:51.697 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:30:21.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:30:21.875 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:30:51.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:30:51.919 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:31:22.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:31:22.032 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:31:52.284 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:31:52.288 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:32:22.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:32:22.451 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:32:52.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:32:52.517 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:33:22.679 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:33:22.682 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:33:52.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:33:52.738 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:34:22.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:34:22.884 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:34:53.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:34:53.174 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:35:23.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:35:23.242 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:35:53.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:35:53.290 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:36:23.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:36:23.446 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:36:53.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:36:53.489 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:37:23.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:37:23.535 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:37:53.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:37:53.644 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:38:23.771 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:38:23.774 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:38:53.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:38:53.880 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:39:23.924 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:39:23.928 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:39:53.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:39:54.001 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:40:24.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:40:24.060 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:40:54.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:40:54.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:41:24.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:41:24.269 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:41:54.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:41:54.412 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:42:24.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:42:24.470 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:42:54.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:42:54.519 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:43:24.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:43:24.617 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:43:54.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:43:54.907 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:44:24.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:44:24.963 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:44:55.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:44:55.017 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:45:25.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:45:25.085 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:45:55.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:45:55.323 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:46:25.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:46:25.374 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:46:55.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:46:55.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:47:25.580 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:47:25.583 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:47:55.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:47:55.680 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:48:25.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:48:25.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:48:55.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:48:55.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:49:25.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:49:25.955 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:49:56.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:49:56.038 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:50:26.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:50:26.095 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:50:56.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:50:56.286 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:51:26.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:51:26.330 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:51:56.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:51:56.398 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:51:56.419 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-09-30T20:51:56.418+0000 7fddb1b87640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45784) UID: 0 2023-09-30T20:51:56.419 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-09-30T20:51:56.418+0000 7f6d9b131640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45784) UID: 0 2023-09-30T20:54:23.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:54:23.486 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:54:53.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:54:53.528 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:55:23.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:55:23.638 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:55:53.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:55:53.701 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:56:23.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:56:23.875 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:56:53.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:56:53.923 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:57:24.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:57:24.039 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:57:54.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:57:54.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:58:24.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:58:24.250 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:58:54.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:58:54.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:59:24.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:59:24.348 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:59:54.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:59:54.496 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T20:59:54.515 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T20:59:54.513+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363574) UID: 0 2023-09-30T20:59:54.516 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T20:59:54.513+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363574) UID: 0 2023-09-30T20:59:54.516 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T20:59:54.513+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363574) UID: 0 2023-09-30T20:59:54.516 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T20:59:54.513+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363574) UID: 0 2023-09-30T21:02:31.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:02:31.792 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:03:02.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:03:02.111 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:03:32.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:03:32.159 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:04:02.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:04:02.215 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:04:32.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:04:32.268 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:05:02.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:05:02.310 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:05:32.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:05:32.383 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:06:02.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:06:02.441 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:06:32.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:06:32.555 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:07:02.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:07:02.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:07:32.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:07:32.693 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:08:02.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:08:02.817 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:08:33.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:08:33.067 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:09:03.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:09:03.106 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:09:33.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:09:33.190 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:09:33.220 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T21:09:33.218+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363626) UID: 0 2023-09-30T21:09:33.220 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T21:09:33.218+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363626) UID: 0 2023-09-30T21:09:33.221 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T21:09:33.218+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363626) UID: 0 2023-09-30T21:09:33.221 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T21:09:33.218+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 363626) UID: 0 2023-09-30T21:11:04.630 INFO:teuthology.orchestra.run.smithi052.stdout:generic/521 6208s 2023-09-30T21:11:04.689 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/521 2023-09-30T21:11:04.689 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T21:11:04.692 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T21:11:04.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T21:11:04.703 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-09-30T21:11:05.644 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T21:11:05.649 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T21:11:05.649 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T21:11:49.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:11:49.429 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:12:19.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:12:19.568 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:12:49.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:12:49.673 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:13:19.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:13:19.746 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:13:49.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:13:49.835 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:14:19.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:14:19.882 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:14:49.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:14:49.936 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:15:19.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:15:19.977 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:15:50.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:15:50.026 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:16:20.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:16:20.132 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:16:50.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:16:50.180 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:17:20.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:17:20.486 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:17:50.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:17:50.545 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:18:20.628 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:18:20.631 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:18:50.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:18:50.746 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:19:20.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:19:20.844 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:19:50.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:19:50.958 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:20:21.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:20:21.265 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:20:51.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:20:51.320 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:21:21.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:21:21.426 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:21:51.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:21:51.542 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:22:21.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:22:21.706 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:22:51.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:22:51.772 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:23:21.891 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:23:21.895 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:23:51.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:23:51.947 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:24:21.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:24:21.996 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:24:52.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:24:52.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:25:22.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:25:22.132 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:25:52.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:25:52.181 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:26:22.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:26:22.237 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:26:52.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:26:52.286 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:27:22.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:27:22.357 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:27:52.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:27:52.463 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:28:22.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:28:22.510 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:28:52.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:28:52.608 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:29:22.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:29:22.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:29:52.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:29:52.738 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:30:22.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:30:22.888 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:30:52.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:30:52.957 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:31:23.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:31:23.089 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:31:53.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:31:53.186 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:32:23.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:32:23.242 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:32:53.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:32:53.310 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:33:23.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:33:23.384 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:33:53.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:33:53.519 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:34:23.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:34:23.567 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:34:53.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:34:53.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:35:23.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:35:23.761 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:35:53.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:35:53.818 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:36:23.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:36:23.941 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:36:53.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:36:53.989 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:37:24.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:37:24.053 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:37:54.382 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:37:54.385 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:38:24.461 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:38:24.464 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:38:54.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:38:54.796 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:39:24.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:39:24.845 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:39:54.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:39:54.999 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:40:25.077 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:40:25.080 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:40:55.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:40:55.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:41:25.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:41:25.309 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:41:55.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:41:55.599 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:42:25.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:42:25.664 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:42:55.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:42:55.777 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:43:25.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:43:25.825 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:43:55.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:43:55.948 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:44:25.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:44:25.996 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:44:56.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:44:56.083 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:45:26.122 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:45:26.125 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:45:56.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:45:56.299 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:46:26.401 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:46:26.404 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:46:56.499 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:46:56.502 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:47:26.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:47:26.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:47:56.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:47:56.664 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:48:26.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:48:26.711 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:48:56.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:48:56.758 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:49:26.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:49:26.840 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:49:57.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:49:57.105 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:50:27.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:50:27.285 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:50:57.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:50:57.383 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:51:27.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:51:27.716 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:51:57.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:51:57.788 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:52:27.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:52:27.885 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:52:57.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:52:57.943 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:53:28.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:53:28.030 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:53:58.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:53:58.128 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:54:28.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:54:28.219 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:54:58.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:54:58.279 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:55:28.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:55:28.429 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:55:58.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:55:58.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:56:28.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:56:28.634 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:56:58.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:56:58.681 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:57:28.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:57:28.736 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:57:58.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:57:58.794 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:58:28.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:58:28.883 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:58:58.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:58:58.997 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:59:29.233 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:59:29.237 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:59:59.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T21:59:59.360 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:00:29.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:00:29.456 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:00:59.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:00:59.504 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:01:29.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:01:29.554 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:01:59.655 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:01:59.658 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:02:29.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:02:29.714 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:02:59.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:02:59.991 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:03:30.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:03:30.047 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:04:00.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:04:00.399 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:04:30.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:04:30.446 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:05:00.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:05:00.578 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:05:30.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:05:30.650 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:06:00.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:06:00.765 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:06:30.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:06:30.813 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:07:00.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:07:00.952 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:07:31.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:07:31.015 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:08:01.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:08:01.075 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:08:31.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:08:31.172 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:09:01.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:09:01.228 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:09:31.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:09:31.342 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:10:01.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:10:01.432 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:10:31.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:10:31.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:11:01.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:11:01.535 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:11:31.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:11:31.658 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:12:01.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:12:01.764 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:12:31.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:12:31.837 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:13:02.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:13:02.347 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:13:32.570 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:13:32.573 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:14:02.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:14:02.624 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:14:02.644 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-09-30T22:14:02.639+0000 7f254dda9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46284) UID: 0 2023-09-30T22:14:02.645 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-09-30T22:14:02.639+0000 7f3c0f7b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46284) UID: 0 2023-09-30T22:14:02.645 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-09-30T22:14:02.639+0000 7f4ae803a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46284) UID: 0 2023-09-30T22:14:02.645 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-09-30T22:14:02.639+0000 7fd82f759640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46284) UID: 0 2023-09-30T22:16:18.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:16:18.974 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:16:49.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:16:49.020 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:17:19.080 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:17:19.084 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:17:49.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:17:49.316 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:18:19.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:18:19.393 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:18:49.474 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:18:49.477 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:19:19.580 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:19:19.583 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:19:49.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:19:49.689 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:20:19.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:20:19.829 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:20:49.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:20:49.868 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:21:20.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:21:20.026 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:21:50.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:21:50.072 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:22:20.166 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:22:20.169 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:22:50.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:22:50.334 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:23:20.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:23:20.423 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:23:50.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:23:50.550 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:24:20.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:24:20.591 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:24:50.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:24:50.766 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:25:20.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:25:20.839 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:25:50.892 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:25:50.895 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:26:20.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:26:20.976 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:26:51.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:26:51.032 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:27:21.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:27:21.079 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:27:51.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:27:51.143 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:28:21.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:28:21.204 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:28:51.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:28:51.261 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:29:21.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:29:21.326 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:29:51.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:29:51.375 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:30:21.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:30:21.415 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:30:49.488 INFO:teuthology.orchestra.run.smithi052.stdout:generic/522 4784s 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/522 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:49.595 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:49.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:49.596 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-09-30T22:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:49.992 INFO:teuthology.orchestra.run.smithi052.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/523 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/523 2023-09-30T22:30:50.228 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:50.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:50.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:50.228 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-09-30T22:30:50.471 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/524 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/524 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:51.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:51.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:51.002 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-09-30T22:30:51.293 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:51.299 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:51.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:51.441 INFO:teuthology.orchestra.run.smithi052.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:51.445 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/525 2023-09-30T22:30:51.445 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/525 2023-09-30T22:30:51.446 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:51.449 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:51.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:51.459 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-09-30T22:30:51.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:30:51.506 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:30:51.660 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:51.664 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:51.664 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:51.818 INFO:teuthology.orchestra.run.smithi052.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:51.821 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/526 2023-09-30T22:30:51.822 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/526 2023-09-30T22:30:51.822 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:51.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:51.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:51.833 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-09-30T22:30:52.023 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:52.027 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:52.027 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:52.161 INFO:teuthology.orchestra.run.smithi052.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:52.165 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/527 2023-09-30T22:30:52.165 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/527 2023-09-30T22:30:52.165 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:52.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:52.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:52.176 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-09-30T22:30:52.363 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:52.368 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:52.368 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:52.513 INFO:teuthology.orchestra.run.smithi052.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-09-30T22:30:52.516 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/528 2023-09-30T22:30:52.516 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/528 2023-09-30T22:30:52.516 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:52.519 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:52.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:52.527 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-09-30T22:30:52.710 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:52.714 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:52.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:52.854 INFO:teuthology.orchestra.run.smithi052.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-30T22:30:52.857 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/529 2023-09-30T22:30:52.858 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/529 2023-09-30T22:30:52.858 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:52.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:52.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:52.868 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-09-30T22:30:53.070 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:53.074 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:53.074 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:53.175 INFO:teuthology.orchestra.run.smithi052.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:53.178 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/530 2023-09-30T22:30:53.179 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/530 2023-09-30T22:30:53.179 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:53.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:53.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:53.190 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-09-30T22:30:53.376 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:53.380 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:53.380 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:53.486 INFO:teuthology.orchestra.run.smithi052.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:53.490 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/531 2023-09-30T22:30:53.490 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/531 2023-09-30T22:30:53.490 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:53.493 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:53.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:53.501 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-09-30T22:30:53.696 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:53.700 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:53.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:53.864 INFO:teuthology.orchestra.run.smithi052.stdout:generic/532 0s 2023-09-30T22:30:53.869 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/532 2023-09-30T22:30:53.869 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:53.871 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:53.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:53.879 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-09-30T22:30:54.076 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:54.080 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:54.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:54.552 INFO:teuthology.orchestra.run.smithi052.stdout:generic/533 0s 2023-09-30T22:30:54.557 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/533 2023-09-30T22:30:54.557 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:54.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:54.567 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-09-30T22:30:54.754 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:54.758 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:54.758 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:54.877 INFO:teuthology.orchestra.run.smithi052.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:54.880 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/534 2023-09-30T22:30:54.880 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/534 2023-09-30T22:30:54.880 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:54.883 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:54.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:54.891 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-09-30T22:30:55.074 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:55.078 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:55.079 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:55.197 INFO:teuthology.orchestra.run.smithi052.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:55.201 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/535 2023-09-30T22:30:55.201 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/535 2023-09-30T22:30:55.201 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:55.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:55.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:55.212 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-09-30T22:30:55.399 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:55.403 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:55.403 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:55.506 INFO:teuthology.orchestra.run.smithi052.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:55.510 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/536 2023-09-30T22:30:55.510 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/536 2023-09-30T22:30:55.510 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:55.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:55.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:55.522 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-09-30T22:30:55.699 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:55.703 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:55.703 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:55.805 INFO:teuthology.orchestra.run.smithi052.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-09-30T22:30:55.808 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/537 2023-09-30T22:30:55.808 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/537 2023-09-30T22:30:55.809 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-09-30T22:30:55.811 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:30:55.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-30T22:30:55.819 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-09-30T22:30:56.023 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-09-30T22:30:56.027 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-09-30T22:30:56.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-09-30T22:31:21.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:31:21.554 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:31:51.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:31:51.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:32:21.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:32:21.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:32:51.767 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:32:51.770 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:33:21.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:33:21.841 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:33:51.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:33:51.907 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:34:22.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:34:22.005 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:34:52.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:34:52.248 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:35:22.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:35:22.385 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:35:52.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:35:52.430 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:36:22.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:36:22.486 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:36:52.631 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:36:52.634 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:37:22.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:37:22.757 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:37:52.809 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:37:52.812 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:38:22.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:38:22.935 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:38:53.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:38:53.158 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:39:23.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:39:23.231 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:39:53.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:39:53.395 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:40:23.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:40:23.486 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:40:53.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:40:53.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:41:23.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:41:23.704 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:41:53.782 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:41:53.785 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:42:23.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:42:23.907 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:42:53.977 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:42:53.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:43:24.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:43:24.077 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:43:54.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:43:54.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:44:24.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:44:24.197 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:44:54.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:44:54.320 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:45:24.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:45:24.470 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:45:54.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:45:54.524 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:46:24.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:46:24.638 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:46:54.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:46:54.760 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:47:24.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:47:24.807 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:47:54.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:47:54.880 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:48:25.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:48:25.022 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:48:55.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:48:55.093 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:49:25.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:49:25.225 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:49:55.351 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:49:55.354 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:50:25.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:50:25.408 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:50:55.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:50:55.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:25.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:25.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:55.625 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:51:55.628 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:25.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:25.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:55.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:52:55.798 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:26.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:26.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:56.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:53:56.065 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:26.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:26.300 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:56.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:54:56.363 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:26.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:26.462 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:56.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:55:56.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:26.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:26.673 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:56.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:56:56.787 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:26.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:26.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:56.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:57:56.982 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:27.052 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:27.055 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:57.166 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:58:57.169 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:27.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:27.406 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:57.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T22:59:57.447 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:27.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:27.579 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:57.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:00:57.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:27.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:27.681 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:57.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:01:57.856 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:28.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:28.064 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:58.121 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:02:58.124 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:28.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:28.185 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:58.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:03:58.268 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:28.314 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:28.317 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:58.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:04:58.363 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:28.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:28.471 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:58.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:05:58.593 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:06:28.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:06:28.649 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:06:58.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:06:58.956 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:07:29.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:07:29.003 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:07:59.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:07:59.107 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:08:29.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:08:29.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:08:59.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:08:59.313 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:09:29.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:09:29.470 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:09:59.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:09:59.592 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:10:29.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:10:29.639 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:10:59.683 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:10:59.686 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:11:29.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:11:29.742 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:11:59.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:11:59.865 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:12:30.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:12:30.005 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:13:00.065 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:13:00.068 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:13:30.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:13:30.134 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:14:00.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:14:00.517 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:14:30.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:14:30.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:15:00.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:15:00.643 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:15:30.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:15:30.775 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:16:00.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:16:00.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:16:30.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:16:30.883 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:17:00.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:17:00.926 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:17:30.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:17:30.974 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:18:01.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:18:01.030 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:18:31.083 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:18:31.086 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:19:01.172 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:19:01.176 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:19:31.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:19:31.230 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:20:01.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:20:01.278 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:20:31.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:20:31.394 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:21:01.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:21:01.532 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:21:31.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:21:31.604 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:22:01.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:22:01.694 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:22:31.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:22:31.749 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:23:01.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:23:01.822 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:23:31.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:23:32.352 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:24:02.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:24:02.408 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:24:32.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:24:32.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:25:02.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:25:02.562 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:25:32.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:25:32.620 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:26:02.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:26:02.743 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:26:32.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:26:32.805 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:27:02.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:27:02.861 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:27:32.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:27:32.921 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:28:02.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:28:02.981 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:28:33.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:28:33.114 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:29:03.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:29:03.168 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:29:33.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:29:33.232 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:30:03.277 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:30:03.280 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:30:33.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:30:33.426 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:31:03.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:31:03.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:31:33.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:31:33.597 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:32:03.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:32:03.637 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:32:33.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:32:33.685 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:33:03.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:33:03.748 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:33:33.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:33:33.957 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:33:33.973 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-09-30T23:33:33.974+0000 7f7ed3869640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375924) UID: 0 2023-09-30T23:33:33.974 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-09-30T23:33:33.974+0000 7f19cb33f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375924) UID: 0 2023-09-30T23:33:33.974 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-09-30T23:33:33.974+0000 7f8229b4b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375924) UID: 0 2023-09-30T23:33:33.974 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-09-30T23:33:33.974+0000 7f695ae5b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375924) UID: 0 2023-09-30T23:36:00.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:36:00.065 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:36:30.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:36:30.173 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:37:00.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:37:00.218 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:37:30.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:37:30.266 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:38:00.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:38:00.322 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:38:30.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:38:30.462 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:39:00.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:39:00.519 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:39:30.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:39:30.648 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:40:00.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:40:00.721 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:40:30.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:40:30.768 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:41:00.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:41:00.808 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:41:30.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:41:30.955 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:42:01.083 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:42:01.086 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:42:31.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:42:31.209 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:43:01.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:43:01.431 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:43:31.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:43:31.495 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:44:01.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:44:01.567 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:44:31.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:44:31.740 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:45:01.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:45:01.880 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:45:31.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:45:31.934 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:46:02.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:46:02.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:46:32.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:46:32.407 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:47:02.449 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:47:02.452 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:47:32.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:47:32.517 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:48:02.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:48:02.656 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:48:32.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:48:32.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:49:02.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:49:02.794 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:49:32.896 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:49:32.899 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:50:02.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:50:02.945 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:50:32.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:50:32.995 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:51:03.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:51:03.142 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:51:33.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:51:33.206 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:52:03.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:52:03.337 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:52:33.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:52:33.460 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:53:03.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:53:03.741 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:53:33.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:53:33.814 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:54:03.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:54:03.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:54:34.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:54:34.018 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:55:04.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:55:04.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:55:34.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:55:34.438 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:56:04.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:56:04.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:56:34.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:56:34.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:57:04.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:57:04.614 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:57:34.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:57:34.661 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:58:04.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:58:04.700 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:58:34.753 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:58:34.756 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:59:04.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:59:04.848 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:59:35.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T23:59:35.004 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-01T00:00:02.053 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f72b43eb640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.053 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f72b43eb640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-10-01T00:00:02.053 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f8229b4b640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.054 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f19cb33f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.054 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f7ed3869640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.054 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f695ae5b640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.055 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-10-01T00:00:02.049+0000 7ffa19fa8640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.055 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-10-01T00:00:02.049+0000 7f63db277640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 377907) UID: 0 2023-10-01T00:00:02.070 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f72b43eb640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.071 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f72b43eb640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-10-01T00:00:02.071 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f8229b4b640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.072 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f7ed3869640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.072 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f19cb33f640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.072 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f63db277640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.073 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-10-01T00:00:02.069+0000 7ffa19fa8640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.073 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f695ae5b640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.074 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f68b7eca640 -1 Fail to open '/proc/377908/cmdline' error = (2) No such file or directory 2023-10-01T00:00:02.074 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f68b7eca640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:02.074 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f68b7eca640 -1 Fail to open '/proc/377908/cmdline' error = (2) No such file or directory 2023-10-01T00:00:02.074 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-10-01T00:00:02.069+0000 7f68b7eca640 -1 received signal: Hangup from (PID: 377908) UID: 0 2023-10-01T00:00:05.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-01T00:00:05.049 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-01T00:00:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:error: state file /var/lib/logrotate/status is already locked 2023-10-01T00:00:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-10-01T00:00:05.061 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-10-01T00:00:05.325 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-01T00:00:26.673 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-10-01T00:00:26.671+0000 7f254dda9640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 47074) UID: 0 2023-10-01T00:00:26.674 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-10-01T00:00:26.671+0000 7f3c0f7b1640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 47074) UID: 0 2023-10-01T00:00:26.674 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-10-01T00:00:26.671+0000 7f4ae803a640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 47074) UID: 0 2023-10-01T00:00:26.675 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-10-01T00:00:26.671+0000 7fd82f759640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 47074) UID: 0 2023-10-01T00:00:26.675 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-10-01T00:00:26.671+0000 7fddb1b87640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 47074) UID: 0 2023-10-01T00:00:26.675 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-10-01T00:00:26.671+0000 7f6d9b131640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 47074) UID: 0 2023-10-01T00:00:26.680 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-10-01T00:00:26.675+0000 7fd9f87ab640 -1 Fail to open '/proc/47074/cmdline' error = (2) No such file or directory 2023-10-01T00:00:26.680 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-10-01T00:00:26.675+0000 7fd9f87ab640 -1 received signal: Hangup from (PID: 47074) UID: 0 2023-10-01T00:00:26.681 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-10-01T00:00:26.679+0000 7f9c6b63d640 -1 Fail to open '/proc/47074/cmdline' error = (2) No such file or directory 2023-10-01T00:00:26.681 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-10-01T00:00:26.679+0000 7f9c6b63d640 -1 received signal: Hangup from (PID: 47074) UID: 0 2023-10-01T00:00:26.682 INFO:tasks.ceph.mon.c.smithi186.stderr:2023-10-01T00:00:26.679+0000 7fec8e4aa640 -1 Fail to open '/proc/47074/cmdline' error = (2) No such file or directory 2023-10-01T00:00:26.682 INFO:tasks.ceph.mon.c.smithi186.stderr:2023-10-01T00:00:26.679+0000 7fec8e4aa640 -1 received signal: Hangup from (PID: 47074) UID: 0 2023-10-01T00:00:26.687 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-10-01T00:00:26.683+0000 7f9c6b63d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-10-01T00:00:26.687 INFO:tasks.ceph.mon.c.smithi186.stderr:2023-10-01T00:00:26.683+0000 7fec8e4aa640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-10-01T00:00:26.734 INFO:tasks.ceph.osd.4.smithi186.stderr:2023-10-01T00:00:26.731+0000 7f254dda9640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.735 INFO:tasks.ceph.osd.7.smithi186.stderr:2023-10-01T00:00:26.731+0000 7fd82f759640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.735 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-10-01T00:00:26.731+0000 7f9c6b63d640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.735 INFO:tasks.ceph.mon.b.smithi186.stderr:2023-10-01T00:00:26.731+0000 7f9c6b63d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-10-01T00:00:26.735 INFO:tasks.ceph.osd.5.smithi186.stderr:2023-10-01T00:00:26.731+0000 7f3c0f7b1640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.736 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-10-01T00:00:26.731+0000 7fddb1b87640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.736 INFO:tasks.ceph.mds.d.smithi186.stderr:2023-10-01T00:00:26.731+0000 7f6d9b131640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.736 INFO:tasks.ceph.mon.c.smithi186.stderr:2023-10-01T00:00:26.731+0000 7fec8e4aa640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.736 INFO:tasks.ceph.mon.c.smithi186.stderr:2023-10-01T00:00:26.731+0000 7fec8e4aa640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-10-01T00:00:26.737 INFO:tasks.ceph.osd.6.smithi186.stderr:2023-10-01T00:00:26.731+0000 7f4ae803a640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:00:26.737 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-10-01T00:00:26.731+0000 7fd9f87ab640 -1 Fail to open '/proc/47075/cmdline' error = (2) No such file or directory 2023-10-01T00:00:26.737 INFO:tasks.ceph.mgr.x.smithi186.stderr:2023-10-01T00:00:26.731+0000 7fd9f87ab640 -1 received signal: Hangup from (PID: 47075) UID: 0 2023-10-01T00:02:31.767 INFO:teuthology.orchestra.run.smithi052.stdout:generic/538 5495s 2023-10-01T00:02:31.781 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/538 2023-10-01T00:02:31.781 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:31.784 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:32.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:32.109 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-10-01T00:02:32.461 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:32.465 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:32.465 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:35.091 INFO:teuthology.orchestra.run.smithi052.stdout:generic/539 3s 2023-10-01T00:02:35.097 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/539 2023-10-01T00:02:35.097 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:35.100 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:35.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:35.110 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-10-01T00:02:35.752 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:35.756 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:35.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:35.869 INFO:teuthology.orchestra.run.smithi052.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:35.872 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/540 2023-10-01T00:02:35.872 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/540 2023-10-01T00:02:35.872 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:35.874 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:35.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:35.882 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-10-01T00:02:36.058 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:36.062 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:36.062 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:36.162 INFO:teuthology.orchestra.run.smithi052.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:36.165 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/541 2023-10-01T00:02:36.165 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/541 2023-10-01T00:02:36.165 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:36.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:36.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:36.177 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-10-01T00:02:36.355 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:36.359 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:36.360 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:36.518 INFO:teuthology.orchestra.run.smithi052.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:36.522 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/542 2023-10-01T00:02:36.523 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/542 2023-10-01T00:02:36.523 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:36.524 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:36.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:36.533 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-10-01T00:02:36.715 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:36.720 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:36.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:36.820 INFO:teuthology.orchestra.run.smithi052.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:36.823 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/543 2023-10-01T00:02:36.824 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/543 2023-10-01T00:02:36.824 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:36.825 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:36.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:36.834 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-10-01T00:02:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:37.034 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:37.035 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:37.136 INFO:teuthology.orchestra.run.smithi052.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:37.139 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/544 2023-10-01T00:02:37.139 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/544 2023-10-01T00:02:37.139 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:37.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:37.150 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-10-01T00:02:37.335 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:37.339 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:37.339 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:37.560 INFO:teuthology.orchestra.run.smithi052.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-10-01T00:02:37.564 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/545 2023-10-01T00:02:37.565 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/545 2023-10-01T00:02:37.565 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:37.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:37.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:37.575 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-10-01T00:02:37.766 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:37.770 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:37.770 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.006 INFO:teuthology.orchestra.run.smithi052.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:38.010 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/546 2023-10-01T00:02:38.010 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/546 2023-10-01T00:02:38.010 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:38.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:38.020 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-10-01T00:02:38.206 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:38.210 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:38.210 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.333 INFO:teuthology.orchestra.run.smithi052.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:38.336 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/547 2023-10-01T00:02:38.336 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/547 2023-10-01T00:02:38.336 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:38.338 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:38.346 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-10-01T00:02:38.535 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:38.539 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:38.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.675 INFO:teuthology.orchestra.run.smithi052.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:38.679 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/548 2023-10-01T00:02:38.679 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/548 2023-10-01T00:02:38.679 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:38.681 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:38.690 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-10-01T00:02:38.863 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:38.867 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:38.867 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:38.994 INFO:teuthology.orchestra.run.smithi052.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:38.998 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/549 2023-10-01T00:02:38.998 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/549 2023-10-01T00:02:38.998 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:39.000 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:39.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:39.009 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-10-01T00:02:39.195 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:39.275 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:39.276 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/550 2023-10-01T00:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/550 2023-10-01T00:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:39.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:39.406 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-10-01T00:02:39.594 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:39.598 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:39.598 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:39.698 INFO:teuthology.orchestra.run.smithi052.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/551 2023-10-01T00:02:39.702 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/551 2023-10-01T00:02:39.703 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:39.705 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:39.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:39.713 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-10-01T00:02:39.903 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:39.907 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:40.025 INFO:teuthology.orchestra.run.smithi052.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:40.028 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/552 2023-10-01T00:02:40.028 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/552 2023-10-01T00:02:40.028 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:40.030 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:40.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:40.038 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-10-01T00:02:40.223 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:40.227 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:40.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:40.452 INFO:teuthology.orchestra.run.smithi052.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-10-01T00:02:40.455 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/553 2023-10-01T00:02:40.455 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/553 2023-10-01T00:02:40.455 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:40.458 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:40.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:40.465 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-10-01T00:02:41.062 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:41.066 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:41.066 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:41.167 INFO:teuthology.orchestra.run.smithi052.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:41.170 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/554 2023-10-01T00:02:41.170 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/554 2023-10-01T00:02:41.170 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:41.173 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:41.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:41.181 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-10-01T00:02:41.355 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:41.359 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:41.359 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:41.568 INFO:teuthology.orchestra.run.smithi052.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-10-01T00:02:41.572 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/555 2023-10-01T00:02:41.572 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/555 2023-10-01T00:02:41.572 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:41.574 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:41.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:41.582 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-10-01T00:02:42.187 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:42.190 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:42.191 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:42.290 INFO:teuthology.orchestra.run.smithi052.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:42.294 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/556 2023-10-01T00:02:42.294 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/556 2023-10-01T00:02:42.294 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:42.296 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:42.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:42.304 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-10-01T00:02:42.479 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:42.482 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:42.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:42.605 INFO:teuthology.orchestra.run.smithi052.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:42.608 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/557 2023-10-01T00:02:42.608 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/557 2023-10-01T00:02:42.609 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:42.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:42.619 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-10-01T00:02:42.810 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:42.814 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:42.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:42.935 INFO:teuthology.orchestra.run.smithi052.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:42.938 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/558 2023-10-01T00:02:42.938 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/558 2023-10-01T00:02:42.939 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:42.941 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:42.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:42.949 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-10-01T00:02:43.140 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:43.144 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:43.144 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:43.244 INFO:teuthology.orchestra.run.smithi052.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:43.248 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/559 2023-10-01T00:02:43.248 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/559 2023-10-01T00:02:43.248 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:43.250 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:43.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:43.258 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-10-01T00:02:43.447 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:43.451 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:43.451 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:43.551 INFO:teuthology.orchestra.run.smithi052.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:43.554 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/560 2023-10-01T00:02:43.554 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/560 2023-10-01T00:02:43.554 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:43.556 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:43.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:43.565 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-10-01T00:02:43.739 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:43.743 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:43.743 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:43.845 INFO:teuthology.orchestra.run.smithi052.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:43.846 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/561 2023-10-01T00:02:43.847 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/561 2023-10-01T00:02:43.847 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:43.849 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:43.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:43.857 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-10-01T00:02:44.043 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:44.049 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:44.050 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:44.154 INFO:teuthology.orchestra.run.smithi052.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:44.157 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/562 2023-10-01T00:02:44.158 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/562 2023-10-01T00:02:44.158 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:44.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:44.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:44.168 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-10-01T00:02:44.355 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:44.359 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:44.359 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:44.484 INFO:teuthology.orchestra.run.smithi052.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:44.488 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/563 2023-10-01T00:02:44.489 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/563 2023-10-01T00:02:44.489 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:44.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:44.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:44.500 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-10-01T00:02:44.683 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:44.687 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:44.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:45.537 INFO:teuthology.orchestra.run.smithi052.stdout:generic/564 1s 2023-10-01T00:02:45.554 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/564 2023-10-01T00:02:45.554 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:45.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:45.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:45.558 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-10-01T00:02:46.103 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:46.107 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:46.107 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:46.210 INFO:teuthology.orchestra.run.smithi052.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:46.214 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/565 2023-10-01T00:02:46.214 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/565 2023-10-01T00:02:46.214 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:46.216 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:46.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:46.225 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-10-01T00:02:46.398 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:46.402 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:46.402 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:46.560 INFO:teuthology.orchestra.run.smithi052.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:46.564 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/566 2023-10-01T00:02:46.564 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/566 2023-10-01T00:02:46.564 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:46.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:46.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:46.577 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-10-01T00:02:46.779 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:46.783 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:46.783 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:46.896 INFO:teuthology.orchestra.run.smithi052.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:46.900 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/567 2023-10-01T00:02:46.900 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/567 2023-10-01T00:02:46.900 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:46.902 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:46.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:46.910 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-10-01T00:02:47.095 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:47.099 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:47.100 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:47.331 INFO:teuthology.orchestra.run.smithi052.stdout:generic/568 0s 2023-10-01T00:02:47.336 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/568 2023-10-01T00:02:47.336 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:47.339 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:47.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:47.356 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-10-01T00:02:47.891 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:47.894 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:47.895 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:48.034 INFO:teuthology.orchestra.run.smithi052.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:48.037 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/569 2023-10-01T00:02:48.037 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/569 2023-10-01T00:02:48.038 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:48.040 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:48.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:48.048 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-10-01T00:02:48.227 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:48.231 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:48.231 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:48.335 INFO:teuthology.orchestra.run.smithi052.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:48.338 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/570 2023-10-01T00:02:48.338 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/570 2023-10-01T00:02:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:48.342 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:48.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:48.351 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-10-01T00:02:48.564 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:48.568 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:48.568 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:54.855 INFO:teuthology.orchestra.run.smithi052.stdout:generic/571 6s 2023-10-01T00:02:54.863 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/571 2023-10-01T00:02:54.863 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:54.866 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:54.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:54.879 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-10-01T00:02:55.466 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:55.470 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:55.470 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:55.574 INFO:teuthology.orchestra.run.smithi052.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:55.577 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/572 2023-10-01T00:02:55.577 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/572 2023-10-01T00:02:55.577 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:55.579 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:55.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:55.587 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-10-01T00:02:55.783 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:55.787 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:55.787 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:55.889 INFO:teuthology.orchestra.run.smithi052.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:55.893 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/573 2023-10-01T00:02:55.893 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/573 2023-10-01T00:02:55.893 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:55.896 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:55.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:55.904 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-10-01T00:02:56.094 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:56.098 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:56.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:56.205 INFO:teuthology.orchestra.run.smithi052.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:56.209 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/574 2023-10-01T00:02:56.209 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/574 2023-10-01T00:02:56.209 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:56.211 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:56.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:56.220 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-10-01T00:02:56.422 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:56.427 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:56.427 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:56.534 INFO:teuthology.orchestra.run.smithi052.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:56.537 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/575 2023-10-01T00:02:56.538 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/575 2023-10-01T00:02:56.538 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:56.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:56.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:56.548 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-10-01T00:02:56.735 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:56.739 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:56.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:56.870 INFO:teuthology.orchestra.run.smithi052.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:56.874 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/576 2023-10-01T00:02:56.874 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/576 2023-10-01T00:02:56.874 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:56.876 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:56.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:56.885 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-10-01T00:02:57.082 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:57.087 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:57.087 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:57.197 INFO:teuthology.orchestra.run.smithi052.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:57.200 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/577 2023-10-01T00:02:57.200 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/577 2023-10-01T00:02:57.201 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:57.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:57.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:57.212 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-10-01T00:02:57.390 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:57.394 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:57.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:57.547 INFO:teuthology.orchestra.run.smithi052.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-01T00:02:57.550 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/578 2023-10-01T00:02:57.550 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/578 2023-10-01T00:02:57.551 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:57.553 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:57.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:57.561 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-10-01T00:02:57.751 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:57.756 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:57.866 INFO:teuthology.orchestra.run.smithi052.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:57.869 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/579 2023-10-01T00:02:57.869 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/579 2023-10-01T00:02:57.869 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:57.871 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:57.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:57.879 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-10-01T00:02:58.079 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:58.083 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:58.083 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:58.212 INFO:teuthology.orchestra.run.smithi052.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:58.216 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/580 2023-10-01T00:02:58.216 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/580 2023-10-01T00:02:58.216 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:58.218 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:58.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:58.227 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-10-01T00:02:58.418 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:58.422 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:58.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:58.957 INFO:teuthology.orchestra.run.smithi052.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:58.962 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/581 2023-10-01T00:02:58.962 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/581 2023-10-01T00:02:58.963 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:58.966 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:58.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:58.978 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-10-01T00:02:59.211 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:59.216 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:59.216 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:59.368 INFO:teuthology.orchestra.run.smithi052.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:59.372 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/582 2023-10-01T00:02:59.372 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/582 2023-10-01T00:02:59.372 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:59.374 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:59.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:59.383 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-10-01T00:02:59.609 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:02:59.613 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:02:59.613 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:59.751 INFO:teuthology.orchestra.run.smithi052.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:02:59.847 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/583 2023-10-01T00:02:59.847 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/583 2023-10-01T00:02:59.848 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:02:59.848 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:02:59.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:02:59.848 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-10-01T00:03:00.090 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:00.094 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:00.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:00.280 INFO:teuthology.orchestra.run.smithi052.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:00.284 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/584 2023-10-01T00:03:00.284 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/584 2023-10-01T00:03:00.284 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:00.286 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:00.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:00.295 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-10-01T00:03:00.490 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:00.494 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:00.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:00.597 INFO:teuthology.orchestra.run.smithi052.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:00.601 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/585 2023-10-01T00:03:00.601 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/585 2023-10-01T00:03:00.601 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:00.603 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:00.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:00.611 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-10-01T00:03:00.798 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:00.802 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:00.802 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:49.043 INFO:teuthology.orchestra.run.smithi052.stdout:generic/586 49s 2023-10-01T00:03:49.051 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/586 2023-10-01T00:03:49.051 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:49.054 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:49.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:49.068 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-10-01T00:03:49.662 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:49.666 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:49.666 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:49.958 INFO:teuthology.orchestra.run.smithi052.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-01T00:03:49.962 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/587 2023-10-01T00:03:49.962 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/587 2023-10-01T00:03:49.963 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:49.965 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:49.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:49.977 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-10-01T00:03:50.212 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:50.216 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:50.217 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:50.350 INFO:teuthology.orchestra.run.smithi052.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:50.355 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/588 2023-10-01T00:03:50.355 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/588 2023-10-01T00:03:50.355 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:50.357 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:50.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:50.366 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-10-01T00:03:50.555 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:50.559 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:50.560 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:50.704 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/589 2023-10-01T00:03:50.704 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/589 2023-10-01T00:03:50.704 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:50.707 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:50.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:50.715 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-10-01T00:03:50.903 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:50.907 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:50.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:51.011 INFO:teuthology.orchestra.run.smithi052.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:51.015 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/590 2023-10-01T00:03:51.015 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/590 2023-10-01T00:03:51.015 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:51.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:51.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:51.026 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-10-01T00:03:51.230 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:51.235 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:51.235 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:generic/591 0s 2023-10-01T00:03:51.629 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/591 2023-10-01T00:03:51.629 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:51.632 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:51.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:51.642 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-10-01T00:03:52.206 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:52.210 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:52.211 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:52.339 INFO:teuthology.orchestra.run.smithi052.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/592 2023-10-01T00:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/592 2023-10-01T00:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:52.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:52.372 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-10-01T00:03:52.550 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:52.554 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:52.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:52.685 INFO:teuthology.orchestra.run.smithi052.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:52.688 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/593 2023-10-01T00:03:52.688 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/593 2023-10-01T00:03:52.688 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:52.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:52.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:52.698 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-10-01T00:03:52.900 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:52.905 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:53.006 INFO:teuthology.orchestra.run.smithi052.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:53.009 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/594 2023-10-01T00:03:53.009 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/594 2023-10-01T00:03:53.010 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:53.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:53.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:53.020 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-10-01T00:03:53.219 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:53.223 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:53.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:53.353 INFO:teuthology.orchestra.run.smithi052.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/595 2023-10-01T00:03:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/595 2023-10-01T00:03:53.357 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:53.360 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:53.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:53.368 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-10-01T00:03:53.562 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:53.567 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:53.567 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:53.679 INFO:teuthology.orchestra.run.smithi052.stdout:generic/596 [not run] accton utility required, skipped this test 2023-10-01T00:03:53.682 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/596 2023-10-01T00:03:53.682 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/596 2023-10-01T00:03:53.682 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:53.684 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:53.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:53.693 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-10-01T00:03:53.876 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:53.880 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:53.880 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:generic/597 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/597.out.bad) 2023-10-01T00:03:54.428 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/597.out 2023-09-30 16:50:24.710064200 +0000 2023-10-01T00:03:54.428 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/597.out.bad 2023-10-01 00:03:54.418979071 +0000 2023-10-01T00:03:54.428 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -4,11 +4,11 @@ 2023-10-01T00:03:54.428 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_symlinks = 0 2023-10-01T00:03:54.428 INFO:teuthology.orchestra.run.smithi052.stdout: successfully followed symlink 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_symlinks = 1 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: +successfully followed symlink 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: == Test hardlink create protection when 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: == process != target owner and process cannot read target 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_hardlinks = 0 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: -successfully created hardlink 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: +Permission denied 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_hardlinks = 1 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-10-01T00:03:54.429 INFO:teuthology.orchestra.run.smithi052.stdout: +Permission denied 2023-10-01T00:03:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/597 2023-10-01T00:03:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/597 2023-10-01T00:03:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-10-01T00:03:54.433 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:54.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T00:03:54.441 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-01T00:03:54.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-01T00:03:54.442 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-10-01T00:03:54.979 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:54.983 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:54.983 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:55.529 INFO:teuthology.orchestra.run.smithi052.stdout:generic/598 - output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/598.out.bad) 2023-10-01T00:03:55.531 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/598.out 2023-09-30 16:50:24.710064200 +0000 2023-10-01T00:03:55.531 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/598.out.bad 2023-10-01 00:03:55.522964955 +0000 2023-10-01T00:03:55.531 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -5,13 +5,10 @@ 2023-10-01T00:03:55.531 INFO:teuthology.orchestra.run.smithi052.stdout: = only group writable dir 2023-10-01T00:03:55.531 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_regular = 1 2023-10-01T00:03:55.531 INFO:teuthology.orchestra.run.smithi052.stdout: = group & world writable dir 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: = only group writable dir 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_regular = 2 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: = group & world writable dir 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: = only group writable dir 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-10-01T00:03:55.532 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_fifos = 0 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -19,10 +16,7 @@ 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: = only group writable dir 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_fifos = 1 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: = group & world writable dir 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: = only group writable dir 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: fs.protected_fifos = 2 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: = group & world writable dir 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: = only group writable dir 2023-10-01T00:03:55.533 INFO:teuthology.orchestra.run.smithi052.stdout: -Permission denied 2023-10-01T00:03:55.534 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/598 2023-10-01T00:03:55.534 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/598 2023-10-01T00:03:55.534 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-10-01T00:03:55.536 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:55.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T00:03:55.544 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-01T00:03:55.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-01T00:03:55.545 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-10-01T00:03:56.090 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:56.093 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:56.093 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:56.194 INFO:teuthology.orchestra.run.smithi052.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:56.198 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/599 2023-10-01T00:03:56.198 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/599 2023-10-01T00:03:56.198 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:56.201 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:56.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:56.209 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-10-01T00:03:56.394 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:56.398 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:56.398 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:56.499 INFO:teuthology.orchestra.run.smithi052.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:56.503 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/600 2023-10-01T00:03:56.503 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/600 2023-10-01T00:03:56.503 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:56.505 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:56.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:56.513 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-10-01T00:03:56.708 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:56.713 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:56.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:56.822 INFO:teuthology.orchestra.run.smithi052.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:56.826 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/601 2023-10-01T00:03:56.826 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/601 2023-10-01T00:03:56.826 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:56.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:56.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:56.837 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-10-01T00:03:57.018 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:57.022 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:57.022 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:57.152 INFO:teuthology.orchestra.run.smithi052.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:57.156 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/602 2023-10-01T00:03:57.156 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/602 2023-10-01T00:03:57.156 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:57.158 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:57.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:57.166 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-10-01T00:03:57.367 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:57.371 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:57.371 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:57.478 INFO:teuthology.orchestra.run.smithi052.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:57.482 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/603 2023-10-01T00:03:57.482 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/603 2023-10-01T00:03:57.482 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:57.484 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:57.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:57.493 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-10-01T00:03:57.674 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:57.678 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:57.678 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:57.782 INFO:teuthology.orchestra.run.smithi052.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:57.786 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/604 2023-10-01T00:03:57.787 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/604 2023-10-01T00:03:57.787 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:57.788 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:57.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:57.797 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-10-01T00:03:57.990 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:57.994 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:57.994 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:58.123 INFO:teuthology.orchestra.run.smithi052.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:58.128 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/605 2023-10-01T00:03:58.128 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/605 2023-10-01T00:03:58.128 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:58.130 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:58.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:58.139 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-10-01T00:03:58.332 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:58.336 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:58.336 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:58.448 INFO:teuthology.orchestra.run.smithi052.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:58.452 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/606 2023-10-01T00:03:58.452 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/606 2023-10-01T00:03:58.452 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:58.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:58.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:58.463 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-10-01T00:03:58.651 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:58.655 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:58.655 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:58.758 INFO:teuthology.orchestra.run.smithi052.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:58.762 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/607 2023-10-01T00:03:58.762 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/607 2023-10-01T00:03:58.762 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:58.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:58.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:58.773 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-10-01T00:03:58.973 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:58.976 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:58.976 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:59.079 INFO:teuthology.orchestra.run.smithi052.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:03:59.083 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/608 2023-10-01T00:03:59.083 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/608 2023-10-01T00:03:59.084 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:59.085 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:59.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:59.094 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-10-01T00:03:59.299 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:03:59.303 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:03:59.303 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:59.880 INFO:teuthology.orchestra.run.smithi052.stdout:generic/609 0s 2023-10-01T00:03:59.887 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/609 2023-10-01T00:03:59.887 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:03:59.891 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:03:59.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:03:59.904 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-10-01T00:04:00.475 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:00.479 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:00.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:00.610 INFO:teuthology.orchestra.run.smithi052.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:00.614 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/610 2023-10-01T00:04:00.615 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/610 2023-10-01T00:04:00.615 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:00.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:00.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:00.627 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-10-01T00:04:00.810 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:00.814 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:00.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:00.916 INFO:teuthology.orchestra.run.smithi052.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:00.919 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/611 2023-10-01T00:04:00.919 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/611 2023-10-01T00:04:00.919 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:00.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:00.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:00.930 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-10-01T00:04:01.122 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:01.126 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-01T00:04:01.310 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/612 2023-10-01T00:04:01.310 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/612 2023-10-01T00:04:01.310 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:01.311 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:01.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:01.319 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-10-01T00:04:01.862 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:01.866 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:01.866 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.019 INFO:teuthology.orchestra.run.smithi052.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:02.022 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/613 2023-10-01T00:04:02.023 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/613 2023-10-01T00:04:02.023 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:02.025 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:02.033 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-10-01T00:04:02.210 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:02.214 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:02.214 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.329 INFO:teuthology.orchestra.run.smithi052.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:02.333 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/614 2023-10-01T00:04:02.333 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/614 2023-10-01T00:04:02.333 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:02.335 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:02.343 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-10-01T00:04:02.522 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:02.526 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:02.526 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.629 INFO:teuthology.orchestra.run.smithi052.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:02.632 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/615 2023-10-01T00:04:02.632 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/615 2023-10-01T00:04:02.632 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:02.634 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:02.643 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-10-01T00:04:02.850 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:02.854 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:02.854 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.960 INFO:teuthology.orchestra.run.smithi052.stdout:generic/616 [not run] kernel does not support IO_URING 2023-10-01T00:04:02.964 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/616 2023-10-01T00:04:02.964 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/616 2023-10-01T00:04:02.964 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:02.966 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:02.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:02.975 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-10-01T00:04:03.183 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:03.188 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:03.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:03.409 INFO:teuthology.orchestra.run.smithi052.stdout:generic/617 [not run] kernel does not support IO_URING 2023-10-01T00:04:03.413 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/617 2023-10-01T00:04:03.413 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/617 2023-10-01T00:04:03.414 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:03.417 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:03.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:03.426 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-10-01T00:04:03.618 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:03.622 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:03.623 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:03.728 INFO:teuthology.orchestra.run.smithi052.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:03.731 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/618 2023-10-01T00:04:03.731 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/618 2023-10-01T00:04:03.731 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:03.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:03.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:03.742 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-10-01T00:04:03.922 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:03.926 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:03.926 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:04.029 INFO:teuthology.orchestra.run.smithi052.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:04.032 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/619 2023-10-01T00:04:04.033 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/619 2023-10-01T00:04:04.033 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:04.035 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:04.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:04.044 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-10-01T00:04:04.234 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:04.238 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:04.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:04.377 INFO:teuthology.orchestra.run.smithi052.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:04.381 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/620 2023-10-01T00:04:04.382 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/620 2023-10-01T00:04:04.382 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:04.383 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:04.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:04.391 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-10-01T00:04:04.570 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:04.574 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:04.574 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:04.703 INFO:teuthology.orchestra.run.smithi052.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:04.707 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/621 2023-10-01T00:04:04.708 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/621 2023-10-01T00:04:04.708 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:04.709 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:04.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:04.718 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-10-01T00:04:04.915 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:04.919 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:04.919 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.029 INFO:teuthology.orchestra.run.smithi052.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:05.034 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/622 2023-10-01T00:04:05.034 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/622 2023-10-01T00:04:05.034 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:05.036 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:05.045 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-10-01T00:04:05.239 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:05.243 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:05.243 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.345 INFO:teuthology.orchestra.run.smithi052.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:05.348 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/623 2023-10-01T00:04:05.348 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/623 2023-10-01T00:04:05.349 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:05.351 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:05.359 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-10-01T00:04:05.551 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:05.555 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:05.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.657 INFO:teuthology.orchestra.run.smithi052.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/624 2023-10-01T00:04:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/624 2023-10-01T00:04:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:05.662 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:05.671 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-10-01T00:04:05.858 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:05.863 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:05.863 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.966 INFO:teuthology.orchestra.run.smithi052.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:05.969 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/625 2023-10-01T00:04:05.970 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/625 2023-10-01T00:04:05.970 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:05.972 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:05.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:05.980 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-10-01T00:04:06.172 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:06.175 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:06.175 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:06.290 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/626 2023-10-01T00:04:06.290 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/626 2023-10-01T00:04:06.290 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:06.292 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:06.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:06.300 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-10-01T00:04:06.496 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:06.500 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:06.500 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:06.606 INFO:teuthology.orchestra.run.smithi052.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:06.610 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/627 2023-10-01T00:04:06.610 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/627 2023-10-01T00:04:06.610 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:06.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:06.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:06.621 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-10-01T00:04:06.810 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:06.814 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:06.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:06.932 INFO:teuthology.orchestra.run.smithi052.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:06.936 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/628 2023-10-01T00:04:06.936 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/628 2023-10-01T00:04:06.936 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:06.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:06.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:06.947 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-10-01T00:04:07.152 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:07.156 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:07.157 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:07.273 INFO:teuthology.orchestra.run.smithi052.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:07.277 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/629 2023-10-01T00:04:07.277 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/629 2023-10-01T00:04:07.277 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:07.279 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:07.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:07.288 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-10-01T00:04:07.468 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/630 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/630 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:07.604 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:07.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:07.605 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-10-01T00:04:07.783 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:07.787 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:07.787 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:07.889 INFO:teuthology.orchestra.run.smithi052.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:07.892 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/631 2023-10-01T00:04:07.892 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/631 2023-10-01T00:04:07.892 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:07.894 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:07.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:07.902 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-10-01T00:04:08.090 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:08.094 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:08.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:15.517 INFO:teuthology.orchestra.run.smithi052.stdout:generic/632 7s 2023-10-01T00:04:15.525 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/632 2023-10-01T00:04:15.525 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:15.529 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:15.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:15.540 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-10-01T00:04:15.777 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:15.782 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:15.782 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:16.427 INFO:teuthology.orchestra.run.smithi052.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/633.out.bad) 2023-10-01T00:04:16.430 INFO:teuthology.orchestra.run.smithi052.stdout: --- tests/generic/633.out 2023-09-30 16:50:24.714064165 +0000 2023-10-01T00:04:16.430 INFO:teuthology.orchestra.run.smithi052.stdout: +++ /tmp/tmp.qvcny3LNTMxfstests-dev/results//generic/633.out.bad 2023-10-01 00:04:16.426697695 +0000 2023-10-01T00:04:16.430 INFO:teuthology.orchestra.run.smithi052.stdout: @@ -1,2 +1,3 @@ 2023-10-01T00:04:16.430 INFO:teuthology.orchestra.run.smithi052.stdout: QA output created by 633 2023-10-01T00:04:16.430 INFO:teuthology.orchestra.run.smithi052.stdout: Silence is golden 2023-10-01T00:04:16.431 INFO:teuthology.orchestra.run.smithi052.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-10-01T00:04:16.440 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/633 2023-10-01T00:04:16.440 INFO:teuthology.orchestra.run.smithi052.stdout:Failures: generic/633 2023-10-01T00:04:16.441 INFO:teuthology.orchestra.run.smithi052.stdout:Failed 1 of 1 tests 2023-10-01T00:04:16.463 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:16.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T00:04:16.476 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-01T00:04:16.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-01T00:04:16.476 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-10-01T00:04:17.061 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:17.064 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:17.064 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:17.172 INFO:teuthology.orchestra.run.smithi052.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:17.175 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/634 2023-10-01T00:04:17.175 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/634 2023-10-01T00:04:17.175 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:17.178 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:17.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:17.186 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-10-01T00:04:17.375 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:17.379 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:17.380 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:17.485 INFO:teuthology.orchestra.run.smithi052.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:17.488 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/635 2023-10-01T00:04:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/635 2023-10-01T00:04:17.489 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:17.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:17.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:17.500 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-10-01T00:04:17.694 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:17.698 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:17.698 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:17.804 INFO:teuthology.orchestra.run.smithi052.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:17.808 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/636 2023-10-01T00:04:17.808 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/636 2023-10-01T00:04:17.808 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:17.810 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:17.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:17.818 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-10-01T00:04:18.004 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:18.009 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:18.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:20.385 INFO:teuthology.orchestra.run.smithi052.stdout:generic/637 2s 2023-10-01T00:04:20.392 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/637 2023-10-01T00:04:20.393 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:20.396 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:20.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:20.408 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-10-01T00:04:21.089 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:21.093 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:21.093 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:21.314 INFO:teuthology.orchestra.run.smithi052.stdout:generic/638 0s 2023-10-01T00:04:21.321 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/638 2023-10-01T00:04:21.321 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:21.324 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:21.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:21.334 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-10-01T00:04:21.557 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:21.562 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:21.562 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:24.311 INFO:teuthology.orchestra.run.smithi052.stdout:generic/639 3s 2023-10-01T00:04:24.319 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/639 2023-10-01T00:04:24.319 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:24.323 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:24.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:24.335 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-10-01T00:04:24.602 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:24.607 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:24.607 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:24.764 INFO:teuthology.orchestra.run.smithi052.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:24.769 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/640 2023-10-01T00:04:24.769 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/640 2023-10-01T00:04:24.769 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:24.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:24.784 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-10-01T00:04:25.024 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:25.029 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:25.029 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:25.159 INFO:teuthology.orchestra.run.smithi052.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:25.163 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/641 2023-10-01T00:04:25.164 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/641 2023-10-01T00:04:25.164 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:25.166 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:25.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:25.176 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-10-01T00:04:25.391 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:25.396 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:25.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:25.577 INFO:teuthology.orchestra.run.smithi052.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:25.581 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/642 2023-10-01T00:04:25.581 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/642 2023-10-01T00:04:25.581 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:25.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:25.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:25.594 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-10-01T00:04:25.799 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:25.804 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:25.804 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:25.946 INFO:teuthology.orchestra.run.smithi052.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:25.951 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/643 2023-10-01T00:04:25.951 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/643 2023-10-01T00:04:25.951 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:25.954 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:25.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:25.964 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-10-01T00:04:26.192 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:26.196 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:26.197 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:26.356 INFO:teuthology.orchestra.run.smithi052.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-10-01T00:04:26.360 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/644 2023-10-01T00:04:26.360 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/644 2023-10-01T00:04:26.360 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:26.363 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:26.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:26.372 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-10-01T00:04:26.555 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:26.559 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:26.559 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:26.662 INFO:teuthology.orchestra.run.smithi052.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-10-01T00:04:26.665 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/645 2023-10-01T00:04:26.665 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/645 2023-10-01T00:04:26.665 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:26.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:26.676 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-10-01T00:04:26.862 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:26.866 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:26.866 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:26.977 INFO:teuthology.orchestra.run.smithi052.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:26.981 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/646 2023-10-01T00:04:26.981 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/646 2023-10-01T00:04:26.982 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:26.984 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:26.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:26.992 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-10-01T00:04:27.191 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:27.196 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:27.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:27.642 INFO:teuthology.orchestra.run.smithi052.stdout:generic/647 0s 2023-10-01T00:04:27.650 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/647 2023-10-01T00:04:27.650 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:27.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:27.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:27.666 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-10-01T00:04:28.242 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:28.246 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:28.246 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:28.368 INFO:teuthology.orchestra.run.smithi052.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T00:04:28.372 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/648 2023-10-01T00:04:28.372 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/648 2023-10-01T00:04:28.372 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:28.374 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:28.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:28.383 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-10-01T00:04:28.570 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:28.574 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:28.741 INFO:teuthology.orchestra.run.smithi052.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-01T00:04:28.744 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/649 2023-10-01T00:04:28.744 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/649 2023-10-01T00:04:28.745 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T00:04:28.747 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T00:04:28.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T00:04:28.755 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-10-01T00:04:29.302 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T00:04:29.307 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T00:04:29.307 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:46.689 INFO:teuthology.orchestra.run.smithi052.stdout:generic/650 3557s 2023-10-01T01:03:46.704 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/650 2023-10-01T01:03:46.704 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:46.705 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:46.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:46.716 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-10-01T01:03:47.017 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:47.022 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:47.022 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:47.215 INFO:teuthology.orchestra.run.smithi052.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:47.223 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/651 2023-10-01T01:03:47.223 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/651 2023-10-01T01:03:47.223 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:47.226 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:47.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:47.243 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-10-01T01:03:47.537 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:48.211 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:48.211 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:48.211 INFO:teuthology.orchestra.run.smithi052.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:48.212 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/652 2023-10-01T01:03:48.212 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/652 2023-10-01T01:03:48.212 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:48.212 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:48.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:48.212 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-10-01T01:03:48.466 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:48.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:48.645 INFO:teuthology.orchestra.run.smithi052.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:48.649 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/653 2023-10-01T01:03:48.649 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/653 2023-10-01T01:03:48.649 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:48.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:48.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:48.678 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-10-01T01:03:49.030 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:49.543 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:49.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:49.543 INFO:teuthology.orchestra.run.smithi052.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:49.543 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/654 2023-10-01T01:03:49.544 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/654 2023-10-01T01:03:49.544 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:49.544 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:49.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:49.544 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-10-01T01:03:49.880 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:49.885 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:49.885 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:50.152 INFO:teuthology.orchestra.run.smithi052.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:50.508 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/655 2023-10-01T01:03:50.623 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/655 2023-10-01T01:03:50.623 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:50.624 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:50.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:50.624 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-10-01T01:03:50.887 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:51.031 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:51.031 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:51.164 INFO:teuthology.orchestra.run.smithi052.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-10-01T01:03:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/656 2023-10-01T01:03:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/656 2023-10-01T01:03:51.173 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:51.176 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:51.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:51.185 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-10-01T01:03:51.476 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:51.481 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:51.481 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:51.706 INFO:teuthology.orchestra.run.smithi052.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:51.710 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/657 2023-10-01T01:03:51.710 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/657 2023-10-01T01:03:51.710 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:51.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:51.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:51.726 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-10-01T01:03:52.038 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:52.042 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:52.043 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:52.246 INFO:teuthology.orchestra.run.smithi052.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:52.371 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/658 2023-10-01T01:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/658 2023-10-01T01:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:52.372 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:52.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:52.372 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-10-01T01:03:52.675 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:52.680 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:52.680 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:52.837 INFO:teuthology.orchestra.run.smithi052.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:52.842 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/659 2023-10-01T01:03:52.843 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/659 2023-10-01T01:03:52.843 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:52.846 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:52.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:52.860 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-10-01T01:03:53.187 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:53.192 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:53.193 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:53.397 INFO:teuthology.orchestra.run.smithi052.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:53.408 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/660 2023-10-01T01:03:53.408 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/660 2023-10-01T01:03:53.408 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:53.410 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:53.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:53.420 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-10-01T01:03:53.711 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:53.716 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:53.717 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:53.875 INFO:teuthology.orchestra.run.smithi052.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:53.879 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/661 2023-10-01T01:03:53.879 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/661 2023-10-01T01:03:53.879 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:53.881 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:53.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:53.893 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-10-01T01:03:54.184 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:54.527 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:54.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:54.527 INFO:teuthology.orchestra.run.smithi052.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:54.527 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/662 2023-10-01T01:03:54.527 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/662 2023-10-01T01:03:54.527 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:54.528 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:54.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:54.528 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-10-01T01:03:54.828 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:54.833 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:54.833 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:54.984 INFO:teuthology.orchestra.run.smithi052.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:54.989 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/663 2023-10-01T01:03:54.989 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/663 2023-10-01T01:03:54.989 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:54.991 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:55.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:55.013 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-10-01T01:03:55.277 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:55.287 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:55.287 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:55.439 INFO:teuthology.orchestra.run.smithi052.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:55.443 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/664 2023-10-01T01:03:55.444 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/664 2023-10-01T01:03:55.444 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:55.447 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:55.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:55.467 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-10-01T01:03:55.801 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:55.806 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:55.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:55.972 INFO:teuthology.orchestra.run.smithi052.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:56.077 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/665 2023-10-01T01:03:56.077 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/665 2023-10-01T01:03:56.077 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:56.077 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:56.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:56.078 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-10-01T01:03:56.355 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:56.365 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:56.365 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:56.537 INFO:teuthology.orchestra.run.smithi052.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:56.542 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/666 2023-10-01T01:03:56.542 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/666 2023-10-01T01:03:56.542 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:56.545 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:56.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:56.558 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-10-01T01:03:56.862 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:56.941 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:56.941 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:57.049 INFO:teuthology.orchestra.run.smithi052.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:57.054 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/667 2023-10-01T01:03:57.054 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/667 2023-10-01T01:03:57.054 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:57.057 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:57.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:57.069 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-10-01T01:03:57.405 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:57.410 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:57.410 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:57.605 INFO:teuthology.orchestra.run.smithi052.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:57.609 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/668 2023-10-01T01:03:57.609 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/668 2023-10-01T01:03:57.609 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:57.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:57.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:57.639 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-10-01T01:03:57.911 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:57.916 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:57.917 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:58.089 INFO:teuthology.orchestra.run.smithi052.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:58.094 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/669 2023-10-01T01:03:58.094 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/669 2023-10-01T01:03:58.094 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:58.097 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:58.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:58.106 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-10-01T01:03:58.377 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:58.394 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:58.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:58.551 INFO:teuthology.orchestra.run.smithi052.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:58.556 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/670 2023-10-01T01:03:58.556 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/670 2023-10-01T01:03:58.556 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:58.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:58.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:58.591 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-10-01T01:03:58.867 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:58.872 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:58.872 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:59.043 INFO:teuthology.orchestra.run.smithi052.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:59.047 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/671 2023-10-01T01:03:59.047 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/671 2023-10-01T01:03:59.047 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:59.053 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:59.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:59.062 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-10-01T01:03:59.375 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:59.450 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:59.450 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:59.537 INFO:teuthology.orchestra.run.smithi052.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:03:59.621 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/672 2023-10-01T01:03:59.621 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/672 2023-10-01T01:03:59.621 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:03:59.621 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:03:59.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:03:59.621 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-10-01T01:03:59.942 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:03:59.946 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:03:59.946 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:04:00.469 INFO:teuthology.orchestra.run.smithi052.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:04:00.474 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/673 2023-10-01T01:04:00.475 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/673 2023-10-01T01:04:00.475 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:04:00.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:04:00.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:04:00.495 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-10-01T01:04:00.797 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:04:00.803 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:04:00.803 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:04:01.011 INFO:teuthology.orchestra.run.smithi052.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:04:01.016 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/674 2023-10-01T01:04:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/674 2023-10-01T01:04:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:04:01.020 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:04:01.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:04:01.205 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-10-01T01:04:01.508 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:04:01.516 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:04:01.516 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:04:01.987 INFO:teuthology.orchestra.run.smithi052.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:04:01.994 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/675 2023-10-01T01:04:01.995 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/675 2023-10-01T01:04:01.995 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:04:01.995 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:04:02.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:04:02.010 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-10-01T01:04:02.311 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:04:02.397 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:04:02.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:25.609 INFO:teuthology.orchestra.run.smithi052.stdout:generic/676 1703s 2023-10-01T01:32:25.685 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/676 2023-10-01T01:32:25.685 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:25.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:25.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:25.705 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-10-01T01:32:26.539 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:26.549 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:26.549 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:27.455 INFO:teuthology.orchestra.run.smithi052.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:27.459 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/677 2023-10-01T01:32:27.460 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/677 2023-10-01T01:32:27.460 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:27.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:27.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:27.484 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-10-01T01:32:27.840 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:27.845 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:27.845 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:28.788 INFO:teuthology.orchestra.run.smithi052.stdout:generic/678 [not run] kernel does not support IO_URING 2023-10-01T01:32:28.793 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/678 2023-10-01T01:32:28.794 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/678 2023-10-01T01:32:28.794 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:28.798 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:28.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:28.811 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-10-01T01:32:29.124 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:29.128 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:29.129 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:29.277 INFO:teuthology.orchestra.run.smithi052.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:29.283 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/679 2023-10-01T01:32:29.283 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/679 2023-10-01T01:32:29.283 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:29.284 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:29.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:29.294 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-10-01T01:32:29.559 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:29.563 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:29.563 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:30.401 INFO:teuthology.orchestra.run.smithi052.stdout:generic/680 1s 2023-10-01T01:32:30.412 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/680 2023-10-01T01:32:30.412 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:30.414 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:30.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:30.423 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-10-01T01:32:31.100 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:31.110 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:31.110 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:31.979 INFO:teuthology.orchestra.run.smithi052.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-01T01:32:31.983 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/681 2023-10-01T01:32:31.983 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/681 2023-10-01T01:32:31.983 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:31.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:31.997 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-10-01T01:32:32.273 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:32.395 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:32.395 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:32.520 INFO:teuthology.orchestra.run.smithi052.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-01T01:32:32.525 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/682 2023-10-01T01:32:32.525 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/682 2023-10-01T01:32:32.525 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:32.529 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:32.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:32.538 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-10-01T01:32:32.836 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:32.841 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:32.841 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:33.223 INFO:teuthology.orchestra.run.smithi052.stdout:generic/683 [not run] /tmp/tmp.NXbAzGS4G1test: file alloc unit 4194304 larger than op length 65536 2023-10-01T01:32:33.228 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/683 2023-10-01T01:32:33.228 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/683 2023-10-01T01:32:33.228 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:33.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:33.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:33.249 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-10-01T01:32:33.526 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:33.539 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:35.126 INFO:teuthology.orchestra.run.smithi052.stdout:generic/684 [not run] /tmp/tmp.NXbAzGS4G1test: file alloc unit 4194304 larger than op length 65536 2023-10-01T01:32:35.131 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/684 2023-10-01T01:32:35.132 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/684 2023-10-01T01:32:35.132 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:35.139 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:35.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:35.153 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-10-01T01:32:35.465 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:35.470 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:35.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:36.939 INFO:teuthology.orchestra.run.smithi052.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-01T01:32:36.949 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/685 2023-10-01T01:32:36.949 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/685 2023-10-01T01:32:36.949 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:36.952 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:36.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:36.971 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-10-01T01:32:37.276 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:37.296 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:37.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:38.844 INFO:teuthology.orchestra.run.smithi052.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-01T01:32:39.104 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/686 2023-10-01T01:32:39.185 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/686 2023-10-01T01:32:39.185 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:39.185 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:39.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:39.185 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-10-01T01:32:39.464 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:39.469 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:39.469 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:41.043 INFO:teuthology.orchestra.run.smithi052.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-01T01:32:41.047 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/687 2023-10-01T01:32:41.048 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/687 2023-10-01T01:32:41.048 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:41.050 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:41.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:41.061 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-10-01T01:32:41.405 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:41.410 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:41.410 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:41.808 INFO:teuthology.orchestra.run.smithi052.stdout:generic/688 [not run] /tmp/tmp.NXbAzGS4G1test: file alloc unit 4194304 larger than op length 65536 2023-10-01T01:32:41.812 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/688 2023-10-01T01:32:41.812 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/688 2023-10-01T01:32:41.812 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:41.815 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:41.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:41.831 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-10-01T01:32:42.103 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:42.108 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:42.108 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:42.382 INFO:teuthology.orchestra.run.smithi052.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-10-01T01:32:42.386 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/689 2023-10-01T01:32:42.386 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/689 2023-10-01T01:32:42.387 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:42.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:42.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:42.405 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-10-01T01:32:42.699 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:42.704 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:42.704 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:42.978 INFO:teuthology.orchestra.run.smithi052.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:43.035 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/690 2023-10-01T01:32:43.036 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/690 2023-10-01T01:32:43.036 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:43.036 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:43.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:43.036 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-10-01T01:32:43.316 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:43.637 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:43.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:43.637 INFO:teuthology.orchestra.run.smithi052.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:43.637 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/691 2023-10-01T01:32:43.637 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/691 2023-10-01T01:32:43.637 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:43.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:43.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:43.638 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-10-01T01:32:43.933 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:45.889 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:45.889 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:45.889 INFO:teuthology.orchestra.run.smithi052.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:45.890 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/692 2023-10-01T01:32:45.890 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/692 2023-10-01T01:32:45.890 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:45.890 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:45.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:45.890 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-10-01T01:32:46.249 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:46.315 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:46.315 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:46.508 INFO:teuthology.orchestra.run.smithi052.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:46.513 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/693 2023-10-01T01:32:46.514 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/693 2023-10-01T01:32:46.514 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:46.708 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:46.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:46.709 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-10-01T01:32:47.005 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:47.117 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:47.117 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:47.778 INFO:teuthology.orchestra.run.smithi052.stdout:generic/694 0s 2023-10-01T01:32:47.848 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/694 2023-10-01T01:32:47.848 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:47.848 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:47.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:47.849 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-10-01T01:32:48.123 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:48.163 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:48.164 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:48.338 INFO:teuthology.orchestra.run.smithi052.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:48.343 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/695 2023-10-01T01:32:48.457 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/695 2023-10-01T01:32:48.458 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:48.459 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:48.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:48.459 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-10-01T01:32:48.724 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:48.773 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:48.773 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:48.900 INFO:teuthology.orchestra.run.smithi052.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:48.933 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/696 2023-10-01T01:32:48.934 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/696 2023-10-01T01:32:48.934 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:48.934 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:48.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:48.934 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-10-01T01:32:49.254 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:49.260 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:49.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:49.511 INFO:teuthology.orchestra.run.smithi052.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-01T01:32:50.333 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/697 2023-10-01T01:32:50.334 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/697 2023-10-01T01:32:50.334 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:50.334 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:50.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:50.339 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-10-01T01:32:50.633 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:50.638 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:50.638 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:50.918 INFO:teuthology.orchestra.run.smithi052.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:50.922 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/698 2023-10-01T01:32:50.922 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/698 2023-10-01T01:32:50.923 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:50.925 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:50.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:50.941 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-10-01T01:32:51.220 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:51.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:51.486 INFO:teuthology.orchestra.run.smithi052.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:51.491 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/699 2023-10-01T01:32:51.491 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/699 2023-10-01T01:32:51.491 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:51.494 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:51.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:51.513 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-10-01T01:32:51.806 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:51.878 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:51.879 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:51.991 INFO:teuthology.orchestra.run.smithi052.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:51.995 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/700 2023-10-01T01:32:52.028 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/700 2023-10-01T01:32:52.028 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:52.029 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:52.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:52.029 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-10-01T01:32:52.314 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:52.318 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:52.318 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:52.890 INFO:teuthology.orchestra.run.smithi052.stdout:generic/701 0s 2023-10-01T01:32:52.895 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/701 2023-10-01T01:32:52.895 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:52.898 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:52.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:52.911 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-10-01T01:32:53.633 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:53.666 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:53.666 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:53.785 INFO:teuthology.orchestra.run.smithi052.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:54.201 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/702 2023-10-01T01:32:54.201 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/702 2023-10-01T01:32:54.201 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:54.226 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:54.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:54.226 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-10-01T01:32:54.543 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:54.548 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:54.805 INFO:teuthology.orchestra.run.smithi052.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:54.809 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/703 2023-10-01T01:32:54.809 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/703 2023-10-01T01:32:54.809 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:54.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:54.833 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-10-01T01:32:55.121 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:55.126 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:55.126 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:55.827 INFO:teuthology.orchestra.run.smithi052.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-10-01T01:32:55.831 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/704 2023-10-01T01:32:55.831 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/704 2023-10-01T01:32:55.831 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:55.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:55.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:55.854 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-10-01T01:32:56.156 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:56.161 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:56.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:56.361 INFO:teuthology.orchestra.run.smithi052.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:56.365 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/705 2023-10-01T01:32:56.366 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/705 2023-10-01T01:32:56.366 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:56.368 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:56.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:56.384 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-10-01T01:32:56.663 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:56.668 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:56.668 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:58.942 INFO:teuthology.orchestra.run.smithi052.stdout:generic/706 2s 2023-10-01T01:32:58.948 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/706 2023-10-01T01:32:58.948 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:58.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:58.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:58.969 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-10-01T01:32:59.642 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:32:59.648 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:32:59.648 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:59.834 INFO:teuthology.orchestra.run.smithi052.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-10-01T01:32:59.841 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/707 2023-10-01T01:32:59.841 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/707 2023-10-01T01:32:59.841 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:32:59.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:32:59.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:32:59.860 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-10-01T01:33:00.133 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:00.137 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:00.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:01.010 INFO:teuthology.orchestra.run.smithi052.stdout:generic/708 0s 2023-10-01T01:33:01.028 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/708 2023-10-01T01:33:01.028 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:01.031 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:01.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:01.044 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-10-01T01:33:01.716 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:01.721 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:01.721 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:01.979 INFO:teuthology.orchestra.run.smithi052.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:01.982 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/709 2023-10-01T01:33:01.983 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/709 2023-10-01T01:33:01.983 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:01.985 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:02.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:02.003 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-10-01T01:33:02.662 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:02.666 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:02.667 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:02.973 INFO:teuthology.orchestra.run.smithi052.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:02.977 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/710 2023-10-01T01:33:02.977 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/710 2023-10-01T01:33:02.977 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:02.979 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:02.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:02.990 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-10-01T01:33:03.675 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:03.686 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:03.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:03.940 INFO:teuthology.orchestra.run.smithi052.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:03.945 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/711 2023-10-01T01:33:03.945 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/711 2023-10-01T01:33:03.945 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:03.954 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:03.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:03.979 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-10-01T01:33:04.602 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:04.607 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:04.607 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:04.958 INFO:teuthology.orchestra.run.smithi052.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:04.962 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/712 2023-10-01T01:33:04.962 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/712 2023-10-01T01:33:04.962 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:04.965 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:04.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:04.984 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-10-01T01:33:05.638 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:05.643 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:05.643 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:05.872 INFO:teuthology.orchestra.run.smithi052.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-10-01T01:33:05.877 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/713 2023-10-01T01:33:05.877 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/713 2023-10-01T01:33:05.877 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:05.880 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:05.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:05.896 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-10-01T01:33:06.565 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:06.582 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:06.582 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:06.847 INFO:teuthology.orchestra.run.smithi052.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:07.004 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/714 2023-10-01T01:33:07.004 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/714 2023-10-01T01:33:07.004 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:07.005 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:07.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:07.005 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-10-01T01:33:07.582 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:07.815 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:07.829 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:07.829 INFO:teuthology.orchestra.run.smithi052.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-10-01T01:33:07.829 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/715 2023-10-01T01:33:07.829 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/715 2023-10-01T01:33:07.829 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:07.829 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:07.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:07.893 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-10-01T01:33:08.469 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:08.471 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:08.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:08.713 INFO:teuthology.orchestra.run.smithi052.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:09.027 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/716 2023-10-01T01:33:09.028 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/716 2023-10-01T01:33:09.028 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:09.028 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:09.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:09.028 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-10-01T01:33:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:09.370 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:09.370 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:09.590 INFO:teuthology.orchestra.run.smithi052.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:09.598 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/717 2023-10-01T01:33:09.599 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/717 2023-10-01T01:33:09.599 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:09.601 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:09.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:09.616 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-10-01T01:33:10.273 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:10.350 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:10.350 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:10.539 INFO:teuthology.orchestra.run.smithi052.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:10.544 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/718 2023-10-01T01:33:10.544 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/718 2023-10-01T01:33:10.544 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:10.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:10.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:10.571 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-10-01T01:33:11.180 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:11.196 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:11.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:11.425 INFO:teuthology.orchestra.run.smithi052.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:11.429 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/719 2023-10-01T01:33:11.430 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/719 2023-10-01T01:33:11.430 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:11.433 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:11.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:11.443 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-10-01T01:33:12.162 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:12.195 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:12.198 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:12.394 INFO:teuthology.orchestra.run.smithi052.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:12.398 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/720 2023-10-01T01:33:12.399 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/720 2023-10-01T01:33:12.399 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:12.401 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:12.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:12.413 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-10-01T01:33:13.029 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:13.094 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:13.245 INFO:teuthology.orchestra.run.smithi052.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-10-01T01:33:13.250 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/721 2023-10-01T01:33:13.250 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/721 2023-10-01T01:33:13.250 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:13.253 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:13.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:13.269 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-10-01T01:33:13.559 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:13.564 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:13.564 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:13.830 INFO:teuthology.orchestra.run.smithi052.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-01T01:33:13.834 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/722 2023-10-01T01:33:13.834 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/722 2023-10-01T01:33:13.834 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:13.836 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:13.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:13.852 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-10-01T01:33:14.533 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:14.537 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:14.537 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:14.784 INFO:teuthology.orchestra.run.smithi052.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-01T01:33:14.789 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/723 2023-10-01T01:33:14.790 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/723 2023-10-01T01:33:14.790 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:14.792 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:14.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:14.811 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-10-01T01:33:15.427 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:15.432 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:15.432 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:15.689 INFO:teuthology.orchestra.run.smithi052.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-01T01:33:15.693 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/724 2023-10-01T01:33:15.693 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/724 2023-10-01T01:33:15.693 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:15.695 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:15.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:15.707 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-10-01T01:33:16.350 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:16.355 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:16.355 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:16.576 INFO:teuthology.orchestra.run.smithi052.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-01T01:33:16.581 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/725 2023-10-01T01:33:16.581 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/725 2023-10-01T01:33:16.581 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:16.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:16.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:16.601 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-10-01T01:33:17.253 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:17.258 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:17.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:17.846 INFO:teuthology.orchestra.run.smithi052.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-01T01:33:17.851 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/726 2023-10-01T01:33:17.851 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/726 2023-10-01T01:33:17.851 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:17.853 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:17.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:17.882 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-10-01T01:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:19.067 INFO:teuthology.orchestra.run.smithi052.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-01T01:33:19.071 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/727 2023-10-01T01:33:19.071 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/727 2023-10-01T01:33:19.071 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:19.073 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:19.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:19.084 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-10-01T01:33:19.677 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:19.683 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:19.683 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:23.983 INFO:teuthology.orchestra.run.smithi052.stdout:generic/728 4s 2023-10-01T01:33:23.994 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/728 2023-10-01T01:33:23.994 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:23.997 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:24.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:24.016 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-10-01T01:33:24.310 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:24.310 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:24.310 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:24.908 INFO:teuthology.orchestra.run.smithi052.stdout:generic/729 0s 2023-10-01T01:33:24.930 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/729 2023-10-01T01:33:24.930 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:24.932 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:24.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:24.952 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-10-01T01:33:25.668 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:25.674 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:25.674 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:25.876 INFO:teuthology.orchestra.run.smithi052.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-10-01T01:33:25.880 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/730 2023-10-01T01:33:25.880 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/730 2023-10-01T01:33:25.880 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:25.883 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:25.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:25.900 DEBUG:teuthology.orchestra.run.smithi052:> (cd /tmp/tmp.qvcny3LNTMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-10-01T01:33:26.201 INFO:teuthology.orchestra.run.smithi052.stdout:FSTYP -- ceph-fuse 2023-10-01T01:33:26.208 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM -- Linux/x86_64 smithi052 5.15.0-84-generic #93-Ubuntu SMP Tue Sep 5 17:16:10 UTC 2023 2023-10-01T01:33:26.208 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:26.389 INFO:teuthology.orchestra.run.smithi052.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-10-01T01:33:26.843 INFO:teuthology.orchestra.run.smithi052.stdout:Ran: generic/731 2023-10-01T01:33:26.844 INFO:teuthology.orchestra.run.smithi052.stdout:Not run: generic/731 2023-10-01T01:33:26.844 INFO:teuthology.orchestra.run.smithi052.stdout:Passed all 1 tests 2023-10-01T01:33:26.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:26.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-01T01:33:26.844 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-10-01T01:33:26.844 DEBUG:teuthology.orchestra.run.smithi052:> sudo userdel --force --remove fsgqa 2023-10-01T01:33:27.042 INFO:teuthology.orchestra.run.smithi052.stderr:userdel: user fsgqa is currently used by process 464883 2023-10-01T01:33:27.052 INFO:teuthology.orchestra.run.smithi052.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-10-01T01:33:27.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo userdel --force --remove 123456-fsgqa 2023-10-01T01:33:27.645 INFO:teuthology.orchestra.run.smithi052.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-10-01T01:33:27.645 INFO:teuthology.orchestra.run.smithi052.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-10-01T01:33:27.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo groupdel fsgqa 2023-10-01T01:33:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:groupdel: group 'fsgqa' does not exist 2023-10-01T01:33:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-01T01:33:28.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:28.019 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.qvcny3LNTMxfstests-dev/results) 2023-10-01T01:33:28.070 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-10-01T01:33:28.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T01:33:28.071 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.qvcny3LNTMxfstests-dev 2023-10-01T01:33:28.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf /tmp/tmp.qvcny3LNTMxfstests-dev 2023-10-01T01:33:28.592 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-01T01:33:28.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-01T01:33:28.735 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-01T01:33:29.047 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-01T01:33:29.047 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-10-01T01:33:29.047 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:29.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339636k,nr_inodes=4084909,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-01T01:33:29.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:33:29.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:29.077 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-01T01:33:29.137 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-10-01T01:33:29.137 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:29.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336536k,nr_inodes=4084134,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18858 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-01T01:33:29.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:33:29.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:29.151 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-01T01:33:29.205 INFO:teuthology.orchestra.run.smithi186.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-01T01:33:29.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T01:33:29.206 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-10-01T01:33:29.206 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:29.211 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339636k,nr_inodes=4084909,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-01T01:33:29.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:33:29.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:29.212 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-01T01:33:29.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T01:33:29.260 INFO:teuthology.orchestra.run.smithi052.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-01T01:33:29.261 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-10-01T01:33:29.261 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:29.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336536k,nr_inodes=4084134,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18858 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-01T01:33:29.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:33:29.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:29.269 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-01T01:33:29.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T01:33:29.318 INFO:teuthology.orchestra.run.smithi186.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-01T01:33:29.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T01:33:30.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.995+0000 7f1d19e13640 1 Processor -- start 2023-10-01T01:33:30.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.995+0000 7f1d19e13640 1 -- start start 2023-10-01T01:33:30.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.995+0000 7f1d19e13640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1d140b2a20 0x7f1d140d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d19e13640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d140cf7a0 con 0x7f1d140cfc30 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d19e13640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d140ce8b0 con 0x7f1d1415a970 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d19e13640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d140ceb90 con 0x7f1d140b2a20 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d12ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1d140cfc30 0x7f1d140b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59294/0 (socket says 172.21.15.52:59294) 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d12ffd640 1 -- 172.21.15.52:0/3270600750 learned_addr learned my addr 172.21.15.52:0/3270600750 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d13fff640 1 --2- 172.21.15.52:0/3270600750 >> v2:172.21.15.186:3300/0 conn(0x7f1d140b2a20 0x7f1d140d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d127fc640 1 -- 172.21.15.52:0/3270600750 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410774355 0 0) 0x7f1d140cf7a0 con 0x7f1d140cfc30 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d127fc640 1 -- 172.21.15.52:0/3270600750 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cfc003530 con 0x7f1d140cfc30 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d13fff640 1 -- 172.21.15.52:0/3270600750 >> v1:172.21.15.186:6789/0 conn(0x7f1d1415a970 legacy=0x7f1d140b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d13fff640 1 -- 172.21.15.52:0/3270600750 >> v1:172.21.15.52:6789/0 conn(0x7f1d140cfc30 legacy=0x7f1d140b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:29.999+0000 7f1d13fff640 1 -- 172.21.15.52:0/3270600750 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d140cee70 con 0x7f1d140b2a20 2023-10-01T01:33:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.003+0000 7f1d13fff640 1 --2- 172.21.15.52:0/3270600750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d140b2a20 0x7f1d140d00b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1d040097c0 tx=0x7f1d0401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c64b6e3feb44b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.007+0000 7f1d127fc640 1 -- 172.21.15.52:0/3270600750 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d040ab600 con 0x7f1d140b2a20 2023-10-01T01:33:30.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.007+0000 7f1d127fc640 1 -- 172.21.15.52:0/3270600750 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d040a7050 con 0x7f1d140b2a20 2023-10-01T01:33:30.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.007+0000 7f1d127fc640 1 -- 172.21.15.52:0/3270600750 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d040ab980 con 0x7f1d140b2a20 2023-10-01T01:33:30.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 -- 172.21.15.52:0/3270600750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d140b2a20 msgr2=0x7f1d140d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 --2- 172.21.15.52:0/3270600750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d140b2a20 0x7f1d140d00b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1d040097c0 tx=0x7f1d0401c480 comp rx=0 tx=0).stop 2023-10-01T01:33:30.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 -- 172.21.15.52:0/3270600750 shutdown_connections 2023-10-01T01:33:30.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 --2- 172.21.15.52:0/3270600750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d140b2a20 0x7f1d140d00b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 -- 172.21.15.52:0/3270600750 >> 172.21.15.52:0/3270600750 conn(0x7f1d140cd310 msgr2=0x7f1d140cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:30.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 -- 172.21.15.52:0/3270600750 shutdown_connections 2023-10-01T01:33:30.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.011+0000 7f1d19e13640 1 -- 172.21.15.52:0/3270600750 wait complete. 2023-10-01T01:33:30.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 Processor -- start 2023-10-01T01:33:30.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 -- start start 2023-10-01T01:33:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 0x7f1d1406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d140cfc30 0x7f1d140ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1415a970 0x7f1d14148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1406cf60 con 0x7f1d140b2a20 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1415a470 con 0x7f1d1415a970 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140ac200 con 0x7f1d140cfc30 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 0x7f1d1406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 0x7f1d1406ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60718/0 (socket says 172.21.15.52:60718) 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 -- 172.21.15.52:0/2133591179 learned_addr learned my addr 172.21.15.52:0/2133591179 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d12ffd640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d140cfc30 0x7f1d140ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d13fff640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1415a970 0x7f1d14148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 -- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d140cfc30 msgr2=0x7f1d140ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d140cfc30 0x7f1d140ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 -- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1415a970 msgr2=0x7f1d14148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1415a970 0x7f1d14148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 -- 172.21.15.52:0/2133591179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04009420 con 0x7f1d140b2a20 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d137fe640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 0x7f1d1406ca20 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c370 tx=0x7f1d0800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080052d0 con 0x7f1d140b2a20 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08005430 con 0x7f1d140b2a20 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d140ac4e0 con 0x7f1d140b2a20 2023-10-01T01:33:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.015+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08007260 con 0x7f1d140b2a20 2023-10-01T01:33:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.023+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1d080073c0 con 0x7f1d140b2a20 2023-10-01T01:33:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.023+0000 7f1cfbfff640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d000661b0 0x7f1d00068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.023+0000 7f1d12ffd640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d000661b0 0x7f1d00068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.023+0000 7f1d12ffd640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d000661b0 0x7f1d00068670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001570 tx=0x7f1d0c001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.031+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d140acaa0 con 0x7f1d140b2a20 2023-10-01T01:33:30.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.035+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1d0805a080 con 0x7f1d140b2a20 2023-10-01T01:33:30.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.035+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d14066750 con 0x7f1d140b2a20 2023-10-01T01:33:30.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.043+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1d08050240 con 0x7f1d140b2a20 2023-10-01T01:33:30.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.323+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d140740a0 con 0x7f1d140b2a20 2023-10-01T01:33:30.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1cfbfff640 1 -- 172.21.15.52:0/2133591179 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f1d08053860 con 0x7f1d140b2a20 2023-10-01T01:33:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:30.333 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:50:15.359964+0000","modified":"2023-09-30T16:50:17.412644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4945":{"gid":4945,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.186:6837/2755050347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2755050347},{"type":"v1","addr":"172.21.15.186:6837","nonce":2755050347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-01T01:33:30.334 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 14 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d000661b0 msgr2=0x7f1d00068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d000661b0 0x7f1d00068670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001570 tx=0x7f1d0c001aa0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 msgr2=0x7f1d1406ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 0x7f1d1406ca20 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c370 tx=0x7f1d0800c830 comp rx=0 tx=0).stop 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 shutdown_connections 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1d000661b0 0x7f1d00068670 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1415a970 0x7f1d14148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d140cfc30 0x7f1d140ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 --2- 172.21.15.52:0/2133591179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d140b2a20 0x7f1d1406ca20 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 >> 172.21.15.52:0/2133591179 conn(0x7f1d140cd310 msgr2=0x7f1d140b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:30.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 shutdown_connections 2023-10-01T01:33:30.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.327+0000 7f1d19e13640 1 -- 172.21.15.52:0/2133591179 wait complete. 2023-10-01T01:33:30.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T01:33:30.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d95ec9640 1 Processor -- start 2023-10-01T01:33:30.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d95ec9640 1 -- start start 2023-10-01T01:33:30.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d95ec9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0d9015ab80 0x7f0d900ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d95ec9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900cbf30 con 0x7f0d900cbaa0 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d95ec9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900cf840 con 0x7f0d900cf3e0 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d95ec9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900cc1c0 con 0x7f0d9015ab80 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0d900cbaa0 0x7f0d900c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59308/0 (socket says 172.21.15.52:59308) 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8ffff640 1 -- 172.21.15.52:0/2030723305 learned_addr learned my addr 172.21.15.52:0/2030723305 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8effd640 1 --1- 172.21.15.52:0/2030723305 >> v1:172.21.15.186:6789/0 conn(0x7f0d900cf3e0 0x7f0d900cb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:44288/0 (socket says 172.21.15.52:44288) 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8f7fe640 1 --2- 172.21.15.52:0/2030723305 >> v2:172.21.15.186:3300/0 conn(0x7f0d9015ab80 0x7f0d900ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8f7fe640 1 -- 172.21.15.52:0/2030723305 >> v1:172.21.15.186:6789/0 conn(0x7f0d900cf3e0 legacy=0x7f0d900cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8f7fe640 1 -- 172.21.15.52:0/2030723305 >> v1:172.21.15.52:6789/0 conn(0x7f0d900cbaa0 legacy=0x7f0d900c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8e7fc640 1 -- 172.21.15.52:0/2030723305 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953677841 0 0) 0x7f0d900cf840 con 0x7f0d900cf3e0 2023-10-01T01:33:30.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.507+0000 7f0d8f7fe640 1 -- 172.21.15.52:0/2030723305 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900cc4a0 con 0x7f0d9015ab80 2023-10-01T01:33:30.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.511+0000 7f0d8f7fe640 1 --2- 172.21.15.52:0/2030723305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d9015ab80 0x7f0d900ceea0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0d800097a0 tx=0x7f0d8001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69aa89334f82765f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.511+0000 7f0d8e7fc640 1 -- 172.21.15.52:0/2030723305 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800a8970 con 0x7f0d9015ab80 2023-10-01T01:33:30.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.511+0000 7f0d8e7fc640 1 -- 172.21.15.52:0/2030723305 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d800a8ad0 con 0x7f0d9015ab80 2023-10-01T01:33:30.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.511+0000 7f0d8e7fc640 1 -- 172.21.15.52:0/2030723305 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800a8e60 con 0x7f0d9015ab80 2023-10-01T01:33:30.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 -- 172.21.15.52:0/2030723305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d9015ab80 msgr2=0x7f0d900ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/2030723305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d9015ab80 0x7f0d900ceea0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0d800097a0 tx=0x7f0d8001ec70 comp rx=0 tx=0).stop 2023-10-01T01:33:30.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 -- 172.21.15.52:0/2030723305 shutdown_connections 2023-10-01T01:33:30.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/2030723305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d9015ab80 0x7f0d900ceea0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 -- 172.21.15.52:0/2030723305 >> 172.21.15.52:0/2030723305 conn(0x7f0d90089ff0 msgr2=0x7f0d90099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:30.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 -- 172.21.15.52:0/2030723305 shutdown_connections 2023-10-01T01:33:30.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.515+0000 7f0d95ec9640 1 -- 172.21.15.52:0/2030723305 wait complete. 2023-10-01T01:33:30.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 Processor -- start 2023-10-01T01:33:30.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- start start 2023-10-01T01:33:30.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d900cbaa0 0x7f0d900c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d900cf3e0 0x7f0d90150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 0x7f0d9006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90151290 con 0x7f0d9015ab80 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d901f2200 con 0x7f0d900cf3e0 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d901f24c0 con 0x7f0d900cbaa0 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 0x7f0d9006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 0x7f0d9006c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60734/0 (socket says 172.21.15.52:60734) 2023-10-01T01:33:30.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 -- 172.21.15.52:0/3339462101 learned_addr learned my addr 172.21.15.52:0/3339462101 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8effd640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d900cf3e0 0x7f0d90150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 -- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d900cbaa0 msgr2=0x7f0d900c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d900cbaa0 0x7f0d900c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 -- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d900cf3e0 msgr2=0x7f0d90150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d900cf3e0 0x7f0d90150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 -- 172.21.15.52:0/3339462101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800093b0 con 0x7f0d9015ab80 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d8ffff640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 0x7f0d9006c5b0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800ca80 tx=0x7f0d8800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800ac30 con 0x7f0d9015ab80 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800ad90 con 0x7f0d9015ab80 2023-10-01T01:33:30.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d901f27a0 con 0x7f0d9015ab80 2023-10-01T01:33:30.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d901f2d60 con 0x7f0d9015ab80 2023-10-01T01:33:30.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88012600 con 0x7f0d9015ab80 2023-10-01T01:33:30.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d70005260 con 0x7f0d9015ab80 2023-10-01T01:33:30.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.519+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f0d88007070 con 0x7f0d9015ab80 2023-10-01T01:33:30.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.523+0000 7f0d77fff640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d7c066160 0x7f0d7c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.523+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0d88083ca0 con 0x7f0d9015ab80 2023-10-01T01:33:30.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.523+0000 7f0d8f7fe640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d7c066160 0x7f0d7c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.523+0000 7f0d8f7fe640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d7c066160 0x7f0d7c068620 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b2000 tx=0x7f0d80004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.527+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f0d880513d0 con 0x7f0d9015ab80 2023-10-01T01:33:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.763+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d700057e0 con 0x7f0d9015ab80 2023-10-01T01:33:30.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.779+0000 7f0d77fff640 1 -- 172.21.15.52:0/3339462101 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16769 (secure 0 0 0) 0x7f0d88001b50 con 0x7f0d9015ab80 2023-10-01T01:33:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:30.787 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:51:00.427901+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:50:13.342272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-30T16:50:14.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T01:33:30.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d7c066160 msgr2=0x7f0d7c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d7c066160 0x7f0d7c068620 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b2000 tx=0x7f0d80004740 comp rx=0 tx=0).stop 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 msgr2=0x7f0d9006c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 0x7f0d9006c5b0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800ca80 tx=0x7f0d8800cf40 comp rx=0 tx=0).stop 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 shutdown_connections 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d7c066160 0x7f0d7c068620 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9015ab80 0x7f0d9006c5b0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d900cf3e0 0x7f0d90150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 --2- 172.21.15.52:0/3339462101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d900cbaa0 0x7f0d900c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 >> 172.21.15.52:0/3339462101 conn(0x7f0d90089ff0 msgr2=0x7f0d90159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:30.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 shutdown_connections 2023-10-01T01:33:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.783+0000 7f0d95ec9640 1 -- 172.21.15.52:0/3339462101 wait complete. 2023-10-01T01:33:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T16:49:03.527089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T16:50:13.342272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T16:50:14.359534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-01T01:33:30.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.951+0000 7ff071c57640 1 Processor -- start 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.951+0000 7ff071c57640 1 -- start start 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.951+0000 7ff071c57640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 0x7ff06c06ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.951+0000 7ff071c57640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff06c06b120 0x7ff06c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.951+0000 7ff071c57640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0c3f30 con 0x7ff06c164580 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.951+0000 7ff071c57640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c06b620 con 0x7ff06c06b120 2023-10-01T01:33:30.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c06b900 con 0x7ff06c0b2a20 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff06c06b120 0x7ff06c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff062ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 0x7ff06c06ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff06c06b120 0x7ff06c0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:58430/0 (socket says 172.21.15.52:58430) 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff062ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 0x7ff06c06ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:55792/0 (socket says 172.21.15.52:55792) 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 -- 172.21.15.52:0/3064070428 learned_addr learned my addr 172.21.15.52:0/3064070428 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 -- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 msgr2=0x7ff06c06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 --2- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 0x7ff06c06ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 -- 172.21.15.52:0/3064070428 >> v1:172.21.15.52:6789/0 conn(0x7ff06c164580 legacy=0x7ff06c0b2310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 -- 172.21.15.52:0/3064070428 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c06bbe0 con 0x7ff06c06b120 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff062ffd640 1 --2- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 0x7ff06c06ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06bfff640 1 --2- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c06b120 0x7ff06c0cb370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff064009e50 tx=0x7ff06401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b20b795b5674140 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06affd640 1 -- 172.21.15.52:0/3064070428 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640a56e0 con 0x7ff06c06b120 2023-10-01T01:33:30.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06affd640 1 -- 172.21.15.52:0/3064070428 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0640a5840 con 0x7ff06c06b120 2023-10-01T01:33:30.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff06affd640 1 -- 172.21.15.52:0/3064070428 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640a5bd0 con 0x7ff06c06b120 2023-10-01T01:33:30.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 -- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c06b120 msgr2=0x7ff06c0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 --2- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c06b120 0x7ff06c0cb370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff064009e50 tx=0x7ff06401c9d0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 -- 172.21.15.52:0/3064070428 shutdown_connections 2023-10-01T01:33:30.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 --2- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c06b120 0x7ff06c0cb370 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 --2- 172.21.15.52:0/3064070428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c0b2a20 0x7ff06c06ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.955+0000 7ff071c57640 1 -- 172.21.15.52:0/3064070428 >> 172.21.15.52:0/3064070428 conn(0x7ff06c0cd310 msgr2=0x7ff06c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:30.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 -- 172.21.15.52:0/3064070428 shutdown_connections 2023-10-01T01:33:30.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 -- 172.21.15.52:0/3064070428 wait complete. 2023-10-01T01:33:30.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 Processor -- start 2023-10-01T01:33:30.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 -- start start 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c06b120 0x7ff06c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c0b2a20 0x7ff06c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 0x7ff06c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b3bc0 con 0x7ff06c163b10 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b3ea0 con 0x7ff06c0b2a20 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff071c57640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b4180 con 0x7ff06c06b120 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff06bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 0x7ff06c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff06bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 0x7ff06c0c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60738/0 (socket says 172.21.15.52:60738) 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff062ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c0b2a20 0x7ff06c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff06bfff640 1 -- 172.21.15.52:0/3576751741 learned_addr learned my addr 172.21.15.52:0/3576751741 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff06b7fe640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c06b120 0x7ff06c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.959+0000 7ff06bfff640 1 -- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c06b120 msgr2=0x7ff06c0b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06bfff640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c06b120 0x7ff06c0b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06bfff640 1 -- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c0b2a20 msgr2=0x7ff06c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06bfff640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c0b2a20 0x7ff06c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06bfff640 1 -- 172.21.15.52:0/3576751741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054009420 con 0x7ff06c163b10 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06bfff640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 0x7ff06c0c93e0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7ff0640af040 tx=0x7ff064019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640b8670 con 0x7ff06c163b10 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0640b87d0 con 0x7ff06c163b10 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff064009b30 con 0x7ff06c163b10 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640b8b80 con 0x7ff06c163b10 2023-10-01T01:33:30.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c0c43b0 con 0x7ff06c163b10 2023-10-01T01:33:30.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff0640b8ce0 con 0x7ff06c163b10 2023-10-01T01:33:30.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c066750 con 0x7ff06c163b10 2023-10-01T01:33:30.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff068ff9640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff04c066160 0x7ff04c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:30.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff06411ee00 con 0x7ff06c163b10 2023-10-01T01:33:30.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06b7fe640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff04c066160 0x7ff04c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:30.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.963+0000 7ff06b7fe640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff04c066160 0x7ff04c068620 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff06c073c70 tx=0x7ff05c0090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:30.975+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7ff0640ec5e0 con 0x7ff06c163b10 2023-10-01T01:33:31.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.203+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff06c0c45a0 con 0x7ff06c163b10 2023-10-01T01:33:31.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.203+0000 7ff068ff9640 1 -- 172.21.15.52:0/3576751741 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0640bc020 con 0x7ff06c163b10 2023-10-01T01:33:31.212 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-10-01T01:33:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff04c066160 msgr2=0x7ff04c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff04c066160 0x7ff04c068620 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff06c073c70 tx=0x7ff05c0090e0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 msgr2=0x7ff06c0c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 0x7ff06c0c93e0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7ff0640af040 tx=0x7ff064019770 comp rx=0 tx=0).stop 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 shutdown_connections 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff04c066160 0x7ff04c068620 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff06c163b10 0x7ff06c0c93e0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff06c0b2a20 0x7ff06c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 --2- 172.21.15.52:0/3576751741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff06c06b120 0x7ff06c0b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 >> 172.21.15.52:0/3576751741 conn(0x7ff06c0cd310 msgr2=0x7ff06c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 shutdown_connections 2023-10-01T01:33:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.207+0000 7ff071c57640 1 -- 172.21.15.52:0/3576751741 wait complete. 2023-10-01T01:33:31.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-01T01:33:31.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 Processor -- start 2023-10-01T01:33:31.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 -- start start 2023-10-01T01:33:31.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f708406f150 0x7f70840c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:31.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f70840c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:31.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f708406f150 0x7f70840c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:31.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f708406f150 0x7f70840c3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60746/0 (socket says 172.21.15.52:60746) 2023-10-01T01:33:31.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f7083fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f708415ce40 0x7f708406e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:44302/0 (socket says 172.21.15.52:44302) 2023-10-01T01:33:31.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70840c4f90 con 0x7f708415ce40 2023-10-01T01:33:31.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840c4330 con 0x7f708406f150 2023-10-01T01:33:31.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f708a279640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708406dec0 con 0x7f70840c4600 2023-10-01T01:33:31.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 -- 172.21.15.52:0/1750384303 learned_addr learned my addr 172.21.15.52:0/1750384303 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:31.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f7088816640 1 --2- 172.21.15.52:0/1750384303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f70840c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:31.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 -- 172.21.15.52:0/1750384303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 msgr2=0x7f70840c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:31.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f7082ffd640 1 -- 172.21.15.52:0/1750384303 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234009046 0 0) 0x7f7074001120 con 0x7f708415ce40 2023-10-01T01:33:31.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 --2- 172.21.15.52:0/1750384303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f70840c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 -- 172.21.15.52:0/1750384303 >> v1:172.21.15.186:6789/0 conn(0x7f708415ce40 legacy=0x7f708406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.375+0000 7f70837fe640 1 -- 172.21.15.52:0/1750384303 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084161590 con 0x7f708406f150 2023-10-01T01:33:31.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f70837fe640 1 --2- 172.21.15.52:0/1750384303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708406f150 0x7f70840c3df0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f7078009870 tx=0x7f707801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bb25334c23dc65 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:31.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f7082ffd640 1 -- 172.21.15.52:0/1750384303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780ab680 con 0x7f708406f150 2023-10-01T01:33:31.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f7082ffd640 1 -- 172.21.15.52:0/1750384303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780ab7e0 con 0x7f708406f150 2023-10-01T01:33:31.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f7082ffd640 1 -- 172.21.15.52:0/1750384303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780abb70 con 0x7f708406f150 2023-10-01T01:33:31.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 -- 172.21.15.52:0/1750384303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708406f150 msgr2=0x7f70840c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 --2- 172.21.15.52:0/1750384303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708406f150 0x7f70840c3df0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f7078009870 tx=0x7f707801c480 comp rx=0 tx=0).stop 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 -- 172.21.15.52:0/1750384303 shutdown_connections 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 --2- 172.21.15.52:0/1750384303 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f70840c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 --2- 172.21.15.52:0/1750384303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708406f150 0x7f70840c3df0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 -- 172.21.15.52:0/1750384303 >> 172.21.15.52:0/1750384303 conn(0x7f70840b0b80 msgr2=0x7f70840b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 -- 172.21.15.52:0/1750384303 shutdown_connections 2023-10-01T01:33:31.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.379+0000 7f708a279640 1 -- 172.21.15.52:0/1750384303 wait complete. 2023-10-01T01:33:31.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 Processor -- start 2023-10-01T01:33:31.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 -- start start 2023-10-01T01:33:31.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708406f150 0x7f7084157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:31.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f708414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:31.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708415ce40 0x7f70840ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:31.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840b1c70 con 0x7f708415ce40 2023-10-01T01:33:31.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708414d270 con 0x7f708406f150 2023-10-01T01:33:31.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7084158270 con 0x7f70840c4600 2023-10-01T01:33:31.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f708414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:31.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f7083fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708406f150 0x7f7084157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f708414c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:55826/0 (socket says 172.21.15.52:55826) 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 -- 172.21.15.52:0/4127002129 learned_addr learned my addr 172.21.15.52:0/4127002129 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f7088816640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708415ce40 0x7f70840ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 -- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708406f150 msgr2=0x7f7084157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708406f150 0x7f7084157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 -- 172.21.15.52:0/4127002129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708415ce40 msgr2=0x7f70840ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708415ce40 0x7f70840ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 -- 172.21.15.52:0/4127002129 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780094d0 con 0x7f70840c4600 2023-10-01T01:33:31.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f7083fff640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708406f150 0x7f7084157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:31.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f70837fe640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f708414c990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70780ad040 tx=0x7f707801acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:31.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780b4800 con 0x7f70840c4600 2023-10-01T01:33:31.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780b4980 con 0x7f70840c4600 2023-10-01T01:33:31.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7084158550 con 0x7f70840c4600 2023-10-01T01:33:31.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780b4d30 con 0x7f70840c4600 2023-10-01T01:33:31.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.383+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708414d7a0 con 0x7f70840c4600 2023-10-01T01:33:31.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.387+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70840740a0 con 0x7f70840c4600 2023-10-01T01:33:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.391+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f70780c7440 con 0x7f70840c4600 2023-10-01T01:33:31.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.395+0000 7f7080ff9640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7070066160 0x7f7070068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:31.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.395+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f707811eaf0 con 0x7f70840c4600 2023-10-01T01:33:31.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.399+0000 7f7083fff640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7070066160 0x7f7070068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:31.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.399+0000 7f7083fff640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7070066160 0x7f7070068620 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7074000f70 tx=0x7f7074007df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:31.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.407+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f70780ec3d0 con 0x7f70840c4600 2023-10-01T01:33:31.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.655+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70840736b0 con 0x7f70840c4600 2023-10-01T01:33:31.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.659+0000 7f7080ff9640 1 -- 172.21.15.52:0/4127002129 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70780ab640 con 0x7f70840c4600 2023-10-01T01:33:31.666 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-10-01T01:33:31.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7070066160 msgr2=0x7f7070068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7070066160 0x7f7070068620 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7074000f70 tx=0x7f7074007df0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 msgr2=0x7f708414c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:31.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f708414c990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70780ad040 tx=0x7f707801acc0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 shutdown_connections 2023-10-01T01:33:31.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7070066160 0x7f7070068620 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708415ce40 0x7f70840ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70840c4600 0x7f708414c990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 --2- 172.21.15.52:0/4127002129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708406f150 0x7f7084157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:31.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 >> 172.21.15.52:0/4127002129 conn(0x7f70840b0b80 msgr2=0x7f708406aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:31.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 shutdown_connections 2023-10-01T01:33:31.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.663+0000 7f708a279640 1 -- 172.21.15.52:0/4127002129 wait complete. 2023-10-01T01:33:31.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-01T01:33:31.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.835+0000 7fd98d9ea640 1 Processor -- start 2023-10-01T01:33:32.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.835+0000 7fd98d9ea640 1 -- start start 2023-10-01T01:33:32.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd98d9ea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd98815a9e0 0x7fd988070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd98d9ea640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880ce770 con 0x7fd9880b63e0 2023-10-01T01:33:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd98d9ea640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880cea10 con 0x7fd9880b2310 2023-10-01T01:33:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd98d9ea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880b3ef0 con 0x7fd98815a9e0 2023-10-01T01:33:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd9867fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd9880b63e0 0x7fd9880b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59324/0 (socket says 172.21.15.52:59324) 2023-10-01T01:33:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd9867fc640 1 -- 172.21.15.52:0/285082177 learned_addr learned my addr 172.21.15.52:0/285082177 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd986ffd640 1 --2- 172.21.15.52:0/285082177 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd98815a9e0 0x7fd988070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd985ffb640 1 -- 172.21.15.52:0/285082177 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779910597 0 0) 0x7fd9880ce770 con 0x7fd9880b63e0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd985ffb640 1 -- 172.21.15.52:0/285082177 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd970003530 con 0x7fd9880b63e0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd986ffd640 1 -- 172.21.15.52:0/285082177 >> v1:172.21.15.186:6789/0 conn(0x7fd9880b2310 legacy=0x7fd9880cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd986ffd640 1 -- 172.21.15.52:0/285082177 >> v1:172.21.15.52:6789/0 conn(0x7fd9880b63e0 legacy=0x7fd9880b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd986ffd640 1 -- 172.21.15.52:0/285082177 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9880cecf0 con 0x7fd98815a9e0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd986ffd640 1 --2- 172.21.15.52:0/285082177 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd98815a9e0 0x7fd988070850 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9780097f0 tx=0x7fd97801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f10e18f9e69324 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd985ffb640 1 -- 172.21.15.52:0/285082177 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780ac640 con 0x7fd98815a9e0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd985ffb640 1 -- 172.21.15.52:0/285082177 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780ac7a0 con 0x7fd98815a9e0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.839+0000 7fd985ffb640 1 -- 172.21.15.52:0/285082177 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780acb30 con 0x7fd98815a9e0 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.843+0000 7fd98d9ea640 1 -- 172.21.15.52:0/285082177 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd98815a9e0 msgr2=0x7fd988070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.843+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/285082177 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd98815a9e0 0x7fd988070850 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9780097f0 tx=0x7fd97801c400 comp rx=0 tx=0).stop 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.843+0000 7fd98d9ea640 1 -- 172.21.15.52:0/285082177 shutdown_connections 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.843+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/285082177 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd98815a9e0 0x7fd988070850 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.843+0000 7fd98d9ea640 1 -- 172.21.15.52:0/285082177 >> 172.21.15.52:0/285082177 conn(0x7fd9880cd310 msgr2=0x7fd9880cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 -- 172.21.15.52:0/285082177 shutdown_connections 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 -- 172.21.15.52:0/285082177 wait complete. 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 Processor -- start 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 -- start start 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9880b2310 0x7fd98815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 0x7fd98814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd98815a9e0 0x7fd988158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98815b910 con 0x7fd9880b2310 2023-10-01T01:33:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880caa20 con 0x7fd98815a9e0 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd98d9ea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98815b250 con 0x7fd9880b63e0 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 0x7fd98814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9877fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd98815a9e0 0x7fd988158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 0x7fd98814e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:55842/0 (socket says 172.21.15.52:55842) 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 -- 172.21.15.52:0/1100512307 learned_addr learned my addr 172.21.15.52:0/1100512307 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 -- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd98815a9e0 msgr2=0x7fd988158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd98815a9e0 0x7fd988158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 -- 172.21.15.52:0/1100512307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9880b2310 msgr2=0x7fd98815d9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9880b2310 0x7fd98815d9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.847+0000 7fd9867fc640 1 -- 172.21.15.52:0/1100512307 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd978009420 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.851+0000 7fd9867fc640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 0x7fd98814e1d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c4d0 tx=0x7fd97c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.851+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c005cf0 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.851+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c005e50 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.851+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c007270 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.851+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98815af40 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.851+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98815df20 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.855+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd988066750 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.855+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd97c0073d0 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.855+0000 7fd96ffff640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd974066160 0x7fd974068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.855+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd97c0834a0 con 0x7fd9880b63e0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.855+0000 7fd986ffd640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd974066160 0x7fd974068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.855+0000 7fd986ffd640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd974066160 0x7fd974068620 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd9780ae000 tx=0x7fd9780a6070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:31.863+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd97c050b50 con 0x7fd9880b63e0 2023-10-01T01:33:32.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.087+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9880740a0 con 0x7fd9880b63e0 2023-10-01T01:33:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.087+0000 7fd96ffff640 1 -- 172.21.15.52:0/1100512307 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd97c054170 con 0x7fd9880b63e0 2023-10-01T01:33:32.096 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd974066160 msgr2=0x7fd974068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd974066160 0x7fd974068620 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd9780ae000 tx=0x7fd9780a6070 comp rx=0 tx=0).stop 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 msgr2=0x7fd98814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 0x7fd98814e1d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c4d0 tx=0x7fd97c00c990 comp rx=0 tx=0).stop 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 shutdown_connections 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd974066160 0x7fd974068620 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd98815a9e0 0x7fd988158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9880b63e0 0x7fd98814e1d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 --2- 172.21.15.52:0/1100512307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9880b2310 0x7fd98815d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 >> 172.21.15.52:0/1100512307 conn(0x7fd9880cd310 msgr2=0x7fd98806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 shutdown_connections 2023-10-01T01:33:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.099+0000 7fd98d9ea640 1 -- 172.21.15.52:0/1100512307 wait complete. 2023-10-01T01:33:32.128 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T01:33:32.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 Processor -- start 2023-10-01T01:33:32.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 -- start start 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe600ca180 0x7fbe6015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe600cc740 0x7fbe600ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600cc2b0 con 0x7fbe600ca560 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe600cc010 con 0x7fbe600ca180 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe656c6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6015bda0 con 0x7fbe600cc740 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe600ca180 0x7fbe6015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe600cc740 0x7fbe600ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe600cc740 0x7fbe600ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:58472/0 (socket says 172.21.15.52:58472) 2023-10-01T01:33:32.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 -- 172.21.15.52:0/3548336802 learned_addr learned my addr 172.21.15.52:0/3548336802 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:32.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 -- 172.21.15.52:0/3548336802 >> v2:172.21.15.52:3300/0 conn(0x7fbe600ca180 msgr2=0x7fbe6015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:32.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 --2- 172.21.15.52:0/3548336802 >> v2:172.21.15.52:3300/0 conn(0x7fbe600ca180 0x7fbe6015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 -- 172.21.15.52:0/3548336802 >> v1:172.21.15.186:6789/0 conn(0x7fbe600ca560 legacy=0x7fbe6006ed70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:32.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.259+0000 7fbe5f7fe640 1 -- 172.21.15.52:0/3548336802 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600b5310 con 0x7fbe600cc740 2023-10-01T01:33:32.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe5f7fe640 1 --2- 172.21.15.52:0/3548336802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600cc740 0x7fbe600ccbd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbe600cd110 tx=0x7fbe5801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d0764e9cccb324 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe5dffb640 1 -- 172.21.15.52:0/3548336802 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580aa5f0 con 0x7fbe600cc740 2023-10-01T01:33:32.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe5dffb640 1 -- 172.21.15.52:0/3548336802 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580aa750 con 0x7fbe600cc740 2023-10-01T01:33:32.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe5dffb640 1 -- 172.21.15.52:0/3548336802 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580aaae0 con 0x7fbe600cc740 2023-10-01T01:33:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe656c6640 1 -- 172.21.15.52:0/3548336802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600cc740 msgr2=0x7fbe600ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe656c6640 1 --2- 172.21.15.52:0/3548336802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600cc740 0x7fbe600ccbd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbe600cd110 tx=0x7fbe5801c490 comp rx=0 tx=0).stop 2023-10-01T01:33:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe656c6640 1 -- 172.21.15.52:0/3548336802 shutdown_connections 2023-10-01T01:33:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe656c6640 1 --2- 172.21.15.52:0/3548336802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600cc740 0x7fbe600ccbd0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe656c6640 1 --2- 172.21.15.52:0/3548336802 >> v2:172.21.15.52:3300/0 conn(0x7fbe600ca180 0x7fbe6015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.263+0000 7fbe656c6640 1 -- 172.21.15.52:0/3548336802 >> 172.21.15.52:0/3548336802 conn(0x7fbe6006d320 msgr2=0x7fbe6006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:32.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.267+0000 7fbe656c6640 1 -- 172.21.15.52:0/3548336802 shutdown_connections 2023-10-01T01:33:32.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.267+0000 7fbe656c6640 1 -- 172.21.15.52:0/3548336802 wait complete. 2023-10-01T01:33:32.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.267+0000 7fbe656c6640 1 Processor -- start 2023-10-01T01:33:32.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- start start 2023-10-01T01:33:32.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600ca180 0x7fbe60143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 0x7fbe60163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe60156b50 0x7fbe60163e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60158290 con 0x7fbe600cc740 2023-10-01T01:33:32.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60155d90 con 0x7fbe600ca180 2023-10-01T01:33:32.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60156070 con 0x7fbe60156b50 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 0x7fbe60163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 0x7fbe60163950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60762/0 (socket says 172.21.15.52:60762) 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5f7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe60156b50 0x7fbe60163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 -- 172.21.15.52:0/472543644 learned_addr learned my addr 172.21.15.52:0/472543644 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5effd640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600ca180 0x7fbe60143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 -- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe60156b50 msgr2=0x7fbe60163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe60156b50 0x7fbe60163e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 -- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600ca180 msgr2=0x7fbe60143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600ca180 0x7fbe60143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 -- 172.21.15.52:0/472543644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580094d0 con 0x7fbe600cc740 2023-10-01T01:33:32.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe5e7fc640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 0x7fbe60163950 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400b410 tx=0x7fbe5400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011830 con 0x7fbe600cc740 2023-10-01T01:33:32.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54011990 con 0x7fbe600cc740 2023-10-01T01:33:32.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6006f600 con 0x7fbe600cc740 2023-10-01T01:33:32.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011d20 con 0x7fbe600cc740 2023-10-01T01:33:32.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe60156630 con 0x7fbe600cc740 2023-10-01T01:33:32.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.279+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe60156850 con 0x7fbe600cc740 2023-10-01T01:33:32.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.283+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fbe5401a410 con 0x7fbe600cc740 2023-10-01T01:33:32.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.283+0000 7fbe477fe640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe4c066190 0x7fbe4c068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.283+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbe540836a0 con 0x7fbe600cc740 2023-10-01T01:33:32.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.283+0000 7fbe5effd640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe4c066190 0x7fbe4c068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.283+0000 7fbe5effd640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe4c066190 0x7fbe4c068650 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbe50003b90 tx=0x7fbe500098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.311+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fbe54050bc0 con 0x7fbe600cc740 2023-10-01T01:33:32.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.579+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe600740a0 con 0x7fbe600cc740 2023-10-01T01:33:32.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.583+0000 7fbe477fe640 1 -- 172.21.15.52:0/472543644 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fbe54009220 con 0x7fbe600cc740 2023-10-01T01:33:32.592 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:32.592 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:50:15.359964+0000","modified":"2023-09-30T16:50:17.412644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4945":{"gid":4945,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.186:6837/2755050347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2755050347},{"type":"v1","addr":"172.21.15.186:6837","nonce":2755050347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-01T01:33:32.592 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 14 2023-10-01T01:33:32.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe4c066190 msgr2=0x7fbe4c068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe4c066190 0x7fbe4c068650 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbe50003b90 tx=0x7fbe500098d0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 msgr2=0x7fbe60163950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 0x7fbe60163950 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400b410 tx=0x7fbe5400b8d0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 shutdown_connections 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbe4c066190 0x7fbe4c068650 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe60156b50 0x7fbe60163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe600cc740 0x7fbe60163950 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 --2- 172.21.15.52:0/472543644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe600ca180 0x7fbe60143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 >> 172.21.15.52:0/472543644 conn(0x7fbe6006d320 msgr2=0x7fbe601589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 shutdown_connections 2023-10-01T01:33:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.587+0000 7fbe656c6640 1 -- 172.21.15.52:0/472543644 wait complete. 2023-10-01T01:33:32.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T01:33:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 Processor -- start 2023-10-01T01:33:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 -- start start 2023-10-01T01:33:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4afc15ce10 0x7f4afc0b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4afc0cd870 0x7f4afc0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc0b7570 con 0x7f4afc0d0fa0 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc0b7850 con 0x7f4afc0cd870 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b03ee8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc0b7b30 con 0x7f4afc15ce10 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4afc0cd870 0x7f4afc0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4afc0cd870 0x7f4afc0cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60764/0 (socket says 172.21.15.52:60764) 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 -- 172.21.15.52:0/3952201246 learned_addr learned my addr 172.21.15.52:0/3952201246 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b02485640 1 --1- 172.21.15.52:0/3952201246 >> v1:172.21.15.186:6789/0 conn(0x7f4afc0d0fa0 0x7f4afc0d1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:44314/0 (socket says 172.21.15.52:44314) 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01c84640 1 --2- 172.21.15.52:0/3952201246 >> v2:172.21.15.186:3300/0 conn(0x7f4afc15ce10 0x7f4afc0b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 -- 172.21.15.52:0/3952201246 >> v2:172.21.15.186:3300/0 conn(0x7f4afc15ce10 msgr2=0x7f4afc0b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 --2- 172.21.15.52:0/3952201246 >> v2:172.21.15.186:3300/0 conn(0x7f4afc15ce10 0x7f4afc0b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 -- 172.21.15.52:0/3952201246 >> v1:172.21.15.186:6789/0 conn(0x7f4afc0d0fa0 legacy=0x7f4afc0d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.779+0000 7f4b01483640 1 -- 172.21.15.52:0/3952201246 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0b7e10 con 0x7f4afc0cd870 2023-10-01T01:33:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.787+0000 7f4b01483640 1 --2- 172.21.15.52:0/3952201246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc0cd870 0x7f4afc0cdcb0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b4e30 tx=0x7f4aec01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e53f2bc3982f3e server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.787+0000 7f4b00c82640 1 -- 172.21.15.52:0/3952201246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0ab600 con 0x7f4afc0cd870 2023-10-01T01:33:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.787+0000 7f4b00c82640 1 -- 172.21.15.52:0/3952201246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0a7050 con 0x7f4afc0cd870 2023-10-01T01:33:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.787+0000 7f4b00c82640 1 -- 172.21.15.52:0/3952201246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0ab980 con 0x7f4afc0cd870 2023-10-01T01:33:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.795+0000 7f4b03ee8640 1 -- 172.21.15.52:0/3952201246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc0cd870 msgr2=0x7f4afc0cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.795+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/3952201246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc0cd870 0x7f4afc0cdcb0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b4e30 tx=0x7f4aec01c300 comp rx=0 tx=0).stop 2023-10-01T01:33:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.803+0000 7f4b03ee8640 1 -- 172.21.15.52:0/3952201246 shutdown_connections 2023-10-01T01:33:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.803+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/3952201246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc0cd870 0x7f4afc0cdcb0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.803+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/3952201246 >> v2:172.21.15.186:3300/0 conn(0x7f4afc15ce10 0x7f4afc0b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.803+0000 7f4b03ee8640 1 -- 172.21.15.52:0/3952201246 >> 172.21.15.52:0/3952201246 conn(0x7f4afc071930 msgr2=0x7f4afc071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.803+0000 7f4b03ee8640 1 -- 172.21.15.52:0/3952201246 shutdown_connections 2023-10-01T01:33:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.803+0000 7f4b03ee8640 1 -- 172.21.15.52:0/3952201246 wait complete. 2023-10-01T01:33:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 Processor -- start 2023-10-01T01:33:32.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 -- start start 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4afc0cd870 0x7f4afc0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4afc0d0fa0 0x7f4afc1f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 0x7f4afc15e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc15d200 con 0x7f4afc200160 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0c7200 con 0x7f4afc0d0fa0 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b03ee8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0c74e0 con 0x7f4afc0cd870 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 0x7f4afc15e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 0x7f4afc15e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60774/0 (socket says 172.21.15.52:60774) 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b01c84640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4afc0cd870 0x7f4afc0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 -- 172.21.15.52:0/1281244179 learned_addr learned my addr 172.21.15.52:0/1281244179 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b01483640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4afc0d0fa0 0x7f4afc1f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 -- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4afc0cd870 msgr2=0x7f4afc0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4afc0cd870 0x7f4afc0c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 -- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4afc0d0fa0 msgr2=0x7f4afc1f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4afc0d0fa0 0x7f4afc1f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 -- 172.21.15.52:0/1281244179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0094d0 con 0x7f4afc200160 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4b02485640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 0x7f4afc15e530 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c3f0 tx=0x7f4af400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af40090d0 con 0x7f4afc200160 2023-10-01T01:33:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.807+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af4009230 con 0x7f4afc200160 2023-10-01T01:33:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.811+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af40095e0 con 0x7f4afc200160 2023-10-01T01:33:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc0c77c0 con 0x7f4afc200160 2023-10-01T01:33:32.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc0c6e40 con 0x7f4afc200160 2023-10-01T01:33:32.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc0740a0 con 0x7f4afc200160 2023-10-01T01:33:32.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f4af4009740 con 0x7f4afc200160 2023-10-01T01:33:32.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4af27fc640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ae0066160 0x7f4ae0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:32.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4af4085a30 con 0x7f4afc200160 2023-10-01T01:33:32.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4b01c84640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ae0066160 0x7f4ae0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:32.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.815+0000 7f4b01c84640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ae0066160 0x7f4ae0068620 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c96f0 tx=0x7f4af8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:32.823+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f4af4053080 con 0x7f4afc200160 2023-10-01T01:33:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.063+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4afc15d620 con 0x7f4afc200160 2023-10-01T01:33:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.063+0000 7f4af27fc640 1 -- 172.21.15.52:0/1281244179 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16769 (secure 0 0 0) 0x7f4af401a090 con 0x7f4afc200160 2023-10-01T01:33:33.072 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:33.072 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:51:00.427901+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:50:13.342272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-30T16:50:14.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ae0066160 msgr2=0x7f4ae0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ae0066160 0x7f4ae0068620 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c96f0 tx=0x7f4af8009190 comp rx=0 tx=0).stop 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 msgr2=0x7f4afc15e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 0x7f4afc15e530 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c3f0 tx=0x7f4af400c8b0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 shutdown_connections 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ae0066160 0x7f4ae0068620 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4afc200160 0x7f4afc15e530 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4afc0d0fa0 0x7f4afc1f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 --2- 172.21.15.52:0/1281244179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4afc0cd870 0x7f4afc0c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 >> 172.21.15.52:0/1281244179 conn(0x7f4afc071930 msgr2=0x7f4afc0b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 shutdown_connections 2023-10-01T01:33:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.067+0000 7f4b03ee8640 1 -- 172.21.15.52:0/1281244179 wait complete. 2023-10-01T01:33:33.102 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-01T01:33:33.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T01:33:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5edcd640 1 Processor -- start 2023-10-01T01:33:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5edcd640 1 -- start start 2023-10-01T01:33:33.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5edcd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f5815d110 0x7f5f580b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5edcd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5806c1c0 con 0x7f5f58158b30 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5edcd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5806c4a0 con 0x7f5f580b05e0 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5edcd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580b0a50 con 0x7f5f5815d110 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5cb69640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5f58158b30 0x7f5f5806d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59340/0 (socket says 172.21.15.52:59340) 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f5cb69640 1 -- 172.21.15.52:0/1434783664 learned_addr learned my addr 172.21.15.52:0/1434783664 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f57fff640 1 --2- 172.21.15.52:0/1434783664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f5815d110 0x7f5f580b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f577fe640 1 -- 172.21.15.52:0/1434783664 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036267106 0 0) 0x7f5f5806c1c0 con 0x7f5f58158b30 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f577fe640 1 -- 172.21.15.52:0/1434783664 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f40003530 con 0x7f5f58158b30 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f57fff640 1 -- 172.21.15.52:0/1434783664 >> v1:172.21.15.186:6789/0 conn(0x7f5f580b05e0 legacy=0x7f5f580c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f57fff640 1 -- 172.21.15.52:0/1434783664 >> v1:172.21.15.52:6789/0 conn(0x7f5f58158b30 legacy=0x7f5f5806d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.259+0000 7f5f57fff640 1 -- 172.21.15.52:0/1434783664 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5806c780 con 0x7f5f5815d110 2023-10-01T01:33:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f57fff640 1 --2- 172.21.15.52:0/1434783664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f5815d110 0x7f5f580b00a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800a990 tx=0x7f5f4801e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef710aac8f27231b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f577fe640 1 -- 172.21.15.52:0/1434783664 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480a7a40 con 0x7f5f5815d110 2023-10-01T01:33:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f577fe640 1 -- 172.21.15.52:0/1434783664 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480a7ba0 con 0x7f5f5815d110 2023-10-01T01:33:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f577fe640 1 -- 172.21.15.52:0/1434783664 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480af440 con 0x7f5f5815d110 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 -- 172.21.15.52:0/1434783664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f5815d110 msgr2=0x7f5f580b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/1434783664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f5815d110 0x7f5f580b00a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800a990 tx=0x7f5f4801e970 comp rx=0 tx=0).stop 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 -- 172.21.15.52:0/1434783664 shutdown_connections 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/1434783664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f5815d110 0x7f5f580b00a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 -- 172.21.15.52:0/1434783664 >> 172.21.15.52:0/1434783664 conn(0x7f5f5806a200 msgr2=0x7f5f5806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 -- 172.21.15.52:0/1434783664 shutdown_connections 2023-10-01T01:33:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.263+0000 7f5f5edcd640 1 -- 172.21.15.52:0/1434783664 wait complete. 2023-10-01T01:33:33.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 Processor -- start 2023-10-01T01:33:33.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 -- start start 2023-10-01T01:33:33.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f580b05e0 0x7f5f58142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f58158b30 0x7f5f58149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 0x7f5f58149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580c1ce0 con 0x7f5f5815d110 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58145570 con 0x7f5f58158b30 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58146f30 con 0x7f5f580b05e0 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 0x7f5f58149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 0x7f5f58149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60776/0 (socket says 172.21.15.52:60776) 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 -- 172.21.15.52:0/2541027992 learned_addr learned my addr 172.21.15.52:0/2541027992 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5cb69640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f580b05e0 0x7f5f58142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 -- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f580b05e0 msgr2=0x7f5f58142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f580b05e0 0x7f5f58142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 -- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f58158b30 msgr2=0x7f5f58149710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f58158b30 0x7f5f58149710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 -- 172.21.15.52:0/2541027992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4800a5c0 con 0x7f5f5815d110 2023-10-01T01:33:33.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5d36a640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 0x7f5f58149c50 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00c430 tx=0x7f5f4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:33.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c005220 con 0x7f5f5815d110 2023-10-01T01:33:33.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c005380 con 0x7f5f5815d110 2023-10-01T01:33:33.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c007270 con 0x7f5f5815d110 2023-10-01T01:33:33.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f58142e70 con 0x7f5f5815d110 2023-10-01T01:33:33.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.267+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f58147140 con 0x7f5f5815d110 2023-10-01T01:33:33.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.271+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58147330 con 0x7f5f5815d110 2023-10-01T01:33:33.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.271+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f5f4c0073d0 con 0x7f5f5815d110 2023-10-01T01:33:33.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.271+0000 7f5f557fa640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5f4406a570 0x7f5f4406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.271+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5f4c0830f0 con 0x7f5f5815d110 2023-10-01T01:33:33.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.271+0000 7f5f5cb69640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5f4406a570 0x7f5f4406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.275+0000 7f5f5cb69640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5f4406a570 0x7f5f4406ca30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5f50004f10 tx=0x7f5f50007500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:33.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.279+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f5f4c0505f0 con 0x7f5f5815d110 2023-10-01T01:33:33.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.575+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f580740a0 con 0x7f5f5815d110 2023-10-01T01:33:33.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.575+0000 7f5f557fa640 1 -- 172.21.15.52:0/2541027992 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f5f4c053c10 con 0x7f5f5815d110 2023-10-01T01:33:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:33.584 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:50:15.359964+0000","modified":"2023-09-30T16:50:17.412644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4945":{"gid":4945,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.186:6837/2755050347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2755050347},{"type":"v1","addr":"172.21.15.186:6837","nonce":2755050347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-01T01:33:33.584 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 14 2023-10-01T01:33:33.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.579+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5f4406a570 msgr2=0x7f5f4406ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.579+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5f4406a570 0x7f5f4406ca30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5f50004f10 tx=0x7f5f50007500 comp rx=0 tx=0).stop 2023-10-01T01:33:33.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.579+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 msgr2=0x7f5f58149c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.579+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 0x7f5f58149c50 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00c430 tx=0x7f5f4c00c8f0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 shutdown_connections 2023-10-01T01:33:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5f4406a570 0x7f5f4406ca30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f5815d110 0x7f5f58149c50 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f58158b30 0x7f5f58149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 --2- 172.21.15.52:0/2541027992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f580b05e0 0x7f5f58142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 >> 172.21.15.52:0/2541027992 conn(0x7f5f5806a200 msgr2=0x7f5f580aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 shutdown_connections 2023-10-01T01:33:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.583+0000 7f5f5edcd640 1 -- 172.21.15.52:0/2541027992 wait complete. 2023-10-01T01:33:33.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T01:33:33.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 Processor -- start 2023-10-01T01:33:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 -- start start 2023-10-01T01:33:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2030159850 0x7f20300cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20300cdb30 0x7f20300ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20300ce170 con 0x7f20300cc6c0 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300ccb50 con 0x7f20300cdb30 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f20369bb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203006eea0 con 0x7f2030159850 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f202f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20300cc6c0 0x7f20300cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59342/0 (socket says 172.21.15.52:59342) 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f202f7fe640 1 -- 172.21.15.52:0/1095525971 learned_addr learned my addr 172.21.15.52:0/1095525971 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f2034f58640 1 --2- 172.21.15.52:0/1095525971 >> v2:172.21.15.52:3300/0 conn(0x7f20300cdb30 0x7f20300ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f202ffff640 1 --2- 172.21.15.52:0/1095525971 >> v2:172.21.15.186:3300/0 conn(0x7f2030159850 0x7f20300cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f202effd640 1 -- 172.21.15.52:0/1095525971 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691015083 0 0) 0x7f20300ce170 con 0x7f20300cc6c0 2023-10-01T01:33:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f202effd640 1 -- 172.21.15.52:0/1095525971 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2018003530 con 0x7f20300cc6c0 2023-10-01T01:33:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f2034f58640 1 -- 172.21.15.52:0/1095525971 >> v2:172.21.15.186:3300/0 conn(0x7f2030159850 msgr2=0x7f20300cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f2034f58640 1 --2- 172.21.15.52:0/1095525971 >> v2:172.21.15.186:3300/0 conn(0x7f2030159850 0x7f20300cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f2034f58640 1 -- 172.21.15.52:0/1095525971 >> v1:172.21.15.52:6789/0 conn(0x7f20300cc6c0 legacy=0x7f20300cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.747+0000 7f2034f58640 1 -- 172.21.15.52:0/1095525971 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203006f180 con 0x7f20300cdb30 2023-10-01T01:33:33.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f2034f58640 1 --2- 172.21.15.52:0/1095525971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300cdb30 0x7f20300ce560 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f20300cc150 tx=0x7f202801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223dcdba06244c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:33.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f202effd640 1 -- 172.21.15.52:0/1095525971 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a5830 con 0x7f20300cdb30 2023-10-01T01:33:33.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f202effd640 1 -- 172.21.15.52:0/1095525971 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280a5990 con 0x7f20300cdb30 2023-10-01T01:33:33.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f202effd640 1 -- 172.21.15.52:0/1095525971 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a5d20 con 0x7f20300cdb30 2023-10-01T01:33:33.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f20369bb640 1 -- 172.21.15.52:0/1095525971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300cdb30 msgr2=0x7f20300ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f20369bb640 1 --2- 172.21.15.52:0/1095525971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300cdb30 0x7f20300ce560 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f20300cc150 tx=0x7f202801c880 comp rx=0 tx=0).stop 2023-10-01T01:33:33.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f20369bb640 1 -- 172.21.15.52:0/1095525971 shutdown_connections 2023-10-01T01:33:33.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f20369bb640 1 --2- 172.21.15.52:0/1095525971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300cdb30 0x7f20300ce560 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f20369bb640 1 --2- 172.21.15.52:0/1095525971 >> v2:172.21.15.186:3300/0 conn(0x7f2030159850 0x7f20300cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.751+0000 7f20369bb640 1 -- 172.21.15.52:0/1095525971 >> 172.21.15.52:0/1095525971 conn(0x7f203006d320 msgr2=0x7f203006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:33.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- 172.21.15.52:0/1095525971 shutdown_connections 2023-10-01T01:33:33.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- 172.21.15.52:0/1095525971 wait complete. 2023-10-01T01:33:33.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 Processor -- start 2023-10-01T01:33:33.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- start start 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20300cc6c0 0x7f20301494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20300cdb30 0x7f2030149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 0x7f20300cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203014a3a0 con 0x7f2030159850 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203014eab0 con 0x7f20300cdb30 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203014ed90 con 0x7f20300cc6c0 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 0x7f20300cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 0x7f20300cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60800/0 (socket says 172.21.15.52:60800) 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 -- 172.21.15.52:0/3820955352 learned_addr learned my addr 172.21.15.52:0/3820955352 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f202f7fe640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20300cdb30 0x7f2030149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 -- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20300cc6c0 msgr2=0x7f20301494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20300cc6c0 0x7f20301494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 -- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20300cdb30 msgr2=0x7f2030149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20300cdb30 0x7f2030149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 -- 172.21.15.52:0/3820955352 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009a70 con 0x7f2030159850 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f2034f58640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 0x7f20300cf7d0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f20280b0040 tx=0x7f2028019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280b9650 con 0x7f2030159850 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280b97d0 con 0x7f2030159850 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203014f070 con 0x7f2030159850 2023-10-01T01:33:33.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.755+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280b9b80 con 0x7f2030159850 2023-10-01T01:33:33.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203014f630 con 0x7f2030159850 2023-10-01T01:33:33.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203014f820 con 0x7f2030159850 2023-10-01T01:33:33.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f20280b9ce0 con 0x7f2030159850 2023-10-01T01:33:33.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f202cff9640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f201c0661b0 0x7f201c068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:33.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f202811eb80 con 0x7f2030159850 2023-10-01T01:33:33.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f202ffff640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f201c0661b0 0x7f201c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:33.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.759+0000 7f202ffff640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f201c0661b0 0x7f201c068670 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2020006aa0 tx=0x7f2020006a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:33.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:33.767+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f20280ec320 con 0x7f2030159850 2023-10-01T01:33:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.035+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20300740a0 con 0x7f2030159850 2023-10-01T01:33:34.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.039+0000 7f202cff9640 1 -- 172.21.15.52:0/3820955352 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f20280ef940 con 0x7f2030159850 2023-10-01T01:33:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:34.046 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T16:50:15.359964+0000","modified":"2023-09-30T16:50:17.412644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4945":{"gid":4945,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.186:6837/2755050347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2755050347},{"type":"v1","addr":"172.21.15.186:6837","nonce":2755050347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-01T01:33:34.046 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 14 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.043+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f201c0661b0 msgr2=0x7f201c068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.043+0000 7f20369bb640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f201c0661b0 0x7f201c068670 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2020006aa0 tx=0x7f2020006a30 comp rx=0 tx=0).stop 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.043+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 msgr2=0x7f20300cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.043+0000 7f20369bb640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 0x7f20300cf7d0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f20280b0040 tx=0x7f2028019620 comp rx=0 tx=0).stop 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 shutdown_connections 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f201c0661b0 0x7f201c068670 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2030159850 0x7f20300cf7d0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20300cdb30 0x7f2030149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 --2- 172.21.15.52:0/3820955352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20300cc6c0 0x7f20301494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 >> 172.21.15.52:0/3820955352 conn(0x7f203006d320 msgr2=0x7f203014ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 shutdown_connections 2023-10-01T01:33:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.047+0000 7f20369bb640 1 -- 172.21.15.52:0/3820955352 wait complete. 2023-10-01T01:33:34.077 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T01:33:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.227+0000 7f9a9ea07640 1 Processor -- start 2023-10-01T01:33:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.227+0000 7f9a9ea07640 1 -- start start 2023-10-01T01:33:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a9ea07640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a9815cb20 0x7f9a9815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a9ea07640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9815d7f0 con 0x7f9a981613e0 2023-10-01T01:33:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a9ea07640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9815cf00 con 0x7f9a980b00a0 2023-10-01T01:33:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a9ea07640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980ccb10 con 0x7f9a9815cb20 2023-10-01T01:33:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a97fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a9815cb20 0x7f9a9815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a8ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a981613e0 0x7f9a980cc400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59350/0 (socket says 172.21.15.52:59350) 2023-10-01T01:33:34.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a8ffff640 1 -- 172.21.15.52:0/2735187900 learned_addr learned my addr 172.21.15.52:0/2735187900 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:34.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a97fff640 1 -- 172.21.15.52:0/2735187900 >> v1:172.21.15.186:6789/0 conn(0x7f9a980b00a0 legacy=0x7f9a980c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a97fff640 1 -- 172.21.15.52:0/2735187900 >> v1:172.21.15.52:6789/0 conn(0x7f9a981613e0 legacy=0x7f9a980cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a97fff640 1 -- 172.21.15.52:0/2735187900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980ccdc0 con 0x7f9a9815cb20 2023-10-01T01:33:34.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.231+0000 7f9a97fff640 1 --2- 172.21.15.52:0/2735187900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a9815dc80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f9a800097c0 tx=0x7f9a8001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f50bda5fe647e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:34.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.235+0000 7f9a977fe640 1 -- 172.21.15.52:0/2735187900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab600 con 0x7f9a9815cb20 2023-10-01T01:33:34.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.235+0000 7f9a977fe640 1 -- 172.21.15.52:0/2735187900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a800a7050 con 0x7f9a9815cb20 2023-10-01T01:33:34.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.235+0000 7f9a977fe640 1 -- 172.21.15.52:0/2735187900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab980 con 0x7f9a9815cb20 2023-10-01T01:33:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.235+0000 7f9a9ea07640 1 -- 172.21.15.52:0/2735187900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 msgr2=0x7f9a9815dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.235+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/2735187900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a9815dc80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f9a800097c0 tx=0x7f9a8001c330 comp rx=0 tx=0).stop 2023-10-01T01:33:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.243+0000 7f9a9ea07640 1 -- 172.21.15.52:0/2735187900 shutdown_connections 2023-10-01T01:33:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.243+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/2735187900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a9815dc80 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.243+0000 7f9a9ea07640 1 -- 172.21.15.52:0/2735187900 >> 172.21.15.52:0/2735187900 conn(0x7f9a9806a200 msgr2=0x7f9a9806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.247+0000 7f9a9ea07640 1 -- 172.21.15.52:0/2735187900 shutdown_connections 2023-10-01T01:33:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.247+0000 7f9a9ea07640 1 -- 172.21.15.52:0/2735187900 wait complete. 2023-10-01T01:33:34.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.251+0000 7f9a9ea07640 1 Processor -- start 2023-10-01T01:33:34.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.251+0000 7f9a9ea07640 1 -- start start 2023-10-01T01:33:34.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a980b00a0 0x7f9a980b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a980b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a98153b70 0x7f9a980c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98153ff0 con 0x7f9a9815cb20 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980b2150 con 0x7f9a980b00a0 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980b2430 con 0x7f9a98153b70 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9cfa4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a98153b70 0x7f9a980c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9cfa4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a98153b70 0x7f9a980c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:55898/0 (socket says 172.21.15.52:55898) 2023-10-01T01:33:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a980b00a0 0x7f9a980b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9cfa4640 1 -- 172.21.15.52:0/914297507 learned_addr learned my addr 172.21.15.52:0/914297507 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a8ffff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a980b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 -- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a98153b70 msgr2=0x7f9a980c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a98153b70 0x7f9a980c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 -- 172.21.15.52:0/914297507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 msgr2=0x7f9a980b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a980b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 -- 172.21.15.52:0/914297507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009420 con 0x7f9a980b00a0 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a8ffff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a980b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a97fff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a980b00a0 0x7f9a980b1a50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ab000 tx=0x7f9a8001ab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800b7650 con 0x7f9a980b00a0 2023-10-01T01:33:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a800b77b0 con 0x7f9a980b00a0 2023-10-01T01:33:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800b7b60 con 0x7f9a980b00a0 2023-10-01T01:33:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980b0a40 con 0x7f9a980b00a0 2023-10-01T01:33:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.255+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980b29f0 con 0x7f9a980b00a0 2023-10-01T01:33:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.259+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f9a800b7cc0 con 0x7f9a980b00a0 2023-10-01T01:33:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.259+0000 7f9a957fa640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9a78066190 0x7f9a78068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.259+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9a8011e650 con 0x7f9a980b00a0 2023-10-01T01:33:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.259+0000 7f9a8ffff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9a78066190 0x7f9a78068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.259+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a980740a0 con 0x7f9a980b00a0 2023-10-01T01:33:34.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.259+0000 7f9a8ffff640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9a78066190 0x7f9a78068650 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9a980c6ac0 tx=0x7f9a88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:34.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.275+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f9a800ebb50 con 0x7f9a980b00a0 2023-10-01T01:33:34.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.511+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a980cbe70 con 0x7f9a980b00a0 2023-10-01T01:33:34.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.511+0000 7f9a957fa640 1 -- 172.21.15.52:0/914297507 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16769 (secure 0 0 0) 0x7f9a800b0020 con 0x7f9a980b00a0 2023-10-01T01:33:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:34.520 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-09-30T16:51:00.427901+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-09-30T16:50:13.342272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-09-30T16:50:14.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9a78066190 msgr2=0x7f9a78068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9a78066190 0x7f9a78068650 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9a980c6ac0 tx=0x7f9a88009040 comp rx=0 tx=0).stop 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a980b00a0 msgr2=0x7f9a980b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a980b00a0 0x7f9a980b1a50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ab000 tx=0x7f9a8001ab70 comp rx=0 tx=0).stop 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 shutdown_connections 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9a78066190 0x7f9a78068650 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a98153b70 0x7f9a980c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a9815cb20 0x7f9a980b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 --2- 172.21.15.52:0/914297507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a980b00a0 0x7f9a980b1a50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 >> 172.21.15.52:0/914297507 conn(0x7f9a9806a200 msgr2=0x7f9a9815e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 shutdown_connections 2023-10-01T01:33:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.515+0000 7f9a9ea07640 1 -- 172.21.15.52:0/914297507 wait complete. 2023-10-01T01:33:34.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-01T01:33:34.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 Processor -- start 2023-10-01T01:33:34.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 -- start start 2023-10-01T01:33:34.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2740ca860 0x7fd2740cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd274069e00 0x7fd27406a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740ccfe0 con 0x7fd27415bee0 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740caca0 con 0x7fd2740ca860 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd279360640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27406a7d0 con 0x7fd274069e00 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2727fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2740ca860 0x7fd2740cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd272ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd27415bee0 0x7fd27415ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59358/0 (socket says 172.21.15.52:59358) 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2727fc640 1 --2- 172.21.15.52:0/2589992180 >> v2:172.21.15.52:3300/0 conn(0x7fd2740ca860 0x7fd2740cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60816/0 (socket says 172.21.15.52:60816) 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd272ffd640 1 -- 172.21.15.52:0/2589992180 learned_addr learned my addr 172.21.15.52:0/2589992180 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2737fe640 1 --2- 172.21.15.52:0/2589992180 >> v2:172.21.15.186:3300/0 conn(0x7fd274069e00 0x7fd27406a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2727fc640 1 -- 172.21.15.52:0/2589992180 >> v2:172.21.15.186:3300/0 conn(0x7fd274069e00 msgr2=0x7fd27406a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:34.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2727fc640 1 --2- 172.21.15.52:0/2589992180 >> v2:172.21.15.186:3300/0 conn(0x7fd274069e00 0x7fd27406a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2727fc640 1 -- 172.21.15.52:0/2589992180 >> v1:172.21.15.52:6789/0 conn(0x7fd27415bee0 legacy=0x7fd27415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd2727fc640 1 -- 172.21.15.52:0/2589992180 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740cca20 con 0x7fd2740ca860 2023-10-01T01:33:34.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.683+0000 7fd271ffb640 1 -- 172.21.15.52:0/2589992180 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682557592 0 0) 0x7fd2740ccfe0 con 0x7fd27415bee0 2023-10-01T01:33:34.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.687+0000 7fd2727fc640 1 --2- 172.21.15.52:0/2589992180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2740ca860 0x7fd2740cc080 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fd2740c9d50 tx=0x7fd26801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d736c43d3e736f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:34.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.687+0000 7fd271ffb640 1 -- 172.21.15.52:0/2589992180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680ab600 con 0x7fd2740ca860 2023-10-01T01:33:34.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.687+0000 7fd271ffb640 1 -- 172.21.15.52:0/2589992180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680a7050 con 0x7fd2740ca860 2023-10-01T01:33:34.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.687+0000 7fd271ffb640 1 -- 172.21.15.52:0/2589992180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680ab980 con 0x7fd2740ca860 2023-10-01T01:33:34.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.687+0000 7fd279360640 1 -- 172.21.15.52:0/2589992180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2740ca860 msgr2=0x7fd2740cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.687+0000 7fd279360640 1 --2- 172.21.15.52:0/2589992180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2740ca860 0x7fd2740cc080 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fd2740c9d50 tx=0x7fd26801c460 comp rx=0 tx=0).stop 2023-10-01T01:33:34.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.695+0000 7fd279360640 1 -- 172.21.15.52:0/2589992180 shutdown_connections 2023-10-01T01:33:34.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.695+0000 7fd279360640 1 --2- 172.21.15.52:0/2589992180 >> v2:172.21.15.186:3300/0 conn(0x7fd274069e00 0x7fd27406a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.695+0000 7fd279360640 1 --2- 172.21.15.52:0/2589992180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2740ca860 0x7fd2740cc080 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.695+0000 7fd279360640 1 -- 172.21.15.52:0/2589992180 >> 172.21.15.52:0/2589992180 conn(0x7fd27406d320 msgr2=0x7fd27406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:34.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.699+0000 7fd279360640 1 -- 172.21.15.52:0/2589992180 shutdown_connections 2023-10-01T01:33:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.707+0000 7fd279360640 1 -- 172.21.15.52:0/2589992180 wait complete. 2023-10-01T01:33:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.707+0000 7fd279360640 1 Processor -- start 2023-10-01T01:33:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.707+0000 7fd279360640 1 -- start start 2023-10-01T01:33:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd274069e00 0x7fd2740c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 0x7fd274152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd27415bee0 0x7fd274163a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd274159fb0 con 0x7fd274069e00 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740ce8a0 con 0x7fd2740ca860 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740cd870 con 0x7fd27415bee0 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 0x7fd274152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2737fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd27415bee0 0x7fd274163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 0x7fd274152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:58522/0 (socket says 172.21.15.52:58522) 2023-10-01T01:33:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 -- 172.21.15.52:0/2574790801 learned_addr learned my addr 172.21.15.52:0/2574790801 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 -- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd27415bee0 msgr2=0x7fd274163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd27415bee0 0x7fd274163a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 -- 172.21.15.52:0/2574790801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd274069e00 msgr2=0x7fd2740c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd274069e00 0x7fd2740c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 -- 172.21.15.52:0/2574790801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd268009420 con 0x7fd2740ca860 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2737fe640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd27415bee0 0x7fd274163a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd2727fc640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 0x7fd274152370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd2680ae040 tx=0x7fd26801aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b7450 con 0x7fd2740ca860 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680b75d0 con 0x7fd2740ca860 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd274159610 con 0x7fd2740ca860 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd274159bd0 con 0x7fd2740ca860 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b7980 con 0x7fd2740ca860 2023-10-01T01:33:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27415a0f0 con 0x7fd2740ca860 2023-10-01T01:33:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.711+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd2680b7ae0 con 0x7fd2740ca860 2023-10-01T01:33:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.715+0000 7fd25b7fe640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd260066160 0x7fd260068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.715+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd26811e420 con 0x7fd2740ca860 2023-10-01T01:33:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.715+0000 7fd272ffd640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd260066160 0x7fd260068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.715+0000 7fd272ffd640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd260066160 0x7fd260068620 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd2640011f0 tx=0x7fd264007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:34.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.719+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fd27415a0f0 con 0x7fd2740ca860 2023-10-01T01:33:35.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:34.999+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd27415a0f0 con 0x7fd2740ca860 2023-10-01T01:33:35.036 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-10-01T01:33:35.027+0000 7f72aebe0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-01T01:33:35.072 INFO:tasks.ceph.mds.b.smithi186.stderr:2023-10-01T01:33:35.063+0000 7fddab37a640 -1 mds.0.12 we have been blocklisted (fenced), respawning... 2023-10-01T01:33:35.199 INFO:tasks.ceph.mds.b.smithi186.stderr: -10> 2023-10-01T01:33:35.063+0000 7fddab37a640 -1 mds.0.12 we have been blocklisted (fenced), respawning... 2023-10-01T01:33:35.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.223+0000 7fd25b7fe640 1 -- 172.21.15.52:0/2574790801 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd27415a0f0 con 0x7fd2740ca860 2023-10-01T01:33:35.232 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-01T01:33:35.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd260066160 msgr2=0x7fd260068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:35.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd260066160 0x7fd260068620 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd2640011f0 tx=0x7fd264007930 comp rx=0 tx=0).stop 2023-10-01T01:33:35.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 msgr2=0x7fd274152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:35.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 0x7fd274152370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd2680ae040 tx=0x7fd26801aca0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 shutdown_connections 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd260066160 0x7fd260068620 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd27415bee0 0x7fd274163a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2740ca860 0x7fd274152370 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 --2- 172.21.15.52:0/2574790801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd274069e00 0x7fd2740c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 >> 172.21.15.52:0/2574790801 conn(0x7fd27406d320 msgr2=0x7fd27415c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 shutdown_connections 2023-10-01T01:33:35.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.227+0000 7fd279360640 1 -- 172.21.15.52:0/2574790801 wait complete. 2023-10-01T01:33:35.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-01T01:33:35.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc543bb640 1 Processor -- start 2023-10-01T01:33:35.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc543bb640 1 -- start start 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc543bb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc4c0c9d20 0x7efc4c070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc543bb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c15d3a0 con 0x7efc4c0ca1a0 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc543bb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c06db80 con 0x7efc4c159780 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc543bb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c0cd740 con 0x7efc4c0c9d20 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.375+0000 7efc51956640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc4c0c9d20 0x7efc4c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51956640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efc4c0c9d20 0x7efc4c070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56194/0 (socket says 172.21.15.52:56194) 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51956640 1 -- 172.21.15.52:0/4155964452 learned_addr learned my addr 172.21.15.52:0/4155964452 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:35.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51956640 1 -- 172.21.15.52:0/4155964452 >> v1:172.21.15.186:6789/0 conn(0x7efc4c159780 legacy=0x7efc4c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:35.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51956640 1 -- 172.21.15.52:0/4155964452 >> v1:172.21.15.52:6789/0 conn(0x7efc4c0ca1a0 legacy=0x7efc4c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:35.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51956640 1 -- 172.21.15.52:0/4155964452 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c0cda20 con 0x7efc4c0c9d20 2023-10-01T01:33:35.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51155640 1 -- 172.21.15.52:0/4155964452 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921417938 0 0) 0x7efc4c15d3a0 con 0x7efc4c0ca1a0 2023-10-01T01:33:35.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51956640 1 --2- 172.21.15.52:0/4155964452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c0c9d20 0x7efc4c070070 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00bb10 tx=0x7efc3c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8352c4095041637 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:35.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51155640 1 -- 172.21.15.52:0/4155964452 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0a7a30 con 0x7efc4c0c9d20 2023-10-01T01:33:35.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51155640 1 -- 172.21.15.52:0/4155964452 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c0a7b90 con 0x7efc4c0c9d20 2023-10-01T01:33:35.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc51155640 1 -- 172.21.15.52:0/4155964452 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0af440 con 0x7efc4c0c9d20 2023-10-01T01:33:35.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 -- 172.21.15.52:0/4155964452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c0c9d20 msgr2=0x7efc4c070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:35.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 --2- 172.21.15.52:0/4155964452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c0c9d20 0x7efc4c070070 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00bb10 tx=0x7efc3c01eb50 comp rx=0 tx=0).stop 2023-10-01T01:33:35.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 -- 172.21.15.52:0/4155964452 shutdown_connections 2023-10-01T01:33:35.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 --2- 172.21.15.52:0/4155964452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c0c9d20 0x7efc4c070070 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 -- 172.21.15.52:0/4155964452 >> 172.21.15.52:0/4155964452 conn(0x7efc4c06a5c0 msgr2=0x7efc4c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:35.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 -- 172.21.15.52:0/4155964452 shutdown_connections 2023-10-01T01:33:35.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.379+0000 7efc543bb640 1 -- 172.21.15.52:0/4155964452 wait complete. 2023-10-01T01:33:35.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 Processor -- start 2023-10-01T01:33:35.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- start start 2023-10-01T01:33:35.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc4c0c9d20 0x7efc4c147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:35.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc4c0ca1a0 0x7efc4c0bd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:35.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 0x7efc4c0be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:35.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0c1480 con 0x7efc4c159780 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c148750 con 0x7efc4c0c9d20 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c14a500 con 0x7efc4c0ca1a0 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 0x7efc4c0be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 0x7efc4c0be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56196/0 (socket says 172.21.15.52:56196) 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 -- 172.21.15.52:0/1897755343 learned_addr learned my addr 172.21.15.52:0/1897755343 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc51956640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc4c0ca1a0 0x7efc4c0bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:35.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52157640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc4c0c9d20 0x7efc4c147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 -- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc4c0ca1a0 msgr2=0x7efc4c0bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc4c0ca1a0 0x7efc4c0bd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 -- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc4c0c9d20 msgr2=0x7efc4c147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc4c0c9d20 0x7efc4c147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 -- 172.21.15.52:0/1897755343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c00b770 con 0x7efc4c159780 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc51956640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc4c0ca1a0 0x7efc4c0bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc52958640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 0x7efc4c0be1d0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c780 tx=0x7efc4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44003db0 con 0x7efc4c159780 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400ce30 con 0x7efc4c159780 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c14a7e0 con 0x7efc4c159780 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440052b0 con 0x7efc4c159780 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c148c80 con 0x7efc4c159780 2023-10-01T01:33:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c15ce40 con 0x7efc4c159780 2023-10-01T01:33:35.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.383+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7efc44005410 con 0x7efc4c159780 2023-10-01T01:33:35.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.387+0000 7efc42ffd640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc30066160 0x7efc30068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:35.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.387+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5911+0+0 (secure 0 0 0) 0x7efc44083880 con 0x7efc4c159780 2023-10-01T01:33:35.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.387+0000 7efc52157640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc30066160 0x7efc30068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:35.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.387+0000 7efc52157640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc30066160 0x7efc30068620 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efc4c14a100 tx=0x7efc48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:35.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.391+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7efc44050dd0 con 0x7efc4c159780 2023-10-01T01:33:35.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:35.579+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc4c148ea0 con 0x7efc4c159780 2023-10-01T01:33:35.654 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2023-10-01T01:33:36.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.307+0000 7efc42ffd640 1 -- 172.21.15.52:0/1897755343 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc440543f0 con 0x7efc4c159780 2023-10-01T01:33:36.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc30066160 msgr2=0x7efc30068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc30066160 0x7efc30068620 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efc4c14a100 tx=0x7efc48009040 comp rx=0 tx=0).stop 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 msgr2=0x7efc4c0be1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 0x7efc4c0be1d0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c780 tx=0x7efc4400cc40 comp rx=0 tx=0).stop 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 shutdown_connections 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7efc30066160 0x7efc30068620 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc4c159780 0x7efc4c0be1d0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efc4c0ca1a0 0x7efc4c0bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 --2- 172.21.15.52:0/1897755343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc4c0c9d20 0x7efc4c147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 >> 172.21.15.52:0/1897755343 conn(0x7efc4c06a5c0 msgr2=0x7efc4c157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 shutdown_connections 2023-10-01T01:33:36.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.311+0000 7efc543bb640 1 -- 172.21.15.52:0/1897755343 wait complete. 2023-10-01T01:33:36.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-01T01:33:36.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 Processor -- start 2023-10-01T01:33:36.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 -- start start 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa2b4159780 0x7fa2b406d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b4070070 0x7fa2b4070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b415d3a0 con 0x7fa2b406d9b0 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b4070a40 con 0x7fa2b4159780 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2bc3dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40cd740 con 0x7fa2b4070070 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba179640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa2b4159780 0x7fa2b406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba97a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b4070070 0x7fa2b4070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2b9978640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa2b406d9b0 0x7fa2b40c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:58856/0 (socket says 172.21.15.52:58856) 2023-10-01T01:33:36.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2b9978640 1 -- 172.21.15.52:0/3020064398 learned_addr learned my addr 172.21.15.52:0/3020064398 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:36.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba179640 1 -- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b4070070 msgr2=0x7fa2b4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:36.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba179640 1 --2- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b4070070 0x7fa2b4070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba179640 1 -- 172.21.15.52:0/3020064398 >> v1:172.21.15.186:6789/0 conn(0x7fa2b406d9b0 legacy=0x7fa2b40c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:36.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba179640 1 -- 172.21.15.52:0/3020064398 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40cda20 con 0x7fa2b4159780 2023-10-01T01:33:36.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.459+0000 7fa2ba97a640 1 --2- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b4070070 0x7fa2b4070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:36.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2ba179640 1 --2- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b406d470 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009d90 tx=0x7fa2a401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1025292eaed10527 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:36.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2b9177640 1 -- 172.21.15.52:0/3020064398 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40a5950 con 0x7fa2b4159780 2023-10-01T01:33:36.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2b9177640 1 -- 172.21.15.52:0/3020064398 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40a5ab0 con 0x7fa2b4159780 2023-10-01T01:33:36.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2b9177640 1 -- 172.21.15.52:0/3020064398 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40a5e40 con 0x7fa2b4159780 2023-10-01T01:33:36.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 msgr2=0x7fa2b406d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:36.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b406d470 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009d90 tx=0x7fa2a401c890 comp rx=0 tx=0).stop 2023-10-01T01:33:36.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/3020064398 shutdown_connections 2023-10-01T01:33:36.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b4070070 0x7fa2b4070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/3020064398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b406d470 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/3020064398 >> 172.21.15.52:0/3020064398 conn(0x7fa2b406a5c0 msgr2=0x7fa2b40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:36.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/3020064398 shutdown_connections 2023-10-01T01:33:36.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.463+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/3020064398 wait complete. 2023-10-01T01:33:36.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 Processor -- start 2023-10-01T01:33:36.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 -- start start 2023-10-01T01:33:36.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 0x7fa2b40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:36.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b40c5ba0 0x7fa2b414a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c8a00 con 0x7fa2b4070070 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c5160 con 0x7fa2b4159780 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c4ee0 con 0x7fa2b40c5ba0 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 0x7fa2b40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 0x7fa2b40c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56198/0 (socket says 172.21.15.52:56198) 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2b9978640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 -- 172.21.15.52:0/453767188 learned_addr learned my addr 172.21.15.52:0/453767188 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba97a640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b40c5ba0 0x7fa2b414a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 -- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b40c5ba0 msgr2=0x7fa2b414a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b40c5ba0 0x7fa2b414a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 -- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 msgr2=0x7fa2b40c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:36.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b40c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:36.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 -- 172.21.15.52:0/453767188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac009420 con 0x7fa2b4070070 2023-10-01T01:33:36.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2ba179640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 0x7fa2b40c49a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fa2a401a4c0 tx=0x7fa2a4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4007000 con 0x7fa2b4070070 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40aee00 con 0x7fa2b4070070 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a40b7650 con 0x7fa2b4070070 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a4009a70 con 0x7fa2b4070070 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.467+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b40c80d0 con 0x7fa2b4070070 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.471+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b40740a0 con 0x7fa2b4070070 2023-10-01T01:33:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.471+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fa2a40b4050 con 0x7fa2b4070070 2023-10-01T01:33:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.471+0000 7fa2b2ffd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa2a0066190 0x7fa2a0068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.471+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fa2a411eed0 con 0x7fa2b4070070 2023-10-01T01:33:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.471+0000 7fa2b9978640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa2a0066190 0x7fa2a0068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.471+0000 7fa2b9978640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa2a0066190 0x7fa2a0068650 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa2b41f8dd0 tx=0x7fa2a8007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:36.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.475+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fa2a40ec680 con 0x7fa2b4070070 2023-10-01T01:33:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:36.635+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2b4159ef0 con 0x7fa2b4070070 2023-10-01T01:33:37.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2b2ffd640 1 -- 172.21.15.52:0/453767188 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa2a40b20d0 con 0x7fa2b4070070 2023-10-01T01:33:37.338 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-10-01T01:33:37.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa2a0066190 msgr2=0x7fa2a0068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa2a0066190 0x7fa2a0068650 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa2b41f8dd0 tx=0x7fa2a8007e90 comp rx=0 tx=0).stop 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 msgr2=0x7fa2b40c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 0x7fa2b40c49a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fa2a401a4c0 tx=0x7fa2a4019630 comp rx=0 tx=0).stop 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 shutdown_connections 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fa2a0066190 0x7fa2a0068650 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b40c5ba0 0x7fa2b414a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b4159780 0x7fa2b40c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 --2- 172.21.15.52:0/453767188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2b4070070 0x7fa2b40c49a0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 >> 172.21.15.52:0/453767188 conn(0x7fa2b406a5c0 msgr2=0x7fa2b40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 shutdown_connections 2023-10-01T01:33:37.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.331+0000 7fa2bc3dd640 1 -- 172.21.15.52:0/453767188 wait complete. 2023-10-01T01:33:37.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-01T01:33:37.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 Processor -- start 2023-10-01T01:33:37.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 -- start start 2023-10-01T01:33:37.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f235c15c9a0 0x7f235c160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f235c0cda60 0x7f235c0d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c161530 con 0x7f235c0b1b50 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0b2430 con 0x7f235c0cda60 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f2363c37640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0d1700 con 0x7f235c15c9a0 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f23621d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f235c0cda60 0x7f235c0d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f23621d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f235c0cda60 0x7f235c0d2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56210/0 (socket says 172.21.15.52:56210) 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.535+0000 7f23621d4640 1 -- 172.21.15.52:0/2362560811 learned_addr learned my addr 172.21.15.52:0/2362560811 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.539+0000 7f23621d4640 1 -- 172.21.15.52:0/2362560811 >> v2:172.21.15.186:3300/0 conn(0x7f235c15c9a0 msgr2=0x7f235c160ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.539+0000 7f23621d4640 1 --2- 172.21.15.52:0/2362560811 >> v2:172.21.15.186:3300/0 conn(0x7f235c15c9a0 0x7f235c160ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.539+0000 7f23621d4640 1 -- 172.21.15.52:0/2362560811 >> v1:172.21.15.186:6789/0 conn(0x7f235c0b1b50 legacy=0x7f235c0cd350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:37.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.539+0000 7f23621d4640 1 -- 172.21.15.52:0/2362560811 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c0d0af0 con 0x7f235c0cda60 2023-10-01T01:33:37.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.539+0000 7f23621d4640 1 --2- 172.21.15.52:0/2362560811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c0cda60 0x7f235c0d2030 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f235c0cf4d0 tx=0x7f23540254c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8348379fe90025 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:37.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f23609d1640 1 -- 172.21.15.52:0/2362560811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540112d0 con 0x7f235c0cda60 2023-10-01T01:33:37.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f23609d1640 1 -- 172.21.15.52:0/2362560811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354011430 con 0x7f235c0cda60 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f2363c37640 1 -- 172.21.15.52:0/2362560811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c0cda60 msgr2=0x7f235c0d2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f2363c37640 1 --2- 172.21.15.52:0/2362560811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c0cda60 0x7f235c0d2030 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f235c0cf4d0 tx=0x7f23540254c0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f2363c37640 1 -- 172.21.15.52:0/2362560811 shutdown_connections 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f2363c37640 1 --2- 172.21.15.52:0/2362560811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c0cda60 0x7f235c0d2030 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f2363c37640 1 --2- 172.21.15.52:0/2362560811 >> v2:172.21.15.186:3300/0 conn(0x7f235c15c9a0 0x7f235c160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.543+0000 7f2363c37640 1 -- 172.21.15.52:0/2362560811 >> 172.21.15.52:0/2362560811 conn(0x7f235c071930 msgr2=0x7f235c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:37.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.547+0000 7f2363c37640 1 -- 172.21.15.52:0/2362560811 shutdown_connections 2023-10-01T01:33:37.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.547+0000 7f2363c37640 1 -- 172.21.15.52:0/2362560811 wait complete. 2023-10-01T01:33:37.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.547+0000 7f2363c37640 1 Processor -- start 2023-10-01T01:33:37.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.547+0000 7f2363c37640 1 -- start start 2023-10-01T01:33:37.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.547+0000 7f2363c37640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 0x7f235c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:37.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c15c9a0 0x7f235c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:37.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f235c0cb020 0x7f235c204210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:37.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c15d150 con 0x7f235c15c9a0 2023-10-01T01:33:37.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b6470 con 0x7f235c0b1b50 2023-10-01T01:33:37.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0cb4b0 con 0x7f235c0cb020 2023-10-01T01:33:37.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 0x7f235c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:37.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 0x7f235c157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:59936/0 (socket says 172.21.15.52:59936) 2023-10-01T01:33:37.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 -- 172.21.15.52:0/3150217154 learned_addr learned my addr 172.21.15.52:0/3150217154 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:37.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 -- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f235c0cb020 msgr2=0x7f235c204210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T01:33:37.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f235c0cb020 0x7f235c204210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 -- 172.21.15.52:0/3150217154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c15c9a0 msgr2=0x7f235c0caae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-01T01:33:37.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c15c9a0 0x7f235c0caae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:37.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 -- 172.21.15.52:0/3150217154 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354014660 con 0x7f235c0b1b50 2023-10-01T01:33:37.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23619d3640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 0x7f235c157f10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f235800b420 tx=0x7f235800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358011830 con 0x7f235c0b1b50 2023-10-01T01:33:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358011990 con 0x7f235c0b1b50 2023-10-01T01:33:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358011d40 con 0x7f235c0b1b50 2023-10-01T01:33:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c0cb760 con 0x7f235c0b1b50 2023-10-01T01:33:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c0b5e20 con 0x7f235c0b1b50 2023-10-01T01:33:37.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.551+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2344005260 con 0x7f235c0b1b50 2023-10-01T01:33:37.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.555+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f2358004020 con 0x7f235c0b1b50 2023-10-01T01:33:37.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.555+0000 7f23527fc640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066190 0x7f2340068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:37.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.555+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f23580836c0 con 0x7f235c0b1b50 2023-10-01T01:33:37.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.555+0000 7f23611d2640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066190 0x7f2340068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.555+0000 7f23611d2640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066190 0x7f2340068650 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f235c156a90 tx=0x7f234c006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:37.567+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f2358050ea0 con 0x7f235c0b1b50 2023-10-01T01:33:38.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.031+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2344005510 con 0x7f235c0b1b50 2023-10-01T01:33:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.347+0000 7f23527fc640 1 -- 172.21.15.52:0/3150217154 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f23580544c0 con 0x7f235c0b1b50 2023-10-01T01:33:38.353 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-10-01T01:33:38.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066190 msgr2=0x7f2340068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:38.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066190 0x7f2340068650 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f235c156a90 tx=0x7f234c006be0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 msgr2=0x7f235c157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:38.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 0x7f235c157f10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f235800b420 tx=0x7f235800b8e0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 shutdown_connections 2023-10-01T01:33:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f2340066190 0x7f2340068650 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f235c0cb020 0x7f235c204210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f235c15c9a0 0x7f235c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 --2- 172.21.15.52:0/3150217154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f235c0b1b50 0x7f235c157f10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 >> 172.21.15.52:0/3150217154 conn(0x7f235c071930 msgr2=0x7f235c158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 shutdown_connections 2023-10-01T01:33:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.367+0000 7f2363c37640 1 -- 172.21.15.52:0/3150217154 wait complete. 2023-10-01T01:33:38.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-01T01:33:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.855+0000 7f8b2a3c2640 1 Processor -- start 2023-10-01T01:33:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.855+0000 7f8b2a3c2640 1 -- start start 2023-10-01T01:33:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b2a3c2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b1c0507d0 0x7f8b1c050bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b2a3c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 0x7f8b1c053050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b2a3c2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c051570 con 0x7f8b1c053590 2023-10-01T01:33:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b2a3c2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c04fcb0 con 0x7f8b1c0507d0 2023-10-01T01:33:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b2a3c2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c04ff30 con 0x7f8b1c03a690 2023-10-01T01:33:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 0x7f8b1c053050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 0x7f8b1c053050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:45220/0 (socket says 172.21.15.52:45220) 2023-10-01T01:33:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 -- 172.21.15.52:0/793192014 learned_addr learned my addr 172.21.15.52:0/793192014 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 -- 172.21.15.52:0/793192014 >> v2:172.21.15.52:3300/0 conn(0x7f8b1c0507d0 msgr2=0x7f8b1c050bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b293c0640 1 --2- 172.21.15.52:0/793192014 >> v2:172.21.15.52:3300/0 conn(0x7f8b1c0507d0 0x7f8b1c050bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 --2- 172.21.15.52:0/793192014 >> v2:172.21.15.52:3300/0 conn(0x7f8b1c0507d0 0x7f8b1c050bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 -- 172.21.15.52:0/793192014 >> v1:172.21.15.186:6789/0 conn(0x7f8b1c053590 legacy=0x7f8b1c053a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-01T01:33:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.859+0000 7f8b28bbf640 1 -- 172.21.15.52:0/793192014 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c050210 con 0x7f8b1c03a690 2023-10-01T01:33:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b293c0640 1 --2- 172.21.15.52:0/793192014 >> v2:172.21.15.52:3300/0 conn(0x7f8b1c0507d0 0x7f8b1c050bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b28bbf640 1 --2- 172.21.15.52:0/793192014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 0x7f8b1c053050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000bb10 tx=0x7f8b2001ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14fe29c8a0da04a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b1bfff640 1 -- 172.21.15.52:0/793192014 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a7b50 con 0x7f8b1c03a690 2023-10-01T01:33:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b1bfff640 1 -- 172.21.15.52:0/793192014 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b200a7cb0 con 0x7f8b1c03a690 2023-10-01T01:33:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b1bfff640 1 -- 172.21.15.52:0/793192014 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200af640 con 0x7f8b1c03a690 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/793192014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 msgr2=0x7f8b1c053050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/793192014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 0x7f8b1c053050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000bb10 tx=0x7f8b2001ebc0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/793192014 shutdown_connections 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/793192014 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c03a690 0x7f8b1c053050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/793192014 >> v2:172.21.15.52:3300/0 conn(0x7f8b1c0507d0 0x7f8b1c050bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.863+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/793192014 >> 172.21.15.52:0/793192014 conn(0x7f8b1c054c80 msgr2=0x7f8b1c055090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/793192014 shutdown_connections 2023-10-01T01:33:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/793192014 wait complete. 2023-10-01T01:33:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 Processor -- start 2023-10-01T01:33:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 -- start start 2023-10-01T01:33:38.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 0x7f8b1c048820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:38.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c0507d0 0x7f8b1c04aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:38.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b1c053590 0x7f8b1c0d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:38.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0368b0 con 0x7f8b1c03a690 2023-10-01T01:33:38.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c036b90 con 0x7f8b1c053590 2023-10-01T01:33:38.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b2a3c2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c036e70 con 0x7f8b1c0507d0 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b293c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 0x7f8b1c048820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b293c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 0x7f8b1c048820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56238/0 (socket says 172.21.15.52:56238) 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b293c0640 1 -- 172.21.15.52:0/1599755242 learned_addr learned my addr 172.21.15.52:0/1599755242 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b28bbf640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c0507d0 0x7f8b1c04aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.867+0000 7f8b29bc1640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b1c053590 0x7f8b1c0d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b28bbf640 1 -- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b1c053590 msgr2=0x7f8b1c0d5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b28bbf640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b1c053590 0x7f8b1c0d5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b28bbf640 1 -- 172.21.15.52:0/1599755242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 msgr2=0x7f8b1c048820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b28bbf640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 0x7f8b1c048820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b28bbf640 1 -- 172.21.15.52:0/1599755242 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2000b770 con 0x7f8b1c0507d0 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b293c0640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 0x7f8b1c048820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.871+0000 7f8b28bbf640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c0507d0 0x7f8b1c04aeb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b200ae000 tx=0x7f8b2001b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.879+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20003820 con 0x7f8b1c0507d0 2023-10-01T01:33:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.879+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20003980 con 0x7f8b1c0507d0 2023-10-01T01:33:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.879+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c037150 con 0x7f8b1c0507d0 2023-10-01T01:33:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.879+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20003cf0 con 0x7f8b1c0507d0 2023-10-01T01:33:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.879+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c048d60 con 0x7f8b1c0507d0 2023-10-01T01:33:38.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.879+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8b200bb450 con 0x7f8b1c0507d0 2023-10-01T01:33:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.883+0000 7f8b19ffb640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8b08066230 0x7f8b080686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.883+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b2011e6f0 con 0x7f8b1c0507d0 2023-10-01T01:33:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.883+0000 7f8b293c0640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8b08066230 0x7f8b080686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.883+0000 7f8b293c0640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8b08066230 0x7f8b080686f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8b24069420 tx=0x7f8b2406d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.883+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c037670 con 0x7f8b1c0507d0 2023-10-01T01:33:38.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:38.895+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f8b200ec250 con 0x7f8b1c0507d0 2023-10-01T01:33:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.207+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8b1c0054c0 con 0x7f8b1c0507d0 2023-10-01T01:33:39.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.283+0000 7f8b19ffb640 1 -- 172.21.15.52:0/1599755242 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b200ef870 con 0x7f8b1c0507d0 2023-10-01T01:33:39.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8b08066230 msgr2=0x7f8b080686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:39.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8b08066230 0x7f8b080686f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8b24069420 tx=0x7f8b2406d040 comp rx=0 tx=0).stop 2023-10-01T01:33:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c0507d0 msgr2=0x7f8b1c04aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:39.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c0507d0 0x7f8b1c04aeb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b200ae000 tx=0x7f8b2001b960 comp rx=0 tx=0).stop 2023-10-01T01:33:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 shutdown_connections 2023-10-01T01:33:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8b08066230 0x7f8b080686f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b1c053590 0x7f8b1c0d5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b1c0507d0 0x7f8b1c04aeb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 --2- 172.21.15.52:0/1599755242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b1c03a690 0x7f8b1c048820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 >> 172.21.15.52:0/1599755242 conn(0x7f8b1c054c80 msgr2=0x7f8b1c004b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:39.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 shutdown_connections 2023-10-01T01:33:39.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.287+0000 7f8b2a3c2640 1 -- 172.21.15.52:0/1599755242 wait complete. 2023-10-01T01:33:39.326 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-01T01:33:39.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.867+0000 7f559d74d640 1 Processor -- start 2023-10-01T01:33:39.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.867+0000 7f559d74d640 1 -- start start 2023-10-01T01:33:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.867+0000 7f559d74d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f55980cc890 0x7f55980cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.867+0000 7f559d74d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55980ce170 con 0x7f55980cd960 2023-10-01T01:33:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.867+0000 7f559d74d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559806eea0 con 0x7f5598159850 2023-10-01T01:33:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.867+0000 7f559d74d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559806f180 con 0x7f55980cc890 2023-10-01T01:33:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.871+0000 7f55967fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f55980cc890 0x7f55980cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.871+0000 7f55967fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f55980cc890 0x7f55980cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:59952/0 (socket says 172.21.15.52:59952) 2023-10-01T01:33:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.871+0000 7f55967fc640 1 -- 172.21.15.52:0/1007154329 learned_addr learned my addr 172.21.15.52:0/1007154329 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:39.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.875+0000 7f55967fc640 1 -- 172.21.15.52:0/1007154329 >> v1:172.21.15.186:6789/0 conn(0x7f5598159850 legacy=0x7f55980cc180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-01T01:33:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.875+0000 7f55967fc640 1 -- 172.21.15.52:0/1007154329 >> v1:172.21.15.52:6789/0 conn(0x7f55980cd960 legacy=0x7f55980ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:39.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.875+0000 7f55967fc640 1 -- 172.21.15.52:0/1007154329 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559806f460 con 0x7f55980cc890 2023-10-01T01:33:39.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.899+0000 7f55967fc640 1 --2- 172.21.15.52:0/1007154329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cc890 0x7f55980cd420 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f558801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef5d0009c81c66c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.899+0000 7f5595ffb640 1 -- 172.21.15.52:0/1007154329 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880ab660 con 0x7f55980cc890 2023-10-01T01:33:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.899+0000 7f5595ffb640 1 -- 172.21.15.52:0/1007154329 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880ab7c0 con 0x7f55980cc890 2023-10-01T01:33:39.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.899+0000 7f5595ffb640 1 -- 172.21.15.52:0/1007154329 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880abb50 con 0x7f55980cc890 2023-10-01T01:33:39.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.899+0000 7f559d74d640 1 -- 172.21.15.52:0/1007154329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cc890 msgr2=0x7f55980cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:39.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.899+0000 7f559d74d640 1 --2- 172.21.15.52:0/1007154329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cc890 0x7f55980cd420 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f558801c440 comp rx=0 tx=0).stop 2023-10-01T01:33:39.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.903+0000 7f559d74d640 1 -- 172.21.15.52:0/1007154329 shutdown_connections 2023-10-01T01:33:39.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.903+0000 7f559d74d640 1 --2- 172.21.15.52:0/1007154329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cc890 0x7f55980cd420 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.903+0000 7f559d74d640 1 -- 172.21.15.52:0/1007154329 >> 172.21.15.52:0/1007154329 conn(0x7f559806d320 msgr2=0x7f559806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:39.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.903+0000 7f559d74d640 1 -- 172.21.15.52:0/1007154329 shutdown_connections 2023-10-01T01:33:39.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.903+0000 7f559d74d640 1 -- 172.21.15.52:0/1007154329 wait complete. 2023-10-01T01:33:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 Processor -- start 2023-10-01T01:33:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 -- start start 2023-10-01T01:33:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55980cc890 0x7f5598150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cd960 0x7f559815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 0x7f55980afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5598151400 con 0x7f5598159850 2023-10-01T01:33:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559815ba10 con 0x7f55980cd960 2023-10-01T01:33:39.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f559d74d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559815bcf0 con 0x7f55980cc890 2023-10-01T01:33:39.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f55977fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 0x7f55980afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:39.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f55977fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 0x7f55980afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56244/0 (socket says 172.21.15.52:56244) 2023-10-01T01:33:39.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f55977fe640 1 -- 172.21.15.52:0/1616962531 learned_addr learned my addr 172.21.15.52:0/1616962531 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:39.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.907+0000 7f5596ffd640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55980cc890 0x7f5598150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f55977fe640 1 -- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55980cc890 msgr2=0x7f5598150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f55977fe640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55980cc890 0x7f5598150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f55977fe640 1 -- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cd960 msgr2=0x7f559815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f55977fe640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cd960 0x7f559815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f55977fe640 1 -- 172.21.15.52:0/1616962531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880094d0 con 0x7f5598159850 2023-10-01T01:33:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f55977fe640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 0x7f55980afb00 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f559000ea80 tx=0x7f559000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:39.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.911+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590002020 con 0x7f5598159850 2023-10-01T01:33:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.915+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559815bfd0 con 0x7f5598159850 2023-10-01T01:33:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.915+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559815b600 con 0x7f5598159850 2023-10-01T01:33:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.915+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590003980 con 0x7f5598159850 2023-10-01T01:33:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.915+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590003d30 con 0x7f5598159850 2023-10-01T01:33:39.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.919+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f55900050d0 con 0x7f5598159850 2023-10-01T01:33:39.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.927+0000 7f557f7fe640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5584066230 0x7f55840686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:39.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.927+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5590085d00 con 0x7f5598159850 2023-10-01T01:33:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.931+0000 7f5596ffd640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5584066230 0x7f55840686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.931+0000 7f5596ffd640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5584066230 0x7f55840686f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f558c009890 tx=0x7f558c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:39.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.931+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5578005260 con 0x7f5598159850 2023-10-01T01:33:39.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:39.939+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f559001f080 con 0x7f5598159850 2023-10-01T01:33:41.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.047+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f5578005510 con 0x7f5598159850 2023-10-01T01:33:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.375+0000 7f557f7fe640 1 -- 172.21.15.52:0/1616962531 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v15813) v1 ==== 144+0+0 (secure 0 0 0) 0x7f5590053600 con 0x7f5598159850 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5584066230 msgr2=0x7f55840686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5584066230 0x7f55840686f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f558c009890 tx=0x7f558c008040 comp rx=0 tx=0).stop 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 msgr2=0x7f55980afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 0x7f55980afb00 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f559000ea80 tx=0x7f559000ef40 comp rx=0 tx=0).stop 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 shutdown_connections 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f5584066230 0x7f55840686f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:41.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5598159850 0x7f55980afb00 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:41.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55980cd960 0x7f559815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:41.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 --2- 172.21.15.52:0/1616962531 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55980cc890 0x7f5598150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:41.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.387+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 >> 172.21.15.52:0/1616962531 conn(0x7f559806d320 msgr2=0x7f55980b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:41.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.391+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 shutdown_connections 2023-10-01T01:33:41.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:41.391+0000 7f559d74d640 1 -- 172.21.15.52:0/1616962531 wait complete. 2023-10-01T01:33:41.532 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner: 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-01T01:33:41.533 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner: 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:Ran 1 test in 31435.962s 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner: 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner: 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-01T01:33:41.534 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-10-01T01:33:41.535 INFO:tasks.cephfs_test_runner: 2023-10-01T01:33:41.535 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-01T01:33:41.618 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bb109f41092d42c8bafd7279a4497732 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-01T01:33:41.620 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-01T01:33:41.629 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-01T01:33:41.649 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-01T01:33:41.649 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-10-01T01:33:41.649 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:41.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339636k,nr_inodes=4084909,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-01T01:33:41.707 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-10-01T01:33:41.707 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:41.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339636k,nr_inodes=4084909,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16275 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-01T01:33:41.761 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-10-01T01:33:41.761 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:41.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336536k,nr_inodes=4084134,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18858 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-01T01:33:41.815 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-10-01T01:33:41.815 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-01T01:33:41.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336536k,nr_inodes=4084134,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18858 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-01T01:33:41.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:41.908 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2023-10-01T01:33:41.960 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-01T01:33:42.062 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-01T01:33:42.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.063 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-01T01:33:42.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.240 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-01T01:33:42.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2023-10-01T01:33:42.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.563 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-10-01T01:33:42.594 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-01T01:33:42.595 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-01T01:33:42.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-01T01:33:42.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.722 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-01T01:33:42.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-01T01:33:42.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-10-01T01:33:42.987 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-01T01:33:42.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-01T01:33:42.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T01:33:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 Processor -- start 2023-10-01T01:33:43.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 -- start start 2023-10-01T01:33:43.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64880c1980 0x7f6488070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:43.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6488070580 0x7f64880ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:43.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64881613a0 con 0x7f64880caf40 2023-10-01T01:33:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880cb440 con 0x7f64880c1980 2023-10-01T01:33:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648eef1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880cb720 con 0x7f6488070580 2023-10-01T01:33:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648e6f0640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f64880caf40 0x7f6488164fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:58870/0 (socket says 172.21.15.52:58870) 2023-10-01T01:33:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648e6f0640 1 -- 172.21.15.52:0/4063360484 learned_addr learned my addr 172.21.15.52:0/4063360484 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.423+0000 7f648d6ee640 1 --2- 172.21.15.52:0/4063360484 >> v2:172.21.15.186:3300/0 conn(0x7f6488070580 0x7f64880ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.427+0000 7f648d6ee640 1 -- 172.21.15.52:0/4063360484 >> v2:172.21.15.52:3300/0 conn(0x7f64880c1980 msgr2=0x7f6488070040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.427+0000 7f648d6ee640 1 --2- 172.21.15.52:0/4063360484 >> v2:172.21.15.52:3300/0 conn(0x7f64880c1980 0x7f6488070040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.427+0000 7f648d6ee640 1 -- 172.21.15.52:0/4063360484 >> v1:172.21.15.186:6789/0 conn(0x7f64880caf40 legacy=0x7f6488164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.427+0000 7f648d6ee640 1 -- 172.21.15.52:0/4063360484 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880cba00 con 0x7f6488070580 2023-10-01T01:33:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.427+0000 7f648d6ee640 1 --2- 172.21.15.52:0/4063360484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6488070580 0x7f64880ce700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f64780097c0 tx=0x7f647801c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d464f96f10d75170 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648ceed640 1 -- 172.21.15.52:0/4063360484 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780ab600 con 0x7f6488070580 2023-10-01T01:33:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648ceed640 1 -- 172.21.15.52:0/4063360484 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64780a7050 con 0x7f6488070580 2023-10-01T01:33:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 -- 172.21.15.52:0/4063360484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6488070580 msgr2=0x7f64880ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:43.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 --2- 172.21.15.52:0/4063360484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6488070580 0x7f64880ce700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f64780097c0 tx=0x7f647801c2c0 comp rx=0 tx=0).stop 2023-10-01T01:33:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 -- 172.21.15.52:0/4063360484 shutdown_connections 2023-10-01T01:33:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 --2- 172.21.15.52:0/4063360484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6488070580 0x7f64880ce700 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:43.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 --2- 172.21.15.52:0/4063360484 >> v2:172.21.15.52:3300/0 conn(0x7f64880c1980 0x7f6488070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 -- 172.21.15.52:0/4063360484 >> 172.21.15.52:0/4063360484 conn(0x7f6488069fd0 msgr2=0x7f648806a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 -- 172.21.15.52:0/4063360484 shutdown_connections 2023-10-01T01:33:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 -- 172.21.15.52:0/4063360484 wait complete. 2023-10-01T01:33:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 Processor -- start 2023-10-01T01:33:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.439+0000 7f648eef1640 1 -- start start 2023-10-01T01:33:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648eef1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6488070580 0x7f64881607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648eef1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 0x7f64880b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648eef1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64880caf40 0x7f6488070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648eef1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64881610f0 con 0x7f64880caf40 2023-10-01T01:33:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648eef1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6488152a80 con 0x7f64880c1980 2023-10-01T01:33:43.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648eef1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6488153a80 con 0x7f6488070580 2023-10-01T01:33:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 0x7f64880b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648e6f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64880caf40 0x7f6488070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 0x7f64880b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:59996/0 (socket says 172.21.15.52:59996) 2023-10-01T01:33:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 -- 172.21.15.52:0/849818582 learned_addr learned my addr 172.21.15.52:0/849818582 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 -- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6488070580 msgr2=0x7f64881607f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-01T01:33:43.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648deef640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6488070580 0x7f64881607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6488070580 0x7f64881607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 -- 172.21.15.52:0/849818582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64880caf40 msgr2=0x7f6488070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64880caf40 0x7f6488070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 -- 172.21.15.52:0/849818582 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009420 con 0x7f64880c1980 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648e6f0640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64880caf40 0x7f6488070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648deef640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6488070580 0x7f64881607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.443+0000 7f648d6ee640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 0x7f64880b3a70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6478019ef0 tx=0x7f6478019060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.451+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780aa970 con 0x7f64880c1980 2023-10-01T01:33:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.459+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488160e10 con 0x7f64880c1980 2023-10-01T01:33:43.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.459+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64881526a0 con 0x7f64880c1980 2023-10-01T01:33:43.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.459+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64780aaad0 con 0x7f64880c1980 2023-10-01T01:33:43.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.459+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780aae80 con 0x7f64880c1980 2023-10-01T01:33:43.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.459+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f64780b2040 con 0x7f64880c1980 2023-10-01T01:33:43.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.463+0000 7f647e7fc640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f646c066260 0x7f646c068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.463+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f647811d870 con 0x7f64880c1980 2023-10-01T01:33:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.463+0000 7f648deef640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f646c066260 0x7f646c068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:43.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.463+0000 7f648deef640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f646c066260 0x7f646c068720 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6484006fd0 tx=0x7f6484008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:43.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.471+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470005260 con 0x7f64880c1980 2023-10-01T01:33:43.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:43.499+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f64780eb200 con 0x7f64880c1980 2023-10-01T01:33:44.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.091+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6470000bd0 con 0x7f646c066260 2023-10-01T01:33:44.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.123+0000 7f647e7fc640 1 -- 172.21.15.52:0/849818582 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49562 (secure 0 0 0) 0x7f6470000bd0 con 0x7f646c066260 2023-10-01T01:33:44.294 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:44.296 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-10-01T01:33:44.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.151+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f646c066260 msgr2=0x7f646c068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.151+0000 7f648eef1640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f646c066260 0x7f646c068720 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6484006fd0 tx=0x7f6484008040 comp rx=0 tx=0).stop 2023-10-01T01:33:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.151+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 msgr2=0x7f64880b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.151+0000 7f648eef1640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 0x7f64880b3a70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6478019ef0 tx=0x7f6478019060 comp rx=0 tx=0).stop 2023-10-01T01:33:44.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 shutdown_connections 2023-10-01T01:33:44.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f646c066260 0x7f646c068720 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64880caf40 0x7f6488070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64880c1980 0x7f64880b3a70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 --2- 172.21.15.52:0/849818582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6488070580 0x7f64881607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 >> 172.21.15.52:0/849818582 conn(0x7f6488069fd0 msgr2=0x7f648815a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:44.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 shutdown_connections 2023-10-01T01:33:44.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.159+0000 7f648eef1640 1 -- 172.21.15.52:0/849818582 wait complete. 2023-10-01T01:33:44.344 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":15768,"stamp":"2023-10-01T01:33:42.861298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":46662528,"kb_used_data":33869228,"kb_used_omap":3673,"kb_used_meta":12442342,"kb_avail":708312192,"statfs":{"total":773094113280,"available":725311684608,"internally_reserved":0,"allocated":34682089472,"data_stored":34609365749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3761525,"internal_metadata":12740958859},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":343,"apply_latency_ms":343,"commit_latency_ns":343000000,"apply_latency_ns":343000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39732900580,"num_objects":-33707,"num_object_clones":0,"num_object_copies":-67414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33707,"num_whiteouts":0,"num_read":-1506866,"num_read_kb":-108893545,"num_write":-7506264,"num_write_kb":-161598023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2461,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.627327"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-01T01:33:35.066328+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-10-01T01:33:35.066328+0000","last_peered":"2023-10-01T01:33:35.066328+0000","last_clean":"2023-10-01T01:33:35.066328+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-10-01T01:33:35.066328+0000","last_undegraded":"2023-10-01T01:33:35.066328+0000","last_fullsized":"2023-10-01T01:33:35.066328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129548442,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4951136,"kb_used_data":3232460,"kb_used_omap":564,"kb_used_meta":1667595,"kb_avail":89420704,"statfs":{"total":96636764160,"available":91566800896,"internally_reserved":0,"allocated":3310039040,"data_stored":3303020623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":577944,"internal_metadata":1707617896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68100000000000005,"15min":0.78700000000000003},"min":{"1min":0.253,"5min":0.248,"15min":0.23100000000000001},"max":{"1min":0.85599999999999998,"5min":5.3360000000000003,"15min":6.6909999999999998},"last":0.745},{"interface":"front","average":{"1min":1.105,"5min":0.88700000000000001,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.255},"max":{"1min":5.9580000000000002,"5min":5.9580000000000002,"15min":6.109},"last":0.498}]},{"osd":1,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.99399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.9039999999999999,"5min":5.2910000000000004,"15min":6.726},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94799999999999995,"15min":1.0740000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":4.8029999999999999,"5min":5.2850000000000001,"15min":9.8680000000000003},"last":1.016}]},{"osd":2,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.2769999999999999,"15min":1.236},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.6399999999999997,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.1950000000000001,"15min":1.272},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":1.589,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.0569999999999999,"15min":1.29},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6840000000000002,"5min":5.8140000000000001,"15min":10.702},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.90500000000000003,"15min":1.1339999999999999},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95099999999999996,"5min":8.1370000000000005,"15min":8.1370000000000005},"last":1.0840000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.68300000000000005,"15min":0.89800000000000002},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.24099999999999999},"max":{"1min":0.95099999999999996,"5min":5.2140000000000004,"15min":6.9770000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.82799999999999996,"15min":1.028},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26400000000000001},"max":{"1min":2.2789999999999999,"5min":5.3579999999999997,"15min":7.9710000000000001},"last":1.0549999999999999}]},{"osd":5,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.90200000000000002,"15min":1.0349999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.26800000000000002},"max":{"1min":1.51,"5min":10.757999999999999,"15min":10.757999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.85699999999999998,"15min":0.95999999999999996},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":0.98599999999999999,"5min":5.7300000000000004,"15min":6.8040000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":5.2590000000000003,"5min":5.9219999999999997,"15min":8.8000000000000007},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":1.071},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":8.8819999999999997},"last":1.151}]}]},{"osd":6,"up_from":14,"seq":60129548444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6356492,"kb_used_data":4659172,"kb_used_omap":29,"kb_used_meta":1611874,"kb_avail":88015348,"statfs":{"total":96636764160,"available":90127716352,"internally_reserved":0,"allocated":4770992128,"data_stored":4760848691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30210,"internal_metadata":1650559486},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.014,"15min":0.88500000000000001},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":15.537000000000001,"5min":15.537000000000001,"15min":15.537000000000001},"last":0.622},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.0900000000000001,"15min":0.96599999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":8.8770000000000007,"5min":8.8770000000000007,"15min":8.8770000000000007},"last":0.94199999999999995}]},{"osd":1,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":1.159,"15min":1.0980000000000001},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":15.608000000000001,"5min":15.608000000000001,"15min":15.608000000000001},"last":1.27},{"interface":"front","average":{"1min":1.286,"5min":1.107,"15min":1.1699999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.28799999999999998},"max":{"1min":8.9429999999999996,"5min":8.9429999999999996,"15min":8.9429999999999996},"last":1.629}]},{"osd":2,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2130000000000001,"15min":1.234},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":5.0049999999999999,"5min":6.1950000000000003,"15min":11.847},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.901,"5min":1.3999999999999999,"15min":1.2529999999999999},"min":{"1min":0.32300000000000001,"5min":0.313,"15min":0.26800000000000002},"max":{"1min":15.951000000000001,"5min":15.951000000000001,"15min":15.951000000000001},"last":1.151}]},{"osd":3,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":1.3759999999999999,"15min":1.3640000000000001},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":16.318000000000001,"5min":16.318000000000001,"15min":16.318000000000001},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0469999999999999,"15min":1.1379999999999999},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":4.4139999999999997,"5min":6.2750000000000004,"15min":7.5469999999999997},"last":1.228}]},{"osd":4,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.119,"15min":0.94999999999999996},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.253},"max":{"1min":16.077999999999999,"5min":16.077999999999999,"15min":16.077999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.0169999999999999,"15min":0.998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":1.9470000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.87,"15min":0.997},"min":{"1min":0.33700000000000002,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":4.4909999999999997,"5min":6.1390000000000002,"15min":8.6799999999999997},"last":1.4450000000000001},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.2270000000000001,"15min":1.0129999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":15.640000000000001,"5min":15.640000000000001,"15min":15.640000000000001},"last":1.571}]},{"osd":7,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.117,"15min":1.103},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.129000000000001,"5min":16.129000000000001,"15min":16.129000000000001},"last":2.266},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0900000000000001,"15min":1.034},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":4.4509999999999996,"5min":6.2370000000000001,"15min":7.516},"last":1.8129999999999999}]}]},{"osd":5,"up_from":14,"seq":60129548443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4921500,"kb_used_data":3137040,"kb_used_omap":864,"kb_used_meta":1761951,"kb_avail":89450340,"statfs":{"total":96636764160,"available":91597148160,"internally_reserved":0,"allocated":3212328960,"data_stored":3205211353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":884917,"internal_metadata":1804238667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6339999999999999,"5min":5.6829999999999998,"15min":10.228999999999999},"last":2.5459999999999998},{"interface":"front","average":{"1min":1.2789999999999999,"5min":0.77800000000000002,"15min":1.073},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":12.055},"last":8.4199999999999999}]},{"osd":1,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.754,"15min":1.1559999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":2.7829999999999999,"5min":4.6180000000000003,"15min":10.068},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.94999999999999996,"15min":0.88800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.3609999999999998,"5min":5.3609999999999998,"15min":9.4689999999999994},"last":1.258}]},{"osd":2,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.98899999999999999,"15min":1.0920000000000001},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.7669999999999999,"5min":7.5780000000000003,"15min":12.086},"last":1.504},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.97099999999999997,"15min":1.2949999999999999},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.8340000000000001,"5min":11.26,"15min":11.26},"last":1.5329999999999999}]},{"osd":3,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.4910000000000001,"5min":1.482,"15min":1.399},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":50.969000000000001,"5min":50.969000000000001,"15min":50.969000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.093,"5min":1.7789999999999999,"15min":1.5840000000000001},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":50.537999999999997,"5min":50.537999999999997,"15min":50.537999999999997},"last":1.5640000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.84899999999999998,"15min":0.71199999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8799999999999999,"5min":5.7119999999999997,"15min":5.7149999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65600000000000003,"15min":0.98799999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":2.9089999999999998,"5min":4.4489999999999998,"15min":12.852},"last":1.806}]},{"osd":6,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.91300000000000003,"15min":1.1160000000000001},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.26700000000000002},"max":{"1min":2.2210000000000001,"5min":15.307,"15min":15.307},"last":1.738},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9710000000000001,"5min":5.1429999999999998,"15min":10.548999999999999},"last":1.419}]},{"osd":7,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":1.101},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":3.5129999999999999,"5min":6.149,"15min":12.805999999999999},"last":1.841},{"interface":"front","average":{"1min":2.0899999999999999,"5min":1.181,"15min":1.226},"min":{"1min":0.439,"5min":0.312,"15min":0.312},"max":{"1min":26.960000000000001,"5min":26.960000000000001,"15min":26.960000000000001},"last":1.7050000000000001}]}]},{"osd":4,"up_from":14,"seq":60129548442,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5766140,"kb_used_data":4096812,"kb_used_omap":488,"kb_used_meta":1517975,"kb_avail":88605700,"statfs":{"total":96636764160,"available":90732236800,"internally_reserved":0,"allocated":4195135488,"data_stored":4186155290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":499847,"internal_metadata":1554407289},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.77500000000000002,"15min":0.86299999999999999},"min":{"1min":0.24399999999999999,"5min":0.221,"15min":0.20499999999999999},"max":{"1min":4.2590000000000003,"5min":8.5519999999999996,"15min":10.225},"last":12.33},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.133,"15min":1.008},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.245},"max":{"1min":2.9670000000000001,"5min":8.5649999999999995,"15min":10.241},"last":12.369}]},{"osd":1,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.82899999999999996,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.3490000000000002,"5min":4.7050000000000001,"15min":7.0179999999999998},"last":0.497},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.206,"15min":1.044},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.847,"5min":5.5259999999999998,"15min":8.266},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.121,"15min":1.1799999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.577,"5min":5.8330000000000002,"15min":23.491},"last":0.621},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.133,"15min":1.202},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3170000000000002,"5min":7.2759999999999998,"15min":23.311},"last":0.72799999999999998}]},{"osd":3,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":3.3780000000000001,"5min":1.748,"15min":1.29},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":32.417000000000002,"5min":32.417000000000002,"15min":32.417000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6930000000000001,"15min":1.3460000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.75,"5min":34.75,"15min":34.75},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":0.89400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":3.032,"5min":5.4059999999999997,"15min":6.1600000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.1339999999999999,"15min":0.99199999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":0.746}]},{"osd":6,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89800000000000002,"15min":0.93899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":4.375,"5min":4.7789999999999999,"15min":6.1470000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":1.2749999999999999,"15min":1.0700000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.0579999999999998,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":12.425000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.222,"15min":1.071},"min":{"1min":0.34599999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.109,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.96899999999999997},"min":{"1min":0.42099999999999999,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":4.4210000000000003,"5min":4.7610000000000001,"15min":6.1840000000000002},"last":0.67900000000000005}]}]},{"osd":3,"up_from":14,"seq":60129548425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5720208,"kb_used_data":4117768,"kb_used_omap":438,"kb_used_meta":1601993,"kb_avail":88651632,"statfs":{"total":96636764160,"available":90779271168,"internally_reserved":0,"allocated":4216594432,"data_stored":4207516396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":448887,"internal_metadata":1640441481},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":5.032,"5min":5.032,"15min":9.8320000000000007},"last":1.718},{"interface":"front","average":{"1min":1.728,"5min":1.3759999999999999,"15min":1.155},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":6.6559999999999997,"5min":11.756,"15min":11.756},"last":6.6559999999999997}]},{"osd":1,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":1.8220000000000001,"15min":1.2150000000000001},"min":{"1min":0.28000000000000003,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":22.338000000000001,"5min":22.338000000000001,"15min":22.338000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.127,"15min":0.92000000000000004},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.24199999999999999},"max":{"1min":15.903,"5min":15.903,"15min":15.903},"last":1.8420000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.7250000000000001,"5min":1.891,"15min":1.3440000000000001},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.859,"5min":1.25,"15min":1.044},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":12.17,"5min":12.17,"15min":12.17},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":1.5009999999999999,"15min":1.2110000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":10.407,"5min":12.07,"15min":12.07},"last":6.702},{"interface":"front","average":{"1min":2.9710000000000001,"5min":1.7490000000000001,"15min":1.3129999999999999},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":22.370000000000001,"5min":22.370000000000001,"15min":22.370000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0730000000000004,"5min":1.9359999999999999,"15min":1.417},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":22.25,"5min":22.25,"15min":22.25},"last":0.53200000000000003},{"interface":"front","average":{"1min":3.552,"5min":1.6040000000000001,"15min":1.1639999999999999},"min":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"max":{"1min":22.183,"5min":22.183,"15min":22.183},"last":0.39400000000000002}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":1.1679999999999999,"15min":1.165},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":17.276,"5min":17.276,"15min":17.276},"last":0.42199999999999999},{"interface":"front","average":{"1min":5.306,"5min":2.5070000000000001,"15min":1.764},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":42.237000000000002,"5min":42.237000000000002,"15min":42.237000000000002},"last":6.734}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":2.1850000000000001,"15min":1.667},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.38900000000000001},"max":{"1min":12.103,"5min":12.103,"15min":12.103},"last":6.7629999999999999},{"interface":"front","average":{"1min":3.6669999999999998,"5min":2.0230000000000001,"15min":1.6020000000000001},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":22.300000000000001,"5min":22.300000000000001,"15min":22.300000000000001},"last":0.57499999999999996}]}]},{"osd":2,"up_from":14,"seq":60129548428,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6672708,"kb_used_data":5091308,"kb_used_omap":399,"kb_used_meta":1542192,"kb_avail":87699132,"statfs":{"total":96636764160,"available":89803911168,"internally_reserved":0,"allocated":5213499392,"data_stored":5203222276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":408784,"internal_metadata":1579205424},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.65000000000000002,"15min":0.84499999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":5.9470000000000001,"5min":6.1310000000000002,"15min":9.6829999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":3.206,"5min":1.5009999999999999,"15min":1.153},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":23.140999999999998,"5min":23.140999999999998,"15min":23.140999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":0.82899999999999996,"15min":0.88700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":5.891,"5min":8.0410000000000004,"15min":9.4350000000000005},"last":11.042999999999999},{"interface":"front","average":{"1min":3.5219999999999998,"5min":1.605,"15min":1.234},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":23.184000000000001,"5min":23.184000000000001,"15min":23.184000000000001},"last":11}]},{"osd":3,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":7.1260000000000003,"5min":2.3109999999999999,"15min":1.4710000000000001},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":55.256,"5min":55.256,"15min":55.256},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.8109999999999999,"5min":1.3120000000000001,"15min":1.1619999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":13.315,"5min":15.095000000000001,"15min":15.095000000000001},"last":0.746}]},{"osd":4,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":0.95399999999999996,"15min":1.014},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":6.7039999999999997,"5min":6.7039999999999997,"15min":9.4789999999999992},"last":0.84699999999999998},{"interface":"front","average":{"1min":4.6459999999999999,"5min":1.7549999999999999,"15min":1.401},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":54.752000000000002,"5min":54.752000000000002,"15min":54.752000000000002},"last":0.83099999999999996}]},{"osd":5,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1800000000000002,"5min":1.7290000000000001,"15min":1.3440000000000001},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"max":{"1min":23.219000000000001,"5min":23.219000000000001,"15min":23.219000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":5.6079999999999997,"5min":2.1269999999999998,"15min":1.5449999999999999},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":35.106999999999999,"5min":35.106999999999999,"15min":35.106999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":4.6109999999999998,"5min":1.948,"15min":1.524},"min":{"1min":0.46999999999999997,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":35.173000000000002,"5min":35.173000000000002,"15min":35.173000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.109,"15min":1.1259999999999999},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":8.1660000000000004,"5min":8.1660000000000004,"15min":9.5090000000000003},"last":1.127}]},{"osd":7,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":1.7769999999999999,"15min":1.4730000000000001},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":23.312999999999999,"5min":23.312999999999999,"15min":23.312999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":4.4859999999999998,"5min":2.0089999999999999,"15min":1.5669999999999999},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":35.240000000000002,"5min":35.240000000000002,"15min":35.240000000000002},"last":0.77200000000000002}]}]},{"osd":0,"up_from":14,"seq":60129548432,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6251524,"kb_used_data":5171892,"kb_used_omap":349,"kb_used_meta":1079266,"kb_avail":88120316,"statfs":{"total":96636764160,"available":90235203584,"internally_reserved":0,"allocated":5296017408,"data_stored":5285201682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":358162,"internal_metadata":1105168622},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.8210000000000002,"5min":7.6159999999999997,"15min":19.224},"last":0.23200000000000001},{"interface":"front","average":{"1min":1.105,"5min":0.93400000000000005,"15min":1.01},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":8.2219999999999995,"5min":10.795,"15min":19.341000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":14.928000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.492,"5min":0.86199999999999999,"15min":1.042},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":15.393000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":11.157,"5min":11.157,"15min":11.157},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.94199999999999995,"15min":0.98599999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.6389999999999993,"5min":8.6389999999999993,"15min":8.6389999999999993},"last":0.47699999999999998}]},{"osd":4,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.311},"max":{"1min":8.6760000000000002,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":1.893,"5min":1.147,"15min":1.0469999999999999},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32400000000000001},"max":{"1min":8.5429999999999993,"5min":9.8000000000000007,"15min":9.8000000000000007},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.115,"15min":1.194},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":8.3689999999999998,"5min":12.773999999999999,"15min":12.773999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.21,"5min":1.038,"15min":1.1950000000000001},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":8.7690000000000001,"5min":8.7690000000000001,"15min":8.7690000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.151,"15min":1.0880000000000001},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":8.4969999999999999,"5min":8.4969999999999999,"15min":8.4969999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.52,"5min":1.1459999999999999,"15min":1.2330000000000001},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":8.3399999999999999,"5min":12.821999999999999,"15min":12.821999999999999},"last":0.497}]},{"osd":7,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.3420000000000001,"15min":1.288},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.2870000000000008,"5min":12.859,"15min":12.859},"last":2.5619999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.3819999999999999,"15min":1.369},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":8.7040000000000006,"5min":8.7040000000000006,"15min":8.7040000000000006},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834581136,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6022820,"kb_used_data":4362776,"kb_used_omap":539,"kb_used_meta":1659492,"kb_avail":88349020,"statfs":{"total":96636764160,"available":90469396480,"internally_reserved":0,"allocated":4467482624,"data_stored":4458189438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":552774,"internal_metadata":1699319994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.748,"15min":0.85299999999999998},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20100000000000001},"max":{"1min":2.48,"5min":5.7999999999999998,"15min":7.9189999999999996},"last":1.0389999999999999},{"interface":"front","average":{"1min":3.0489999999999999,"5min":1.3120000000000001,"15min":0.98299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":38.442,"5min":38.442,"15min":38.442},"last":1.1080000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":1.3859999999999999,"15min":1.2629999999999999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":22.739999999999998,"5min":22.739999999999998,"15min":22.739999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.80700000000000005,"15min":0.89100000000000001},"min":{"1min":0.31900000000000001,"5min":0.22700000000000001,"15min":0.22},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":7.9889999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0449999999999999,"15min":1.077},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.1840000000000002,"5min":6.1840000000000002,"15min":8.9390000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.1160000000000001,"15min":1.0589999999999999},"min":{"1min":0.28499999999999998,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":5.1180000000000003,"5min":8.8919999999999995,"15min":8.8919999999999995},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":1.383,"15min":1.2929999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29699999999999999},"max":{"1min":22.84,"5min":22.84,"15min":22.84},"last":0.50800000000000001},{"interface":"front","average":{"1min":2.4529999999999998,"5min":1.3280000000000001,"15min":1.2330000000000001},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":25.719000000000001,"5min":25.719000000000001,"15min":25.719000000000001},"last":2.294}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":1.1579999999999999,"15min":1.01},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.9060000000000006,"5min":8.9060000000000006,"15min":8.9060000000000006},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.514,"5min":1.196,"15min":1.3220000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32900000000000001},"max":{"1min":10.329000000000001,"5min":10.329000000000001,"15min":10.329000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.3500000000000001,"15min":1.1830000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.5940000000000003,"5min":6.1379999999999999,"15min":6.1379999999999999},"last":2.3969999999999998},{"interface":"front","average":{"1min":1.446,"5min":1.1859999999999999,"15min":1.3},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.375},"max":{"1min":10.364000000000001,"5min":10.364000000000001,"15min":10.364000000000001},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.1559999999999999,"15min":1.137},"min":{"1min":0.49099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.1219999999999999,"5min":6.1219999999999999,"15min":8.0549999999999997},"last":0.877},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4830000000000001,"15min":1.26},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.6230000000000002,"5min":6.149,"15min":6.1689999999999996},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T01:33:44.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T01:33:44.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d2bda640 1 Processor -- start 2023-10-01T01:33:44.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d2bda640 1 -- start start 2023-10-01T01:33:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d2bda640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc15d110 0x7f47cc0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d2bda640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc06c1c0 con 0x7f47cc0b05e0 2023-10-01T01:33:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d2bda640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc06c4a0 con 0x7f47cc158b30 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d2bda640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b0a50 con 0x7f47cc15d110 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d0976640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f47cc158b30 0x7f47cc06d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:58876/0 (socket says 172.21.15.52:58876) 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.783+0000 7f47d0976640 1 -- 172.21.15.52:0/3770410568 learned_addr learned my addr 172.21.15.52:0/3770410568 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543874847 0 0) 0x7f47cc06c4a0 con 0x7f47cc158b30 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ac003530 con 0x7f47cc158b30 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657447819 0 0) 0x7f47cc06c1c0 con 0x7f47cc0b05e0 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47cc06c4a0 con 0x7f47cc0b05e0 2023-10-01T01:33:44.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 142337443 0 0) 0x7f47ac003530 con 0x7f47cc158b30 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc15d110 msgr2=0x7f47cc0b00a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc15d110 0x7f47cc0b00a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 >> v1:172.21.15.52:6789/0 conn(0x7f47cc0b05e0 legacy=0x7f47cc0c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc06c780 con 0x7f47cc158b30 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f47bc001680 con 0x7f47cc158b30 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 >> v1:172.21.15.186:6789/0 conn(0x7f47cc158b30 legacy=0x7f47cc06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47ac004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47ac003770 0x7f47ac003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47ac004330 0x7f47ac0059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c4001470 con 0x7f47ac003770 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b0a50 con 0x7f47ac004c10 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0062f0 con 0x7f47ac004330 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47d0976640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47ac004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.787+0000 7f47d1177640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47ac004330 0x7f47ac0059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47d0976640 1 -- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47ac004330 msgr2=0x7f47ac0059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:44.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47d0976640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47ac004330 0x7f47ac0059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47d0976640 1 -- 172.21.15.52:0/3770410568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47ac003770 msgr2=0x7f47ac003bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47cbfff640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47ac003770 0x7f47ac003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47d0976640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47ac003770 0x7f47ac003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47d0976640 1 -- 172.21.15.52:0/3770410568 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac003530 con 0x7f47ac004c10 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47cbfff640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47ac003770 0x7f47ac003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47d0976640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47ac004ff0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f47bc007fa0 tx=0x7f47bc01cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3639928b22cb3fe server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc005ae0 con 0x7f47ac004c10 2023-10-01T01:33:44.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc005c40 con 0x7f47ac004c10 2023-10-01T01:33:44.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.791+0000 7f47cb7fe640 1 -- 172.21.15.52:0/3770410568 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a57a0 con 0x7f47ac004c10 2023-10-01T01:33:44.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.795+0000 7f47d2bda640 1 -- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 msgr2=0x7f47ac004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.795+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3770410568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47ac004ff0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f47bc007fa0 tx=0x7f47bc01cb20 comp rx=0 tx=0).stop 2023-10-01T01:33:44.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.795+0000 7f47d1177640 1 -- 172.21.15.52:0/3770410568 reap_dead start 2023-10-01T01:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.799+0000 7f47d2bda640 1 -- 172.21.15.52:0/3770410568 shutdown_connections 2023-10-01T01:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.799+0000 7f47d2bda640 1 -- 172.21.15.52:0/3770410568 >> 172.21.15.52:0/3770410568 conn(0x7f47cc06a200 msgr2=0x7f47cc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:44.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 -- 172.21.15.52:0/3770410568 shutdown_connections 2023-10-01T01:33:44.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 -- 172.21.15.52:0/3770410568 wait complete. 2023-10-01T01:33:44.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 Processor -- start 2023-10-01T01:33:44.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 -- start start 2023-10-01T01:33:44.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47cc1eee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47cc1f18a0 0x7f47cc0af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc0c3920 0x7f47cc15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0c31b0 con 0x7f47cc1f18a0 2023-10-01T01:33:44.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1f20f0 con 0x7f47ac004c10 2023-10-01T01:33:44.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d2bda640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc1f23d0 con 0x7f47cc0c3920 2023-10-01T01:33:44.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47cbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47cc1f18a0 0x7f47cc0af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47cbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47cc1f18a0 0x7f47cc0af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56276/0 (socket says 172.21.15.52:56276) 2023-10-01T01:33:44.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47cbfff640 1 -- 172.21.15.52:0/3237473986 learned_addr learned my addr 172.21.15.52:0/3237473986 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:44.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.823+0000 7f47d0976640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47cc1eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d1177640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc0c3920 0x7f47cc15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d0976640 1 -- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc0c3920 msgr2=0x7f47cc15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d0976640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc0c3920 0x7f47cc15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d0976640 1 -- 172.21.15.52:0/3237473986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47cc1f18a0 msgr2=0x7f47cc0af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d0976640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47cc1f18a0 0x7f47cc0af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d0976640 1 -- 172.21.15.52:0/3237473986 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0c3420 con 0x7f47ac004c10 2023-10-01T01:33:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.827+0000 7f47d0976640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47cc1eee40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009000 tx=0x7f47ac005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:44.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0b4070 con 0x7f47ac004c10 2023-10-01T01:33:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc0a57a0 con 0x7f47ac004c10 2023-10-01T01:33:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a5b10 con 0x7f47ac004c10 2023-10-01T01:33:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc1f26b0 con 0x7f47ac004c10 2023-10-01T01:33:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc0af840 con 0x7f47ac004c10 2023-10-01T01:33:44.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f47bc0a5c70 con 0x7f47ac004c10 2023-10-01T01:33:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47c97fa640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47b0066230 0x7f47b00686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f47bc11d180 con 0x7f47ac004c10 2023-10-01T01:33:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.851+0000 7f47cbfff640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47b0066230 0x7f47b00686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.855+0000 7f47cbfff640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47b0066230 0x7f47b00686f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f47cc06c0c0 tx=0x7f47b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.855+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0c35b0 con 0x7f47ac004c10 2023-10-01T01:33:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:44.867+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f47bc0eab30 con 0x7f47ac004c10 2023-10-01T01:33:45.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.243+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47cc06cd40 con 0x7f47b0066230 2023-10-01T01:33:45.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.247+0000 7f47c97fa640 1 -- 172.21.15.52:0/3237473986 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49562 (secure 0 0 0) 0x7f47b400c040 con 0x7f47b0066230 2023-10-01T01:33:45.257 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:45.258 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-10-01T01:33:45.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47b0066230 msgr2=0x7f47b00686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:45.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47b0066230 0x7f47b00686f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f47cc06c0c0 tx=0x7f47b4008040 comp rx=0 tx=0).stop 2023-10-01T01:33:45.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 msgr2=0x7f47cc1eee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47cc1eee40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009000 tx=0x7f47ac005800 comp rx=0 tx=0).stop 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 shutdown_connections 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47b0066230 0x7f47b00686f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47cc0c3920 0x7f47cc15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47cc1f18a0 0x7f47cc0af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 --2- 172.21.15.52:0/3237473986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47ac004c10 0x7f47cc1eee40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 >> 172.21.15.52:0/3237473986 conn(0x7f47cc06a200 msgr2=0x7f47cc156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 shutdown_connections 2023-10-01T01:33:45.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.267+0000 7f47d2bda640 1 -- 172.21.15.52:0/3237473986 wait complete. 2023-10-01T01:33:45.295 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":15769,"stamp":"2023-10-01T01:33:44.862101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":46662528,"kb_used_data":33869228,"kb_used_omap":3673,"kb_used_meta":12442342,"kb_avail":708312192,"statfs":{"total":773094113280,"available":725311684608,"internally_reserved":0,"allocated":34682089472,"data_stored":34609365749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3761525,"internal_metadata":12740958859},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":343,"apply_latency_ms":343,"commit_latency_ns":343000000,"apply_latency_ns":343000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39732900580,"num_objects":-33707,"num_object_clones":0,"num_object_copies":-67414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33707,"num_whiteouts":0,"num_read":-1506866,"num_read_kb":-108893545,"num_write":-7506264,"num_write_kb":-161598023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2461,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001991"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-01T01:33:35.066328+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-10-01T01:33:35.066328+0000","last_peered":"2023-10-01T01:33:35.066328+0000","last_clean":"2023-10-01T01:33:35.066328+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-10-01T01:33:35.066328+0000","last_undegraded":"2023-10-01T01:33:35.066328+0000","last_fullsized":"2023-10-01T01:33:35.066328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129548442,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4951136,"kb_used_data":3232460,"kb_used_omap":564,"kb_used_meta":1667595,"kb_avail":89420704,"statfs":{"total":96636764160,"available":91566800896,"internally_reserved":0,"allocated":3310039040,"data_stored":3303020623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":577944,"internal_metadata":1707617896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68100000000000005,"15min":0.78700000000000003},"min":{"1min":0.253,"5min":0.248,"15min":0.23100000000000001},"max":{"1min":0.85599999999999998,"5min":5.3360000000000003,"15min":6.6909999999999998},"last":0.745},{"interface":"front","average":{"1min":1.105,"5min":0.88700000000000001,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.255},"max":{"1min":5.9580000000000002,"5min":5.9580000000000002,"15min":6.109},"last":0.498}]},{"osd":1,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.99399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.9039999999999999,"5min":5.2910000000000004,"15min":6.726},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94799999999999995,"15min":1.0740000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":4.8029999999999999,"5min":5.2850000000000001,"15min":9.8680000000000003},"last":1.016}]},{"osd":2,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.2769999999999999,"15min":1.236},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.6399999999999997,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.1950000000000001,"15min":1.272},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":1.589,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.0569999999999999,"15min":1.29},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6840000000000002,"5min":5.8140000000000001,"15min":10.702},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.90500000000000003,"15min":1.1339999999999999},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95099999999999996,"5min":8.1370000000000005,"15min":8.1370000000000005},"last":1.0840000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.68300000000000005,"15min":0.89800000000000002},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.24099999999999999},"max":{"1min":0.95099999999999996,"5min":5.2140000000000004,"15min":6.9770000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.82799999999999996,"15min":1.028},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26400000000000001},"max":{"1min":2.2789999999999999,"5min":5.3579999999999997,"15min":7.9710000000000001},"last":1.0549999999999999}]},{"osd":5,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.90200000000000002,"15min":1.0349999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.26800000000000002},"max":{"1min":1.51,"5min":10.757999999999999,"15min":10.757999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.85699999999999998,"15min":0.95999999999999996},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":0.98599999999999999,"5min":5.7300000000000004,"15min":6.8040000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":5.2590000000000003,"5min":5.9219999999999997,"15min":8.8000000000000007},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":1.071},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":8.8819999999999997},"last":1.151}]}]},{"osd":6,"up_from":14,"seq":60129548444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6356492,"kb_used_data":4659172,"kb_used_omap":29,"kb_used_meta":1611874,"kb_avail":88015348,"statfs":{"total":96636764160,"available":90127716352,"internally_reserved":0,"allocated":4770992128,"data_stored":4760848691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30210,"internal_metadata":1650559486},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.014,"15min":0.88500000000000001},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":15.537000000000001,"5min":15.537000000000001,"15min":15.537000000000001},"last":0.622},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.0900000000000001,"15min":0.96599999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":8.8770000000000007,"5min":8.8770000000000007,"15min":8.8770000000000007},"last":0.94199999999999995}]},{"osd":1,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":1.159,"15min":1.0980000000000001},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":15.608000000000001,"5min":15.608000000000001,"15min":15.608000000000001},"last":1.27},{"interface":"front","average":{"1min":1.286,"5min":1.107,"15min":1.1699999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.28799999999999998},"max":{"1min":8.9429999999999996,"5min":8.9429999999999996,"15min":8.9429999999999996},"last":1.629}]},{"osd":2,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2130000000000001,"15min":1.234},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":5.0049999999999999,"5min":6.1950000000000003,"15min":11.847},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.901,"5min":1.3999999999999999,"15min":1.2529999999999999},"min":{"1min":0.32300000000000001,"5min":0.313,"15min":0.26800000000000002},"max":{"1min":15.951000000000001,"5min":15.951000000000001,"15min":15.951000000000001},"last":1.151}]},{"osd":3,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":1.3759999999999999,"15min":1.3640000000000001},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":16.318000000000001,"5min":16.318000000000001,"15min":16.318000000000001},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0469999999999999,"15min":1.1379999999999999},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":4.4139999999999997,"5min":6.2750000000000004,"15min":7.5469999999999997},"last":1.228}]},{"osd":4,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.119,"15min":0.94999999999999996},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.253},"max":{"1min":16.077999999999999,"5min":16.077999999999999,"15min":16.077999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.0169999999999999,"15min":0.998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":1.9470000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.87,"15min":0.997},"min":{"1min":0.33700000000000002,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":4.4909999999999997,"5min":6.1390000000000002,"15min":8.6799999999999997},"last":1.4450000000000001},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.2270000000000001,"15min":1.0129999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":15.640000000000001,"5min":15.640000000000001,"15min":15.640000000000001},"last":1.571}]},{"osd":7,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.117,"15min":1.103},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.129000000000001,"5min":16.129000000000001,"15min":16.129000000000001},"last":2.266},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0900000000000001,"15min":1.034},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":4.4509999999999996,"5min":6.2370000000000001,"15min":7.516},"last":1.8129999999999999}]}]},{"osd":5,"up_from":14,"seq":60129548443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4921500,"kb_used_data":3137040,"kb_used_omap":864,"kb_used_meta":1761951,"kb_avail":89450340,"statfs":{"total":96636764160,"available":91597148160,"internally_reserved":0,"allocated":3212328960,"data_stored":3205211353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":884917,"internal_metadata":1804238667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6339999999999999,"5min":5.6829999999999998,"15min":10.228999999999999},"last":2.5459999999999998},{"interface":"front","average":{"1min":1.2789999999999999,"5min":0.77800000000000002,"15min":1.073},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":12.055},"last":8.4199999999999999}]},{"osd":1,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.754,"15min":1.1559999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":2.7829999999999999,"5min":4.6180000000000003,"15min":10.068},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.94999999999999996,"15min":0.88800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.3609999999999998,"5min":5.3609999999999998,"15min":9.4689999999999994},"last":1.258}]},{"osd":2,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.98899999999999999,"15min":1.0920000000000001},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.7669999999999999,"5min":7.5780000000000003,"15min":12.086},"last":1.504},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.97099999999999997,"15min":1.2949999999999999},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.8340000000000001,"5min":11.26,"15min":11.26},"last":1.5329999999999999}]},{"osd":3,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.4910000000000001,"5min":1.482,"15min":1.399},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":50.969000000000001,"5min":50.969000000000001,"15min":50.969000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.093,"5min":1.7789999999999999,"15min":1.5840000000000001},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":50.537999999999997,"5min":50.537999999999997,"15min":50.537999999999997},"last":1.5640000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.84899999999999998,"15min":0.71199999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8799999999999999,"5min":5.7119999999999997,"15min":5.7149999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65600000000000003,"15min":0.98799999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":2.9089999999999998,"5min":4.4489999999999998,"15min":12.852},"last":1.806}]},{"osd":6,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.91300000000000003,"15min":1.1160000000000001},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.26700000000000002},"max":{"1min":2.2210000000000001,"5min":15.307,"15min":15.307},"last":1.738},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9710000000000001,"5min":5.1429999999999998,"15min":10.548999999999999},"last":1.419}]},{"osd":7,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":1.101},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":3.5129999999999999,"5min":6.149,"15min":12.805999999999999},"last":1.841},{"interface":"front","average":{"1min":2.0899999999999999,"5min":1.181,"15min":1.226},"min":{"1min":0.439,"5min":0.312,"15min":0.312},"max":{"1min":26.960000000000001,"5min":26.960000000000001,"15min":26.960000000000001},"last":1.7050000000000001}]}]},{"osd":4,"up_from":14,"seq":60129548442,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5766140,"kb_used_data":4096812,"kb_used_omap":488,"kb_used_meta":1517975,"kb_avail":88605700,"statfs":{"total":96636764160,"available":90732236800,"internally_reserved":0,"allocated":4195135488,"data_stored":4186155290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":499847,"internal_metadata":1554407289},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.77500000000000002,"15min":0.86299999999999999},"min":{"1min":0.24399999999999999,"5min":0.221,"15min":0.20499999999999999},"max":{"1min":4.2590000000000003,"5min":8.5519999999999996,"15min":10.225},"last":12.33},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.133,"15min":1.008},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.245},"max":{"1min":2.9670000000000001,"5min":8.5649999999999995,"15min":10.241},"last":12.369}]},{"osd":1,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.82899999999999996,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.3490000000000002,"5min":4.7050000000000001,"15min":7.0179999999999998},"last":0.497},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.206,"15min":1.044},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.847,"5min":5.5259999999999998,"15min":8.266},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.121,"15min":1.1799999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.577,"5min":5.8330000000000002,"15min":23.491},"last":0.621},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.133,"15min":1.202},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3170000000000002,"5min":7.2759999999999998,"15min":23.311},"last":0.72799999999999998}]},{"osd":3,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":3.3780000000000001,"5min":1.748,"15min":1.29},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":32.417000000000002,"5min":32.417000000000002,"15min":32.417000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6930000000000001,"15min":1.3460000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.75,"5min":34.75,"15min":34.75},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":0.89400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":3.032,"5min":5.4059999999999997,"15min":6.1600000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.1339999999999999,"15min":0.99199999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":0.746}]},{"osd":6,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89800000000000002,"15min":0.93899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":4.375,"5min":4.7789999999999999,"15min":6.1470000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":1.2749999999999999,"15min":1.0700000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.0579999999999998,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":12.425000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.222,"15min":1.071},"min":{"1min":0.34599999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.109,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.96899999999999997},"min":{"1min":0.42099999999999999,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":4.4210000000000003,"5min":4.7610000000000001,"15min":6.1840000000000002},"last":0.67900000000000005}]}]},{"osd":3,"up_from":14,"seq":60129548425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5720208,"kb_used_data":4117768,"kb_used_omap":438,"kb_used_meta":1601993,"kb_avail":88651632,"statfs":{"total":96636764160,"available":90779271168,"internally_reserved":0,"allocated":4216594432,"data_stored":4207516396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":448887,"internal_metadata":1640441481},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":5.032,"5min":5.032,"15min":9.8320000000000007},"last":1.718},{"interface":"front","average":{"1min":1.728,"5min":1.3759999999999999,"15min":1.155},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":6.6559999999999997,"5min":11.756,"15min":11.756},"last":6.6559999999999997}]},{"osd":1,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":1.8220000000000001,"15min":1.2150000000000001},"min":{"1min":0.28000000000000003,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":22.338000000000001,"5min":22.338000000000001,"15min":22.338000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.127,"15min":0.92000000000000004},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.24199999999999999},"max":{"1min":15.903,"5min":15.903,"15min":15.903},"last":1.8420000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.7250000000000001,"5min":1.891,"15min":1.3440000000000001},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.859,"5min":1.25,"15min":1.044},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":12.17,"5min":12.17,"15min":12.17},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":1.5009999999999999,"15min":1.2110000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":10.407,"5min":12.07,"15min":12.07},"last":6.702},{"interface":"front","average":{"1min":2.9710000000000001,"5min":1.7490000000000001,"15min":1.3129999999999999},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":22.370000000000001,"5min":22.370000000000001,"15min":22.370000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0730000000000004,"5min":1.9359999999999999,"15min":1.417},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":22.25,"5min":22.25,"15min":22.25},"last":0.53200000000000003},{"interface":"front","average":{"1min":3.552,"5min":1.6040000000000001,"15min":1.1639999999999999},"min":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"max":{"1min":22.183,"5min":22.183,"15min":22.183},"last":0.39400000000000002}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":1.1679999999999999,"15min":1.165},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":17.276,"5min":17.276,"15min":17.276},"last":0.42199999999999999},{"interface":"front","average":{"1min":5.306,"5min":2.5070000000000001,"15min":1.764},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":42.237000000000002,"5min":42.237000000000002,"15min":42.237000000000002},"last":6.734}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":2.1850000000000001,"15min":1.667},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.38900000000000001},"max":{"1min":12.103,"5min":12.103,"15min":12.103},"last":6.7629999999999999},{"interface":"front","average":{"1min":3.6669999999999998,"5min":2.0230000000000001,"15min":1.6020000000000001},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":22.300000000000001,"5min":22.300000000000001,"15min":22.300000000000001},"last":0.57499999999999996}]}]},{"osd":2,"up_from":14,"seq":60129548428,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6672708,"kb_used_data":5091308,"kb_used_omap":399,"kb_used_meta":1542192,"kb_avail":87699132,"statfs":{"total":96636764160,"available":89803911168,"internally_reserved":0,"allocated":5213499392,"data_stored":5203222276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":408784,"internal_metadata":1579205424},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.65000000000000002,"15min":0.84499999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":5.9470000000000001,"5min":6.1310000000000002,"15min":9.6829999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":3.206,"5min":1.5009999999999999,"15min":1.153},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":23.140999999999998,"5min":23.140999999999998,"15min":23.140999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":0.82899999999999996,"15min":0.88700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":5.891,"5min":8.0410000000000004,"15min":9.4350000000000005},"last":11.042999999999999},{"interface":"front","average":{"1min":3.5219999999999998,"5min":1.605,"15min":1.234},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":23.184000000000001,"5min":23.184000000000001,"15min":23.184000000000001},"last":11}]},{"osd":3,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":7.1260000000000003,"5min":2.3109999999999999,"15min":1.4710000000000001},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":55.256,"5min":55.256,"15min":55.256},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.8109999999999999,"5min":1.3120000000000001,"15min":1.1619999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":13.315,"5min":15.095000000000001,"15min":15.095000000000001},"last":0.746}]},{"osd":4,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":0.95399999999999996,"15min":1.014},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":6.7039999999999997,"5min":6.7039999999999997,"15min":9.4789999999999992},"last":0.84699999999999998},{"interface":"front","average":{"1min":4.6459999999999999,"5min":1.7549999999999999,"15min":1.401},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":54.752000000000002,"5min":54.752000000000002,"15min":54.752000000000002},"last":0.83099999999999996}]},{"osd":5,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1800000000000002,"5min":1.7290000000000001,"15min":1.3440000000000001},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"max":{"1min":23.219000000000001,"5min":23.219000000000001,"15min":23.219000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":5.6079999999999997,"5min":2.1269999999999998,"15min":1.5449999999999999},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":35.106999999999999,"5min":35.106999999999999,"15min":35.106999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":4.6109999999999998,"5min":1.948,"15min":1.524},"min":{"1min":0.46999999999999997,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":35.173000000000002,"5min":35.173000000000002,"15min":35.173000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.109,"15min":1.1259999999999999},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":8.1660000000000004,"5min":8.1660000000000004,"15min":9.5090000000000003},"last":1.127}]},{"osd":7,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":1.7769999999999999,"15min":1.4730000000000001},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":23.312999999999999,"5min":23.312999999999999,"15min":23.312999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":4.4859999999999998,"5min":2.0089999999999999,"15min":1.5669999999999999},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":35.240000000000002,"5min":35.240000000000002,"15min":35.240000000000002},"last":0.77200000000000002}]}]},{"osd":0,"up_from":14,"seq":60129548432,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6251524,"kb_used_data":5171892,"kb_used_omap":349,"kb_used_meta":1079266,"kb_avail":88120316,"statfs":{"total":96636764160,"available":90235203584,"internally_reserved":0,"allocated":5296017408,"data_stored":5285201682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":358162,"internal_metadata":1105168622},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.8210000000000002,"5min":7.6159999999999997,"15min":19.224},"last":0.23200000000000001},{"interface":"front","average":{"1min":1.105,"5min":0.93400000000000005,"15min":1.01},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":8.2219999999999995,"5min":10.795,"15min":19.341000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":14.928000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.492,"5min":0.86199999999999999,"15min":1.042},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":15.393000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":11.157,"5min":11.157,"15min":11.157},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.94199999999999995,"15min":0.98599999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.6389999999999993,"5min":8.6389999999999993,"15min":8.6389999999999993},"last":0.47699999999999998}]},{"osd":4,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.311},"max":{"1min":8.6760000000000002,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":1.893,"5min":1.147,"15min":1.0469999999999999},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32400000000000001},"max":{"1min":8.5429999999999993,"5min":9.8000000000000007,"15min":9.8000000000000007},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.115,"15min":1.194},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":8.3689999999999998,"5min":12.773999999999999,"15min":12.773999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.21,"5min":1.038,"15min":1.1950000000000001},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":8.7690000000000001,"5min":8.7690000000000001,"15min":8.7690000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.151,"15min":1.0880000000000001},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":8.4969999999999999,"5min":8.4969999999999999,"15min":8.4969999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.52,"5min":1.1459999999999999,"15min":1.2330000000000001},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":8.3399999999999999,"5min":12.821999999999999,"15min":12.821999999999999},"last":0.497}]},{"osd":7,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.3420000000000001,"15min":1.288},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.2870000000000008,"5min":12.859,"15min":12.859},"last":2.5619999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.3819999999999999,"15min":1.369},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":8.7040000000000006,"5min":8.7040000000000006,"15min":8.7040000000000006},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834581136,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6022820,"kb_used_data":4362776,"kb_used_omap":539,"kb_used_meta":1659492,"kb_avail":88349020,"statfs":{"total":96636764160,"available":90469396480,"internally_reserved":0,"allocated":4467482624,"data_stored":4458189438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":552774,"internal_metadata":1699319994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.748,"15min":0.85299999999999998},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20100000000000001},"max":{"1min":2.48,"5min":5.7999999999999998,"15min":7.9189999999999996},"last":1.0389999999999999},{"interface":"front","average":{"1min":3.0489999999999999,"5min":1.3120000000000001,"15min":0.98299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":38.442,"5min":38.442,"15min":38.442},"last":1.1080000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":1.3859999999999999,"15min":1.2629999999999999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":22.739999999999998,"5min":22.739999999999998,"15min":22.739999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.80700000000000005,"15min":0.89100000000000001},"min":{"1min":0.31900000000000001,"5min":0.22700000000000001,"15min":0.22},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":7.9889999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0449999999999999,"15min":1.077},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.1840000000000002,"5min":6.1840000000000002,"15min":8.9390000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.1160000000000001,"15min":1.0589999999999999},"min":{"1min":0.28499999999999998,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":5.1180000000000003,"5min":8.8919999999999995,"15min":8.8919999999999995},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":1.383,"15min":1.2929999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29699999999999999},"max":{"1min":22.84,"5min":22.84,"15min":22.84},"last":0.50800000000000001},{"interface":"front","average":{"1min":2.4529999999999998,"5min":1.3280000000000001,"15min":1.2330000000000001},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":25.719000000000001,"5min":25.719000000000001,"15min":25.719000000000001},"last":2.294}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":1.1579999999999999,"15min":1.01},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.9060000000000006,"5min":8.9060000000000006,"15min":8.9060000000000006},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.514,"5min":1.196,"15min":1.3220000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32900000000000001},"max":{"1min":10.329000000000001,"5min":10.329000000000001,"15min":10.329000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.3500000000000001,"15min":1.1830000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.5940000000000003,"5min":6.1379999999999999,"15min":6.1379999999999999},"last":2.3969999999999998},{"interface":"front","average":{"1min":1.446,"5min":1.1859999999999999,"15min":1.3},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.375},"max":{"1min":10.364000000000001,"5min":10.364000000000001,"15min":10.364000000000001},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.1559999999999999,"15min":1.137},"min":{"1min":0.49099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.1219999999999999,"5min":6.1219999999999999,"15min":8.0549999999999997},"last":0.877},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4830000000000001,"15min":1.26},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.6230000000000002,"5min":6.149,"15min":6.1689999999999996},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T01:33:45.297 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-01T01:33:45.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T01:33:45.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 Processor -- start 2023-10-01T01:33:45.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 -- start start 2023-10-01T01:33:45.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9798070520 0x7f979815d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:45.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f979806c7d0 0x7f97980c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9798158f50 con 0x7f9798158b70 2023-10-01T01:33:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979815d5a0 con 0x7f979806c7d0 2023-10-01T01:33:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f979dd84640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980709a0 con 0x7f9798070520 2023-10-01T01:33:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f9797fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f979806c7d0 0x7f97980c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f9797fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f979806c7d0 0x7f97980c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39796/0 (socket says 172.21.15.52:39796) 2023-10-01T01:33:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.535+0000 7f9797fff640 1 -- 172.21.15.52:0/2581626306 learned_addr learned my addr 172.21.15.52:0/2581626306 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.539+0000 7f9797fff640 1 -- 172.21.15.52:0/2581626306 >> v2:172.21.15.186:3300/0 conn(0x7f9798070520 msgr2=0x7f979815d060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-01T01:33:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.539+0000 7f9797fff640 1 --2- 172.21.15.52:0/2581626306 >> v2:172.21.15.186:3300/0 conn(0x7f9798070520 0x7f979815d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.539+0000 7f9797fff640 1 -- 172.21.15.52:0/2581626306 >> v1:172.21.15.186:6789/0 conn(0x7f9798158b70 legacy=0x7f979806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.539+0000 7f9797fff640 1 -- 172.21.15.52:0/2581626306 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798070c80 con 0x7f979806c7d0 2023-10-01T01:33:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.539+0000 7f9797fff640 1 --2- 172.21.15.52:0/2581626306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f979806c7d0 0x7f97980c8b00 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f97980cf490 tx=0x7f979001ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf6c8e7de252966 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.551+0000 7f97967fc640 1 -- 172.21.15.52:0/2581626306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900a7e70 con 0x7f979806c7d0 2023-10-01T01:33:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.551+0000 7f97967fc640 1 -- 172.21.15.52:0/2581626306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900ab070 con 0x7f979806c7d0 2023-10-01T01:33:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.551+0000 7f979dd84640 1 -- 172.21.15.52:0/2581626306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f979806c7d0 msgr2=0x7f97980c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.551+0000 7f979dd84640 1 --2- 172.21.15.52:0/2581626306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f979806c7d0 0x7f97980c8b00 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f97980cf490 tx=0x7f979001ed80 comp rx=0 tx=0).stop 2023-10-01T01:33:45.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- 172.21.15.52:0/2581626306 shutdown_connections 2023-10-01T01:33:45.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 --2- 172.21.15.52:0/2581626306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f979806c7d0 0x7f97980c8b00 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 --2- 172.21.15.52:0/2581626306 >> v2:172.21.15.186:3300/0 conn(0x7f9798070520 0x7f979815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- 172.21.15.52:0/2581626306 >> 172.21.15.52:0/2581626306 conn(0x7f97980ce4b0 msgr2=0x7f97980ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:45.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- 172.21.15.52:0/2581626306 shutdown_connections 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- 172.21.15.52:0/2581626306 wait complete. 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 Processor -- start 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- start start 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979806c7d0 0x7f97980c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 0x7f97980b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9798158b70 0x7f97980b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:45.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b3f90 con 0x7f9798070520 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c3c80 con 0x7f9798158b70 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.567+0000 7f979dd84640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b3410 con 0x7f979806c7d0 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 0x7f97980b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 0x7f97980b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39798/0 (socket says 172.21.15.52:39798) 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 -- 172.21.15.52:0/855178702 learned_addr learned my addr 172.21.15.52:0/855178702 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f97977fe640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979806c7d0 0x7f97980c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:45.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9797fff640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9798158b70 0x7f97980b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:45.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 -- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979806c7d0 msgr2=0x7f97980c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:45.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979806c7d0 0x7f97980c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 -- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9798158b70 msgr2=0x7f97980b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:45.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9798158b70 0x7f97980b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:45.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 -- 172.21.15.52:0/855178702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979000d050 con 0x7f9798070520 2023-10-01T01:33:45.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.571+0000 7f9796ffd640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 0x7f97980b2940 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b4a0 tx=0x7f978c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:45.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.583+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c010610 con 0x7f9798070520 2023-10-01T01:33:45.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.583+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c010790 con 0x7f9798070520 2023-10-01T01:33:45.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.583+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c010b40 con 0x7f9798070520 2023-10-01T01:33:45.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.583+0000 7f979dd84640 1 -- 172.21.15.52:0/855178702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97980b36f0 con 0x7f9798070520 2023-10-01T01:33:45.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.583+0000 7f979dd84640 1 -- 172.21.15.52:0/855178702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97980b3cb0 con 0x7f9798070520 2023-10-01T01:33:45.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.583+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f978c010ca0 con 0x7f9798070520 2023-10-01T01:33:45.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.587+0000 7f977ffff640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9784066230 0x7f97840686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:45.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.587+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f978c083300 con 0x7f9798070520 2023-10-01T01:33:45.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.587+0000 7f97977fe640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9784066230 0x7f97840686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:45.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.587+0000 7f97977fe640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9784066230 0x7f97840686f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9788007fd0 tx=0x7f9788009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:45.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.595+0000 7f979dd84640 1 -- 172.21.15.52:0/855178702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979804e930 con 0x7f9798070520 2023-10-01T01:33:45.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:45.607+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f978c050d40 con 0x7f9798070520 2023-10-01T01:33:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.043+0000 7f979dd84640 1 -- 172.21.15.52:0/855178702 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9798071520 con 0x7f9784066230 2023-10-01T01:33:46.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.047+0000 7f977ffff640 1 -- 172.21.15.52:0/855178702 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49562 (secure 0 0 0) 0x7f9788001450 con 0x7f9784066230 2023-10-01T01:33:46.055 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:46.055 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-10-01T01:33:46.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 -- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9784066230 msgr2=0x7f97840686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9784066230 0x7f97840686f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9788007fd0 tx=0x7f9788009040 comp rx=0 tx=0).stop 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 -- 172.21.15.52:0/855178702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 msgr2=0x7f97980b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 0x7f97980b2940 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b4a0 tx=0x7f978c00b960 comp rx=0 tx=0).stop 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 -- 172.21.15.52:0/855178702 shutdown_connections 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9784066230 0x7f97840686f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9798158b70 0x7f97980b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9798070520 0x7f97980b2940 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 --2- 172.21.15.52:0/855178702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979806c7d0 0x7f97980c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 -- 172.21.15.52:0/855178702 >> 172.21.15.52:0/855178702 conn(0x7f97980ce4b0 msgr2=0x7f9798071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:46.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 -- 172.21.15.52:0/855178702 shutdown_connections 2023-10-01T01:33:46.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.075+0000 7f977dffb640 1 -- 172.21.15.52:0/855178702 wait complete. 2023-10-01T01:33:46.105 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":15769,"stamp":"2023-10-01T01:33:44.862101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":46662528,"kb_used_data":33869228,"kb_used_omap":3673,"kb_used_meta":12442342,"kb_avail":708312192,"statfs":{"total":773094113280,"available":725311684608,"internally_reserved":0,"allocated":34682089472,"data_stored":34609365749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3761525,"internal_metadata":12740958859},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":343,"apply_latency_ms":343,"commit_latency_ns":343000000,"apply_latency_ns":343000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39732900580,"num_objects":-33707,"num_object_clones":0,"num_object_copies":-67414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33707,"num_whiteouts":0,"num_read":-1506866,"num_read_kb":-108893545,"num_write":-7506264,"num_write_kb":-161598023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2461,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001991"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-01T01:33:35.066328+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-10-01T01:33:35.066328+0000","last_peered":"2023-10-01T01:33:35.066328+0000","last_clean":"2023-10-01T01:33:35.066328+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-10-01T01:33:35.066328+0000","last_undegraded":"2023-10-01T01:33:35.066328+0000","last_fullsized":"2023-10-01T01:33:35.066328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129548442,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4951136,"kb_used_data":3232460,"kb_used_omap":564,"kb_used_meta":1667595,"kb_avail":89420704,"statfs":{"total":96636764160,"available":91566800896,"internally_reserved":0,"allocated":3310039040,"data_stored":3303020623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":577944,"internal_metadata":1707617896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68100000000000005,"15min":0.78700000000000003},"min":{"1min":0.253,"5min":0.248,"15min":0.23100000000000001},"max":{"1min":0.85599999999999998,"5min":5.3360000000000003,"15min":6.6909999999999998},"last":0.745},{"interface":"front","average":{"1min":1.105,"5min":0.88700000000000001,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.255},"max":{"1min":5.9580000000000002,"5min":5.9580000000000002,"15min":6.109},"last":0.498}]},{"osd":1,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.99399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.9039999999999999,"5min":5.2910000000000004,"15min":6.726},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94799999999999995,"15min":1.0740000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":4.8029999999999999,"5min":5.2850000000000001,"15min":9.8680000000000003},"last":1.016}]},{"osd":2,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.2769999999999999,"15min":1.236},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.6399999999999997,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.1950000000000001,"15min":1.272},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":1.589,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.0569999999999999,"15min":1.29},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6840000000000002,"5min":5.8140000000000001,"15min":10.702},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.90500000000000003,"15min":1.1339999999999999},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95099999999999996,"5min":8.1370000000000005,"15min":8.1370000000000005},"last":1.0840000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.68300000000000005,"15min":0.89800000000000002},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.24099999999999999},"max":{"1min":0.95099999999999996,"5min":5.2140000000000004,"15min":6.9770000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.82799999999999996,"15min":1.028},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26400000000000001},"max":{"1min":2.2789999999999999,"5min":5.3579999999999997,"15min":7.9710000000000001},"last":1.0549999999999999}]},{"osd":5,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.90200000000000002,"15min":1.0349999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.26800000000000002},"max":{"1min":1.51,"5min":10.757999999999999,"15min":10.757999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.85699999999999998,"15min":0.95999999999999996},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":0.98599999999999999,"5min":5.7300000000000004,"15min":6.8040000000000003},"last":0.85799999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":5.2590000000000003,"5min":5.9219999999999997,"15min":8.8000000000000007},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":1.071},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":8.8819999999999997},"last":1.151}]}]},{"osd":6,"up_from":14,"seq":60129548444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6356492,"kb_used_data":4659172,"kb_used_omap":29,"kb_used_meta":1611874,"kb_avail":88015348,"statfs":{"total":96636764160,"available":90127716352,"internally_reserved":0,"allocated":4770992128,"data_stored":4760848691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30210,"internal_metadata":1650559486},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.014,"15min":0.88500000000000001},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":15.537000000000001,"5min":15.537000000000001,"15min":15.537000000000001},"last":0.622},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.0900000000000001,"15min":0.96599999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":8.8770000000000007,"5min":8.8770000000000007,"15min":8.8770000000000007},"last":0.94199999999999995}]},{"osd":1,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":1.159,"15min":1.0980000000000001},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":15.608000000000001,"5min":15.608000000000001,"15min":15.608000000000001},"last":1.27},{"interface":"front","average":{"1min":1.286,"5min":1.107,"15min":1.1699999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.28799999999999998},"max":{"1min":8.9429999999999996,"5min":8.9429999999999996,"15min":8.9429999999999996},"last":1.629}]},{"osd":2,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2130000000000001,"15min":1.234},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":5.0049999999999999,"5min":6.1950000000000003,"15min":11.847},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.901,"5min":1.3999999999999999,"15min":1.2529999999999999},"min":{"1min":0.32300000000000001,"5min":0.313,"15min":0.26800000000000002},"max":{"1min":15.951000000000001,"5min":15.951000000000001,"15min":15.951000000000001},"last":1.151}]},{"osd":3,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":1.3759999999999999,"15min":1.3640000000000001},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":16.318000000000001,"5min":16.318000000000001,"15min":16.318000000000001},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0469999999999999,"15min":1.1379999999999999},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":4.4139999999999997,"5min":6.2750000000000004,"15min":7.5469999999999997},"last":1.228}]},{"osd":4,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.119,"15min":0.94999999999999996},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.253},"max":{"1min":16.077999999999999,"5min":16.077999999999999,"15min":16.077999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.0169999999999999,"15min":0.998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":1.9470000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.87,"15min":0.997},"min":{"1min":0.33700000000000002,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":4.4909999999999997,"5min":6.1390000000000002,"15min":8.6799999999999997},"last":1.4450000000000001},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.2270000000000001,"15min":1.0129999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":15.640000000000001,"5min":15.640000000000001,"15min":15.640000000000001},"last":1.571}]},{"osd":7,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.117,"15min":1.103},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.129000000000001,"5min":16.129000000000001,"15min":16.129000000000001},"last":2.266},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0900000000000001,"15min":1.034},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":4.4509999999999996,"5min":6.2370000000000001,"15min":7.516},"last":1.8129999999999999}]}]},{"osd":5,"up_from":14,"seq":60129548443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4921500,"kb_used_data":3137040,"kb_used_omap":864,"kb_used_meta":1761951,"kb_avail":89450340,"statfs":{"total":96636764160,"available":91597148160,"internally_reserved":0,"allocated":3212328960,"data_stored":3205211353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":884917,"internal_metadata":1804238667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6339999999999999,"5min":5.6829999999999998,"15min":10.228999999999999},"last":2.5459999999999998},{"interface":"front","average":{"1min":1.2789999999999999,"5min":0.77800000000000002,"15min":1.073},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":12.055},"last":8.4199999999999999}]},{"osd":1,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.754,"15min":1.1559999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":2.7829999999999999,"5min":4.6180000000000003,"15min":10.068},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.94999999999999996,"15min":0.88800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.3609999999999998,"5min":5.3609999999999998,"15min":9.4689999999999994},"last":1.258}]},{"osd":2,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.98899999999999999,"15min":1.0920000000000001},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.7669999999999999,"5min":7.5780000000000003,"15min":12.086},"last":1.504},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.97099999999999997,"15min":1.2949999999999999},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.8340000000000001,"5min":11.26,"15min":11.26},"last":1.5329999999999999}]},{"osd":3,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.4910000000000001,"5min":1.482,"15min":1.399},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":50.969000000000001,"5min":50.969000000000001,"15min":50.969000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.093,"5min":1.7789999999999999,"15min":1.5840000000000001},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":50.537999999999997,"5min":50.537999999999997,"15min":50.537999999999997},"last":1.5640000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.84899999999999998,"15min":0.71199999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8799999999999999,"5min":5.7119999999999997,"15min":5.7149999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65600000000000003,"15min":0.98799999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":2.9089999999999998,"5min":4.4489999999999998,"15min":12.852},"last":1.806}]},{"osd":6,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.91300000000000003,"15min":1.1160000000000001},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.26700000000000002},"max":{"1min":2.2210000000000001,"5min":15.307,"15min":15.307},"last":1.738},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9710000000000001,"5min":5.1429999999999998,"15min":10.548999999999999},"last":1.419}]},{"osd":7,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":1.101},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":3.5129999999999999,"5min":6.149,"15min":12.805999999999999},"last":1.841},{"interface":"front","average":{"1min":2.0899999999999999,"5min":1.181,"15min":1.226},"min":{"1min":0.439,"5min":0.312,"15min":0.312},"max":{"1min":26.960000000000001,"5min":26.960000000000001,"15min":26.960000000000001},"last":1.7050000000000001}]}]},{"osd":4,"up_from":14,"seq":60129548442,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5766140,"kb_used_data":4096812,"kb_used_omap":488,"kb_used_meta":1517975,"kb_avail":88605700,"statfs":{"total":96636764160,"available":90732236800,"internally_reserved":0,"allocated":4195135488,"data_stored":4186155290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":499847,"internal_metadata":1554407289},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.77500000000000002,"15min":0.86299999999999999},"min":{"1min":0.24399999999999999,"5min":0.221,"15min":0.20499999999999999},"max":{"1min":4.2590000000000003,"5min":8.5519999999999996,"15min":10.225},"last":12.33},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.133,"15min":1.008},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.245},"max":{"1min":2.9670000000000001,"5min":8.5649999999999995,"15min":10.241},"last":12.369}]},{"osd":1,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.82899999999999996,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.3490000000000002,"5min":4.7050000000000001,"15min":7.0179999999999998},"last":0.497},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.206,"15min":1.044},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.847,"5min":5.5259999999999998,"15min":8.266},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.121,"15min":1.1799999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.577,"5min":5.8330000000000002,"15min":23.491},"last":0.621},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.133,"15min":1.202},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3170000000000002,"5min":7.2759999999999998,"15min":23.311},"last":0.72799999999999998}]},{"osd":3,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":3.3780000000000001,"5min":1.748,"15min":1.29},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":32.417000000000002,"5min":32.417000000000002,"15min":32.417000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6930000000000001,"15min":1.3460000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.75,"5min":34.75,"15min":34.75},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":0.89400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":3.032,"5min":5.4059999999999997,"15min":6.1600000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.1339999999999999,"15min":0.99199999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":0.746}]},{"osd":6,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89800000000000002,"15min":0.93899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":4.375,"5min":4.7789999999999999,"15min":6.1470000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":1.2749999999999999,"15min":1.0700000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.0579999999999998,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":12.425000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.222,"15min":1.071},"min":{"1min":0.34599999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.109,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.96899999999999997},"min":{"1min":0.42099999999999999,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":4.4210000000000003,"5min":4.7610000000000001,"15min":6.1840000000000002},"last":0.67900000000000005}]}]},{"osd":3,"up_from":14,"seq":60129548425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5720208,"kb_used_data":4117768,"kb_used_omap":438,"kb_used_meta":1601993,"kb_avail":88651632,"statfs":{"total":96636764160,"available":90779271168,"internally_reserved":0,"allocated":4216594432,"data_stored":4207516396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":448887,"internal_metadata":1640441481},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":5.032,"5min":5.032,"15min":9.8320000000000007},"last":1.718},{"interface":"front","average":{"1min":1.728,"5min":1.3759999999999999,"15min":1.155},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":6.6559999999999997,"5min":11.756,"15min":11.756},"last":6.6559999999999997}]},{"osd":1,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":1.8220000000000001,"15min":1.2150000000000001},"min":{"1min":0.28000000000000003,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":22.338000000000001,"5min":22.338000000000001,"15min":22.338000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.127,"15min":0.92000000000000004},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.24199999999999999},"max":{"1min":15.903,"5min":15.903,"15min":15.903},"last":1.8420000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.7250000000000001,"5min":1.891,"15min":1.3440000000000001},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.859,"5min":1.25,"15min":1.044},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":12.17,"5min":12.17,"15min":12.17},"last":0.31900000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":1.5009999999999999,"15min":1.2110000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":10.407,"5min":12.07,"15min":12.07},"last":6.702},{"interface":"front","average":{"1min":2.9710000000000001,"5min":1.7490000000000001,"15min":1.3129999999999999},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":22.370000000000001,"5min":22.370000000000001,"15min":22.370000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0730000000000004,"5min":1.9359999999999999,"15min":1.417},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":22.25,"5min":22.25,"15min":22.25},"last":0.53200000000000003},{"interface":"front","average":{"1min":3.552,"5min":1.6040000000000001,"15min":1.1639999999999999},"min":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"max":{"1min":22.183,"5min":22.183,"15min":22.183},"last":0.39400000000000002}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":1.1679999999999999,"15min":1.165},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":17.276,"5min":17.276,"15min":17.276},"last":0.42199999999999999},{"interface":"front","average":{"1min":5.306,"5min":2.5070000000000001,"15min":1.764},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":42.237000000000002,"5min":42.237000000000002,"15min":42.237000000000002},"last":6.734}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":2.1850000000000001,"15min":1.667},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.38900000000000001},"max":{"1min":12.103,"5min":12.103,"15min":12.103},"last":6.7629999999999999},{"interface":"front","average":{"1min":3.6669999999999998,"5min":2.0230000000000001,"15min":1.6020000000000001},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":22.300000000000001,"5min":22.300000000000001,"15min":22.300000000000001},"last":0.57499999999999996}]}]},{"osd":2,"up_from":14,"seq":60129548428,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6672708,"kb_used_data":5091308,"kb_used_omap":399,"kb_used_meta":1542192,"kb_avail":87699132,"statfs":{"total":96636764160,"available":89803911168,"internally_reserved":0,"allocated":5213499392,"data_stored":5203222276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":408784,"internal_metadata":1579205424},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.65000000000000002,"15min":0.84499999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":5.9470000000000001,"5min":6.1310000000000002,"15min":9.6829999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":3.206,"5min":1.5009999999999999,"15min":1.153},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":23.140999999999998,"5min":23.140999999999998,"15min":23.140999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":0.82899999999999996,"15min":0.88700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":5.891,"5min":8.0410000000000004,"15min":9.4350000000000005},"last":11.042999999999999},{"interface":"front","average":{"1min":3.5219999999999998,"5min":1.605,"15min":1.234},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":23.184000000000001,"5min":23.184000000000001,"15min":23.184000000000001},"last":11}]},{"osd":3,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":7.1260000000000003,"5min":2.3109999999999999,"15min":1.4710000000000001},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":55.256,"5min":55.256,"15min":55.256},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.8109999999999999,"5min":1.3120000000000001,"15min":1.1619999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":13.315,"5min":15.095000000000001,"15min":15.095000000000001},"last":0.746}]},{"osd":4,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":0.95399999999999996,"15min":1.014},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":6.7039999999999997,"5min":6.7039999999999997,"15min":9.4789999999999992},"last":0.84699999999999998},{"interface":"front","average":{"1min":4.6459999999999999,"5min":1.7549999999999999,"15min":1.401},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":54.752000000000002,"5min":54.752000000000002,"15min":54.752000000000002},"last":0.83099999999999996}]},{"osd":5,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1800000000000002,"5min":1.7290000000000001,"15min":1.3440000000000001},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"max":{"1min":23.219000000000001,"5min":23.219000000000001,"15min":23.219000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":5.6079999999999997,"5min":2.1269999999999998,"15min":1.5449999999999999},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":35.106999999999999,"5min":35.106999999999999,"15min":35.106999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":4.6109999999999998,"5min":1.948,"15min":1.524},"min":{"1min":0.46999999999999997,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":35.173000000000002,"5min":35.173000000000002,"15min":35.173000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.109,"15min":1.1259999999999999},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":8.1660000000000004,"5min":8.1660000000000004,"15min":9.5090000000000003},"last":1.127}]},{"osd":7,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":1.7769999999999999,"15min":1.4730000000000001},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":23.312999999999999,"5min":23.312999999999999,"15min":23.312999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":4.4859999999999998,"5min":2.0089999999999999,"15min":1.5669999999999999},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":35.240000000000002,"5min":35.240000000000002,"15min":35.240000000000002},"last":0.77200000000000002}]}]},{"osd":0,"up_from":14,"seq":60129548432,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6251524,"kb_used_data":5171892,"kb_used_omap":349,"kb_used_meta":1079266,"kb_avail":88120316,"statfs":{"total":96636764160,"available":90235203584,"internally_reserved":0,"allocated":5296017408,"data_stored":5285201682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":358162,"internal_metadata":1105168622},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.8210000000000002,"5min":7.6159999999999997,"15min":19.224},"last":0.23200000000000001},{"interface":"front","average":{"1min":1.105,"5min":0.93400000000000005,"15min":1.01},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":8.2219999999999995,"5min":10.795,"15min":19.341000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":14.928000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":1.492,"5min":0.86199999999999999,"15min":1.042},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":15.393000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":11.157,"5min":11.157,"15min":11.157},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.94199999999999995,"15min":0.98599999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.6389999999999993,"5min":8.6389999999999993,"15min":8.6389999999999993},"last":0.47699999999999998}]},{"osd":4,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.311},"max":{"1min":8.6760000000000002,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":1.893,"5min":1.147,"15min":1.0469999999999999},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32400000000000001},"max":{"1min":8.5429999999999993,"5min":9.8000000000000007,"15min":9.8000000000000007},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.115,"15min":1.194},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":8.3689999999999998,"5min":12.773999999999999,"15min":12.773999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.21,"5min":1.038,"15min":1.1950000000000001},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":8.7690000000000001,"5min":8.7690000000000001,"15min":8.7690000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.151,"15min":1.0880000000000001},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":8.4969999999999999,"5min":8.4969999999999999,"15min":8.4969999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.52,"5min":1.1459999999999999,"15min":1.2330000000000001},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":8.3399999999999999,"5min":12.821999999999999,"15min":12.821999999999999},"last":0.497}]},{"osd":7,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.3420000000000001,"15min":1.288},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.2870000000000008,"5min":12.859,"15min":12.859},"last":2.5619999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.3819999999999999,"15min":1.369},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":8.7040000000000006,"5min":8.7040000000000006,"15min":8.7040000000000006},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834581136,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6022820,"kb_used_data":4362776,"kb_used_omap":539,"kb_used_meta":1659492,"kb_avail":88349020,"statfs":{"total":96636764160,"available":90469396480,"internally_reserved":0,"allocated":4467482624,"data_stored":4458189438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":552774,"internal_metadata":1699319994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.748,"15min":0.85299999999999998},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20100000000000001},"max":{"1min":2.48,"5min":5.7999999999999998,"15min":7.9189999999999996},"last":1.0389999999999999},{"interface":"front","average":{"1min":3.0489999999999999,"5min":1.3120000000000001,"15min":0.98299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":38.442,"5min":38.442,"15min":38.442},"last":1.1080000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":1.3859999999999999,"15min":1.2629999999999999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":22.739999999999998,"5min":22.739999999999998,"15min":22.739999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.80700000000000005,"15min":0.89100000000000001},"min":{"1min":0.31900000000000001,"5min":0.22700000000000001,"15min":0.22},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":7.9889999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0449999999999999,"15min":1.077},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.1840000000000002,"5min":6.1840000000000002,"15min":8.9390000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.1160000000000001,"15min":1.0589999999999999},"min":{"1min":0.28499999999999998,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":5.1180000000000003,"5min":8.8919999999999995,"15min":8.8919999999999995},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":1.383,"15min":1.2929999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29699999999999999},"max":{"1min":22.84,"5min":22.84,"15min":22.84},"last":0.50800000000000001},{"interface":"front","average":{"1min":2.4529999999999998,"5min":1.3280000000000001,"15min":1.2330000000000001},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":25.719000000000001,"5min":25.719000000000001,"15min":25.719000000000001},"last":2.294}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":1.1579999999999999,"15min":1.01},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.9060000000000006,"5min":8.9060000000000006,"15min":8.9060000000000006},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.514,"5min":1.196,"15min":1.3220000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32900000000000001},"max":{"1min":10.329000000000001,"5min":10.329000000000001,"15min":10.329000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.3500000000000001,"15min":1.1830000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.5940000000000003,"5min":6.1379999999999999,"15min":6.1379999999999999},"last":2.3969999999999998},{"interface":"front","average":{"1min":1.446,"5min":1.1859999999999999,"15min":1.3},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.375},"max":{"1min":10.364000000000001,"5min":10.364000000000001,"15min":10.364000000000001},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.1559999999999999,"15min":1.137},"min":{"1min":0.49099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.1219999999999999,"5min":6.1219999999999999,"15min":8.0549999999999997},"last":0.877},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4830000000000001,"15min":1.26},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.6230000000000002,"5min":6.149,"15min":6.1689999999999996},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T01:33:46.107 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-01T01:33:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 Processor -- start 2023-10-01T01:33:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 -- start start 2023-10-01T01:33:46.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f728c15a9e0 0x7f728c070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f728c0b63e0 0x7f728c0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c0ce770 con 0x7f728c0b2310 2023-10-01T01:33:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0cea10 con 0x7f728c0b63e0 2023-10-01T01:33:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f729353b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0cecf0 con 0x7f728c15a9e0 2023-10-01T01:33:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f7291ad8640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f728c0b2310 0x7f728c0cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38730/0 (socket says 172.21.15.52:38730) 2023-10-01T01:33:46.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f7291ad8640 1 -- 172.21.15.52:0/1644623091 learned_addr learned my addr 172.21.15.52:0/1644623091 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f72912d7640 1 --2- 172.21.15.52:0/1644623091 >> v2:172.21.15.186:3300/0 conn(0x7f728c15a9e0 0x7f728c070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f7290ad6640 1 --2- 172.21.15.52:0/1644623091 >> v2:172.21.15.52:3300/0 conn(0x7f728c0b63e0 0x7f728c0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f7283fff640 1 -- 172.21.15.52:0/1644623091 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072566501 0 0) 0x7f728c0ce770 con 0x7f728c0b2310 2023-10-01T01:33:46.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f7283fff640 1 -- 172.21.15.52:0/1644623091 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7278003530 con 0x7f728c0b2310 2023-10-01T01:33:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f72912d7640 1 -- 172.21.15.52:0/1644623091 >> v2:172.21.15.52:3300/0 conn(0x7f728c0b63e0 msgr2=0x7f728c0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f72912d7640 1 --2- 172.21.15.52:0/1644623091 >> v2:172.21.15.52:3300/0 conn(0x7f728c0b63e0 0x7f728c0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f72912d7640 1 -- 172.21.15.52:0/1644623091 >> v1:172.21.15.52:6789/0 conn(0x7f728c0b2310 legacy=0x7f728c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f72912d7640 1 -- 172.21.15.52:0/1644623091 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0cefd0 con 0x7f728c15a9e0 2023-10-01T01:33:46.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.303+0000 7f7290ad6640 1 --2- 172.21.15.52:0/1644623091 >> v2:172.21.15.52:3300/0 conn(0x7f728c0b63e0 0x7f728c0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:46.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f72912d7640 1 --2- 172.21.15.52:0/1644623091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c15a9e0 0x7f728c070850 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f728c0cdf50 tx=0x7f728801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2314b85bbe54c43b server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f7283fff640 1 -- 172.21.15.52:0/1644623091 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880ab600 con 0x7f728c15a9e0 2023-10-01T01:33:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f7283fff640 1 -- 172.21.15.52:0/1644623091 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72880a7050 con 0x7f728c15a9e0 2023-10-01T01:33:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f7283fff640 1 -- 172.21.15.52:0/1644623091 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880ab9c0 con 0x7f728c15a9e0 2023-10-01T01:33:46.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 -- 172.21.15.52:0/1644623091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c15a9e0 msgr2=0x7f728c070850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 --2- 172.21.15.52:0/1644623091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c15a9e0 0x7f728c070850 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f728c0cdf50 tx=0x7f728801c3c0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 -- 172.21.15.52:0/1644623091 shutdown_connections 2023-10-01T01:33:46.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 --2- 172.21.15.52:0/1644623091 >> v2:172.21.15.52:3300/0 conn(0x7f728c0b63e0 0x7f728c0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 --2- 172.21.15.52:0/1644623091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c15a9e0 0x7f728c070850 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 -- 172.21.15.52:0/1644623091 >> 172.21.15.52:0/1644623091 conn(0x7f728c0cd310 msgr2=0x7f728c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:46.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 -- 172.21.15.52:0/1644623091 shutdown_connections 2023-10-01T01:33:46.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.315+0000 7f729353b640 1 -- 172.21.15.52:0/1644623091 wait complete. 2023-10-01T01:33:46.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 Processor -- start 2023-10-01T01:33:46.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 -- start start 2023-10-01T01:33:46.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 0x7f728c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:46.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f728c0b63e0 0x7f728c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:46.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f728c15a9e0 0x7f728c1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 0x7f728c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 0x7f728c0c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:52698/0 (socket says 172.21.15.52:52698) 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 -- 172.21.15.52:0/2213657322 learned_addr learned my addr 172.21.15.52:0/2213657322 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f7291ad8640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f728c15a9e0 0x7f728c1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c150e10 con 0x7f728c15a9e0 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0c4aa0 con 0x7f728c0b2310 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0c4d80 con 0x7f728c0b63e0 2023-10-01T01:33:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f7290ad6640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f728c0b63e0 0x7f728c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 -- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f728c0b63e0 msgr2=0x7f728c0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f728c0b63e0 0x7f728c0c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 -- 172.21.15.52:0/2213657322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f728c15a9e0 msgr2=0x7f728c1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f728c15a9e0 0x7f728c1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c009420 con 0x7f728c0b2310 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f72912d7640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 0x7f728c0c5b40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f72880ae040 tx=0x7f7288019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880b5690 con 0x7f728c0b2310 2023-10-01T01:33:46.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72880b57f0 con 0x7f728c0b2310 2023-10-01T01:33:46.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880b5ba0 con 0x7f728c0b2310 2023-10-01T01:33:46.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7288009420 con 0x7f728c0b2310 2023-10-01T01:33:46.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.319+0000 7f729353b640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c15af40 con 0x7f728c0b2310 2023-10-01T01:33:46.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.323+0000 7f729353b640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c066750 con 0x7f728c0b2310 2023-10-01T01:33:46.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.323+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f72880b5d00 con 0x7f728c0b2310 2023-10-01T01:33:46.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.323+0000 7f7281ffb640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7270066160 0x7f7270068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:46.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.323+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7288121660 con 0x7f728c0b2310 2023-10-01T01:33:46.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.323+0000 7f7290ad6640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7270066160 0x7f7270068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:46.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.323+0000 7f7290ad6640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7270066160 0x7f7270068620 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f728c0cb850 tx=0x7f727c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.331+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f72880eefb0 con 0x7f728c0b2310 2023-10-01T01:33:46.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.647+0000 7f729353b640 1 -- 172.21.15.52:0/2213657322 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f728c0740a0 con 0x7f728c0b2310 2023-10-01T01:33:46.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.647+0000 7f7281ffb640 1 -- 172.21.15.52:0/2213657322 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13000 (secure 0 0 0) 0x7f72880b0090 con 0x7f728c0b2310 2023-10-01T01:33:46.661 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:46.661 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"fsid":"a2b00988-da85-4e26-9767-73ee6224a074","created":"2023-09-30T16:48:52.668509+0000","modified":"2023-10-01T01:33:38.334876+0000","last_up_change":"2023-09-30T16:49:03.391194+0000","last_in_change":"2023-09-30T16:48:54.918124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T16:49:03.527089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7cadf180-98eb-4c22-bb95-37deba653198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6825","nonce":3968874267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6827","nonce":3968874267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6831","nonce":3968874267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3968874267},{"type":"v1","addr":"172.21.15.52:6829","nonce":3968874267}]},"public_addr":"172.21.15.52:6825/3968874267","cluster_addr":"172.21.15.52:6827/3968874267","heartbeat_back_addr":"172.21.15.52:6831/3968874267","heartbeat_front_addr":"172.21.15.52:6829/3968874267","state":["exists","up"]},{"osd":1,"uuid":"435f1380-5a40-4732-8e94-9c6d802061dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6801","nonce":2774169000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6803","nonce":2774169000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6807","nonce":2774169000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2774169000},{"type":"v1","addr":"172.21.15.52:6805","nonce":2774169000}]},"public_addr":"172.21.15.52:6801/2774169000","cluster_addr":"172.21.15.52:6803/2774169000","heartbeat_back_addr":"172.21.15.52:6807/2774169000","heartbeat_front_addr":"172.21.15.52:6805/2774169000","state":["exists","up"]},{"osd":2,"uuid":"3f1be1b2-bbe7-4e00-af4e-80a3ad55c4c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6810","nonce":2011916612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6814","nonce":2011916612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6822","nonce":2011916612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2011916612},{"type":"v1","addr":"172.21.15.52:6818","nonce":2011916612}]},"public_addr":"172.21.15.52:6810/2011916612","cluster_addr":"172.21.15.52:6814/2011916612","heartbeat_back_addr":"172.21.15.52:6822/2011916612","heartbeat_front_addr":"172.21.15.52:6818/2011916612","state":["exists","up"]},{"osd":3,"uuid":"d820caf8-a460-48bc-87aa-1a8c814dac17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6811","nonce":2535336001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6815","nonce":2535336001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6823","nonce":2535336001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":2535336001},{"type":"v1","addr":"172.21.15.52:6819","nonce":2535336001}]},"public_addr":"172.21.15.52:6811/2535336001","cluster_addr":"172.21.15.52:6815/2535336001","heartbeat_back_addr":"172.21.15.52:6823/2535336001","heartbeat_front_addr":"172.21.15.52:6819/2535336001","state":["exists","up"]},{"osd":4,"uuid":"0f6d72bf-38d4-43c9-ae63-ec59668c7d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6801","nonce":2180915136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6803","nonce":2180915136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6807","nonce":2180915136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2180915136},{"type":"v1","addr":"172.21.15.186:6805","nonce":2180915136}]},"public_addr":"172.21.15.186:6801/2180915136","cluster_addr":"172.21.15.186:6803/2180915136","heartbeat_back_addr":"172.21.15.186:6807/2180915136","heartbeat_front_addr":"172.21.15.186:6805/2180915136","state":["exists","up"]},{"osd":5,"uuid":"c39510df-e980-4d60-a3b4-625511e4efea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6809","nonce":3258999792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6811","nonce":3258999792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6815","nonce":3258999792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3258999792},{"type":"v1","addr":"172.21.15.186:6813","nonce":3258999792}]},"public_addr":"172.21.15.186:6809/3258999792","cluster_addr":"172.21.15.186:6811/3258999792","heartbeat_back_addr":"172.21.15.186:6815/3258999792","heartbeat_front_addr":"172.21.15.186:6813/3258999792","state":["exists","up"]},{"osd":6,"uuid":"0317f0d3-2589-4900-9291-4a978b487b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6818","nonce":2219583678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6823","nonce":2219583678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6831","nonce":2219583678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":2219583678},{"type":"v1","addr":"172.21.15.186:6827","nonce":2219583678}]},"public_addr":"172.21.15.186:6818/2219583678","cluster_addr":"172.21.15.186:6823/2219583678","heartbeat_back_addr":"172.21.15.186:6831/2219583678","heartbeat_front_addr":"172.21.15.186:6827/2219583678","state":["exists","up"]},{"osd":7,"uuid":"0f601fa0-d3e4-45b2-af77-930fd5fb461d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6819","nonce":1826627445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6822","nonce":1826627445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6829","nonce":1826627445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1826627445},{"type":"v1","addr":"172.21.15.186:6826","nonce":1826627445}]},"public_addr":"172.21.15.186:6819/1826627445","cluster_addr":"172.21.15.186:6822/1826627445","heartbeat_back_addr":"172.21.15.186:6829/1826627445","heartbeat_front_addr":"172.21.15.186:6826/1826627445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.508817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.434384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.513013+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.519041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.335631+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.416434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.261133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T16:49:00.428753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:6837/2755050347":"2023-10-02T01:33:35.007306+0000","172.21.15.186:6836/2755050347":"2023-10-02T01:33:35.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-01T01:33:46.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.663+0000 7f726f7fe640 1 -- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7270066160 msgr2=0x7f7270068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.663+0000 7f726f7fe640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7270066160 0x7f7270068620 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f728c0cb850 tx=0x7f727c009190 comp rx=0 tx=0).stop 2023-10-01T01:33:46.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.663+0000 7f726f7fe640 1 -- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 msgr2=0x7f728c0c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:46.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.663+0000 7f726f7fe640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 0x7f728c0c5b40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f72880ae040 tx=0x7f7288019160 comp rx=0 tx=0).stop 2023-10-01T01:33:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 -- 172.21.15.52:0/2213657322 shutdown_connections 2023-10-01T01:33:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7270066160 0x7f7270068620 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f728c15a9e0 0x7f728c1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f728c0b63e0 0x7f728c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 --2- 172.21.15.52:0/2213657322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f728c0b2310 0x7f728c0c5b40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 -- 172.21.15.52:0/2213657322 >> 172.21.15.52:0/2213657322 conn(0x7f728c0cd310 msgr2=0x7f728c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 -- 172.21.15.52:0/2213657322 shutdown_connections 2023-10-01T01:33:46.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:46.679+0000 7f726f7fe640 1 -- 172.21.15.52:0/2213657322 wait complete. 2023-10-01T01:33:47.706 INFO:tasks.ceph:Scrubbing osd.0 2023-10-01T01:33:47.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.915+0000 7f842f9b8640 1 Processor -- start 2023-10-01T01:33:47.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.915+0000 7f842f9b8640 1 -- start start 2023-10-01T01:33:47.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842f9b8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84280cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842f9b8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84280b4f50 0x7f84280cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842f9b8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280cb700 con 0x7f8428159b70 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842d754640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f8428159b70 0x7f84280ce5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.52:48806/0 (socket says 172.21.15.52:48806) 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842d754640 1 -- 172.21.15.52:0/818000668 learned_addr learned my addr 172.21.15.52:0/818000668 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842cf53640 1 --2- 172.21.15.52:0/818000668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84280cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842df55640 1 --2- 172.21.15.52:0/818000668 >> v2:172.21.15.186:3300/0 conn(0x7f84280b4f50 0x7f84280cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280ce290 con 0x7f84280b4f50 2023-10-01T01:33:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8428159f50 con 0x7f84280ced00 2023-10-01T01:33:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f841ffff640 1 -- 172.21.15.52:0/818000668 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257424355 0 0) 0x7f84280cb700 con 0x7f8428159b70 2023-10-01T01:33:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f841ffff640 1 -- 172.21.15.52:0/818000668 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8414003530 con 0x7f8428159b70 2023-10-01T01:33:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842cf53640 1 -- 172.21.15.52:0/818000668 >> v2:172.21.15.186:3300/0 conn(0x7f84280b4f50 msgr2=0x7f84280cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842cf53640 1 --2- 172.21.15.52:0/818000668 >> v2:172.21.15.186:3300/0 conn(0x7f84280b4f50 0x7f84280cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842cf53640 1 -- 172.21.15.52:0/818000668 >> v1:172.21.15.186:6789/0 conn(0x7f8428159b70 legacy=0x7f84280ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.919+0000 7f842cf53640 1 -- 172.21.15.52:0/818000668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428072020 con 0x7f84280ced00 2023-10-01T01:33:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842cf53640 1 --2- 172.21.15.52:0/818000668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84280cdd50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84180097c0 tx=0x7f8418020ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc740c49fbd8cd99 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f841ffff640 1 -- 172.21.15.52:0/818000668 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180aaba0 con 0x7f84280ced00 2023-10-01T01:33:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f841ffff640 1 -- 172.21.15.52:0/818000668 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180aad00 con 0x7f84280ced00 2023-10-01T01:33:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f841ffff640 1 -- 172.21.15.52:0/818000668 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180b2660 con 0x7f84280ced00 2023-10-01T01:33:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 msgr2=0x7f84280cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 --2- 172.21.15.52:0/818000668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84280cdd50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84180097c0 tx=0x7f8418020ec0 comp rx=0 tx=0).stop 2023-10-01T01:33:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 shutdown_connections 2023-10-01T01:33:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 --2- 172.21.15.52:0/818000668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84280cdd50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 --2- 172.21.15.52:0/818000668 >> v2:172.21.15.186:3300/0 conn(0x7f84280b4f50 0x7f84280cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 >> 172.21.15.52:0/818000668 conn(0x7f842806d320 msgr2=0x7f842806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 shutdown_connections 2023-10-01T01:33:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.923+0000 7f842f9b8640 1 -- 172.21.15.52:0/818000668 wait complete. 2023-10-01T01:33:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.927+0000 7f842f9b8640 1 Processor -- start 2023-10-01T01:33:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.927+0000 7f842f9b8640 1 -- start start 2023-10-01T01:33:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.927+0000 7f842f9b8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84280b4f50 0x7f84280b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84281f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8428159b70 0x7f84281f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84280b4f50 0x7f84280b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84280b4f50 0x7f84280b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.52:52712/0 (socket says 172.21.15.52:52712) 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842cf53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84281f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842cf53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84281f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:39030/0 (socket says 172.21.15.52:39030) 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 -- 172.21.15.52:0/1645531841 learned_addr learned my addr 172.21.15.52:0/1645531841 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281f2180 con 0x7f8428159b70 2023-10-01T01:33:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842df55640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8428159b70 0x7f84281f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842815d170 con 0x7f84280b4f50 2023-10-01T01:33:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842815c3b0 con 0x7f84280ced00 2023-10-01T01:33:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 -- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 msgr2=0x7f84281f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84281f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 -- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8428159b70 msgr2=0x7f84281f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8428159b70 0x7f84281f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418009420 con 0x7f84280b4f50 2023-10-01T01:33:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842cf53640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280ced00 0x7f84281f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842df55640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8428159b70 0x7f84281f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842d754640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84280b4f50 0x7f84280b0730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f842400c3c0 tx=0x7f842400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424005cf0 con 0x7f84280b4f50 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842815c690 con 0x7f84280b4f50 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842815cc50 con 0x7f84280b4f50 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84280cb390 con 0x7f84280b4f50 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8424005e50 con 0x7f84280b4f50 2023-10-01T01:33:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.931+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240072f0 con 0x7f84280b4f50 2023-10-01T01:33:47.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.939+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8424007450 con 0x7f84280b4f50 2023-10-01T01:33:47.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.939+0000 7f841dffb640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84140665e0 0x7f8414068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.939+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8424083490 con 0x7f84280b4f50 2023-10-01T01:33:47.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.939+0000 7f842cf53640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84140665e0 0x7f8414068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.943+0000 7f841dffb640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7f841406c440 0x7f841406e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:47.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.943+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f841406ef10 con 0x7f841406c440 2023-10-01T01:33:47.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.943+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84240838e0 con 0x7f84280b4f50 2023-10-01T01:33:47.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.943+0000 7f842df55640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7f841406c440 0x7f841406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:47.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.943+0000 7f842cf53640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84140665e0 0x7f8414068aa0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f84180b4000 tx=0x7f8418008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:47.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:47.943+0000 7f842df55640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7f841406c440 0x7f841406e860 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.339+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== osd.0 v2:172.21.15.52:6824/3968874267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f841406ef10 con 0x7f841406c440 2023-10-01T01:33:49.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 --> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8428072300 con 0x7f841406c440 2023-10-01T01:33:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f841dffb640 1 -- 172.21.15.52:0/1645531841 <== osd.0 v2:172.21.15.52:6824/3968874267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8420007870 con 0x7f841406c440 2023-10-01T01:33:49.372 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:49.372 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:49.372 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7f841406c440 msgr2=0x7f841406e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.52:6824/3968874267,v1:172.21.15.52:6825/3968874267] conn(0x7f841406c440 0x7f841406e860 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84140665e0 msgr2=0x7f8414068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f84140665e0 0x7f8414068aa0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f84180b4000 tx=0x7f8418008040 comp rx=0 tx=0).stop 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84280b4f50 msgr2=0x7f84280b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 --2- 172.21.15.52:0/1645531841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84280b4f50 0x7f84280b0730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f842400c3c0 tx=0x7f842400c880 comp rx=0 tx=0).stop 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842df55640 1 -- 172.21.15.52:0/1645531841 reap_dead start 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 shutdown_connections 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 >> 172.21.15.52:0/1645531841 conn(0x7f842806d320 msgr2=0x7f84280ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 shutdown_connections 2023-10-01T01:33:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.363+0000 7f842f9b8640 1 -- 172.21.15.52:0/1645531841 wait complete. 2023-10-01T01:33:49.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-01T01:33:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 Processor -- start 2023-10-01T01:33:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 -- start start 2023-10-01T01:33:49.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9244159b70 0x7f92440cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92440b4f50 0x7f92440ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92440cef80 con 0x7f92440ceb30 2023-10-01T01:33:49.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92440ce290 con 0x7f92440b4f50 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924aa81640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92440cb700 con 0x7f9244159b70 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92440b4f50 0x7f92440ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92440b4f50 0x7f92440ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39844/0 (socket says 172.21.15.52:39844) 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 -- 172.21.15.52:0/2232379833 learned_addr learned my addr 172.21.15.52:0/2232379833 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924881d640 1 --2- 172.21.15.52:0/2232379833 >> v2:172.21.15.186:3300/0 conn(0x7f9244159b70 0x7f92440cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 -- 172.21.15.52:0/2232379833 >> v2:172.21.15.186:3300/0 conn(0x7f9244159b70 msgr2=0x7f92440cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 --2- 172.21.15.52:0/2232379833 >> v2:172.21.15.186:3300/0 conn(0x7f9244159b70 0x7f92440cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 -- 172.21.15.52:0/2232379833 >> v1:172.21.15.52:6789/0 conn(0x7f92440ceb30 legacy=0x7f924406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:49.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f9243fff640 1 -- 172.21.15.52:0/2232379833 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244159f50 con 0x7f92440b4f50 2023-10-01T01:33:49.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.491+0000 7f924881d640 1 --2- 172.21.15.52:0/2232379833 >> v2:172.21.15.186:3300/0 conn(0x7f9244159b70 0x7f92440cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T01:33:49.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f9243fff640 1 --2- 172.21.15.52:0/2232379833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f92440ce5f0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9244070b90 tx=0x7f923001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c518ebeeb9f5ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f92437fe640 1 -- 172.21.15.52:0/2232379833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a89b0 con 0x7f92440b4f50 2023-10-01T01:33:49.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f92437fe640 1 -- 172.21.15.52:0/2232379833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300a8b10 con 0x7f92440b4f50 2023-10-01T01:33:49.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f92437fe640 1 -- 172.21.15.52:0/2232379833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a8ea0 con 0x7f92440b4f50 2023-10-01T01:33:49.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 -- 172.21.15.52:0/2232379833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 msgr2=0x7f92440ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 --2- 172.21.15.52:0/2232379833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f92440ce5f0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9244070b90 tx=0x7f923001ecb0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 -- 172.21.15.52:0/2232379833 shutdown_connections 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 --2- 172.21.15.52:0/2232379833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f92440ce5f0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 --2- 172.21.15.52:0/2232379833 >> v2:172.21.15.186:3300/0 conn(0x7f9244159b70 0x7f92440cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 -- 172.21.15.52:0/2232379833 >> 172.21.15.52:0/2232379833 conn(0x7f924406d320 msgr2=0x7f924406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 -- 172.21.15.52:0/2232379833 shutdown_connections 2023-10-01T01:33:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.495+0000 7f924aa81640 1 -- 172.21.15.52:0/2232379833 wait complete. 2023-10-01T01:33:49.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 Processor -- start 2023-10-01T01:33:49.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- start start 2023-10-01T01:33:49.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f924414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92440ceb30 0x7f92440c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9244159b70 0x7f92440c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92440c3fd0 con 0x7f92440b4f50 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92440c42b0 con 0x7f9244159b70 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92440c4590 con 0x7f92440ceb30 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f924414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f924414f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39852/0 (socket says 172.21.15.52:39852) 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 -- 172.21.15.52:0/1377781790 learned_addr learned my addr 172.21.15.52:0/1377781790 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:49.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924901e640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9244159b70 0x7f92440c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f9243fff640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92440ceb30 0x7f92440c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 -- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92440ceb30 msgr2=0x7f92440c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92440ceb30 0x7f92440c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 -- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9244159b70 msgr2=0x7f92440c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9244159b70 0x7f92440c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 -- 172.21.15.52:0/1377781790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300094d0 con 0x7f92440b4f50 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924901e640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9244159b70 0x7f92440c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T01:33:49.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924881d640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f924414f1d0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f923800e810 tx=0x7f923800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800c8d0 con 0x7f92440b4f50 2023-10-01T01:33:49.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800ca30 con 0x7f92440b4f50 2023-10-01T01:33:49.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92440c4870 con 0x7f92440b4f50 2023-10-01T01:33:49.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800cde0 con 0x7f92440b4f50 2023-10-01T01:33:49.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924414f710 con 0x7f92440b4f50 2023-10-01T01:33:49.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.499+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92440740a0 con 0x7f92440b4f50 2023-10-01T01:33:49.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.503+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f9238013410 con 0x7f92440b4f50 2023-10-01T01:33:49.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.503+0000 7f92417fa640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9228066160 0x7f9228068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.503+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f92380838f0 con 0x7f92440b4f50 2023-10-01T01:33:49.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.503+0000 7f9243fff640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9228066160 0x7f9228068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.503+0000 7f9243fff640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9228066160 0x7f9228068620 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f92300b2000 tx=0x7f9230008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.511+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f9238051210 con 0x7f92440b4f50 2023-10-01T01:33:49.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.699+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9244072300 con 0x7f9228066160 2023-10-01T01:33:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f92417fa640 1 -- 172.21.15.52:0/1377781790 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92300b0440 con 0x7f9228066160 2023-10-01T01:33:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2023-10-01T01:33:49.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9228066160 msgr2=0x7f9228068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9228066160 0x7f9228068620 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f92300b2000 tx=0x7f9230008040 comp rx=0 tx=0).stop 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 msgr2=0x7f924414f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f924414f1d0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f923800e810 tx=0x7f923800ecd0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 shutdown_connections 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f9228066160 0x7f9228068620 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9244159b70 0x7f92440c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92440ceb30 0x7f92440c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 --2- 172.21.15.52:0/1377781790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92440b4f50 0x7f924414f1d0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 >> 172.21.15.52:0/1377781790 conn(0x7f924406d320 msgr2=0x7f92440cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 shutdown_connections 2023-10-01T01:33:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.787+0000 7f924aa81640 1 -- 172.21.15.52:0/1377781790 wait complete. 2023-10-01T01:33:49.819 INFO:tasks.ceph:Scrubbing osd.1 2023-10-01T01:33:49.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:49.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.959+0000 7ff0563b7640 1 Processor -- start 2023-10-01T01:33:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.959+0000 7ff0563b7640 1 -- start start 2023-10-01T01:33:49.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff0563b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff0501600a0 0x7ff05006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff0563b7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff05006b660 0x7ff0500b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff0563b7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500b2ca0 con 0x7ff0500b2850 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff0563b7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05006c440 con 0x7ff05006b660 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff0563b7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500caf90 con 0x7ff0501600a0 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04f7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff05006b660 0x7ff0500b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff054954640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff0500b2850 0x7ff05006fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38752/0 (socket says 172.21.15.52:38752) 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff054954640 1 -- 172.21.15.52:0/1705500093 learned_addr learned my addr 172.21.15.52:0/1705500093 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:49.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04ffff640 1 --2- 172.21.15.52:0/1705500093 >> v2:172.21.15.186:3300/0 conn(0x7ff0501600a0 0x7ff05006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04f7fe640 1 -- 172.21.15.52:0/1705500093 >> v2:172.21.15.186:3300/0 conn(0x7ff0501600a0 msgr2=0x7ff05006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04f7fe640 1 --2- 172.21.15.52:0/1705500093 >> v2:172.21.15.186:3300/0 conn(0x7ff0501600a0 0x7ff05006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04f7fe640 1 -- 172.21.15.52:0/1705500093 >> v1:172.21.15.52:6789/0 conn(0x7ff0500b2850 legacy=0x7ff05006fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04f7fe640 1 -- 172.21.15.52:0/1705500093 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500cb230 con 0x7ff05006b660 2023-10-01T01:33:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04f7fe640 1 --2- 172.21.15.52:0/1705500093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff05006b660 0x7ff0500b2310 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7ff050073bf0 tx=0x7ff04401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e5baa7a0ef097a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04effd640 1 -- 172.21.15.52:0/1705500093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440a8950 con 0x7ff05006b660 2023-10-01T01:33:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04effd640 1 -- 172.21.15.52:0/1705500093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0440a8ab0 con 0x7ff05006b660 2023-10-01T01:33:49.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.963+0000 7ff04effd640 1 -- 172.21.15.52:0/1705500093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440a8e40 con 0x7ff05006b660 2023-10-01T01:33:49.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/1705500093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff05006b660 msgr2=0x7ff0500b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 --2- 172.21.15.52:0/1705500093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff05006b660 0x7ff0500b2310 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7ff050073bf0 tx=0x7ff04401ec50 comp rx=0 tx=0).stop 2023-10-01T01:33:49.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/1705500093 shutdown_connections 2023-10-01T01:33:49.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 --2- 172.21.15.52:0/1705500093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff05006b660 0x7ff0500b2310 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 --2- 172.21.15.52:0/1705500093 >> v2:172.21.15.186:3300/0 conn(0x7ff0501600a0 0x7ff05006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/1705500093 >> 172.21.15.52:0/1705500093 conn(0x7ff0500cd310 msgr2=0x7ff0500cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:49.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/1705500093 shutdown_connections 2023-10-01T01:33:49.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/1705500093 wait complete. 2023-10-01T01:33:49.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 Processor -- start 2023-10-01T01:33:49.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- start start 2023-10-01T01:33:49.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff05006b660 0x7ff0500c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0500b2850 0x7ff0500c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0501600a0 0x7ff0501f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c9990 con 0x7ff0501600a0 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05014a9a0 con 0x7ff05006b660 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500ca4d0 con 0x7ff0500b2850 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0501600a0 0x7ff0501f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0501600a0 0x7ff0501f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39868/0 (socket says 172.21.15.52:39868) 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 -- 172.21.15.52:0/3691247185 learned_addr learned my addr 172.21.15.52:0/3691247185 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff04ffff640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff05006b660 0x7ff0500c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff04f7fe640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0500b2850 0x7ff0500c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 -- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0500b2850 msgr2=0x7ff0500c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0500b2850 0x7ff0500c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 -- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff05006b660 msgr2=0x7ff0500c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff05006b660 0x7ff0500c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 -- 172.21.15.52:0/3691247185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044009420 con 0x7ff0501600a0 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff04ffff640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff05006b660 0x7ff0500c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff054954640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0501600a0 0x7ff0501f29d0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7ff04800ca70 tx=0x7ff04800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800abd0 con 0x7ff0501600a0 2023-10-01T01:33:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04800ad30 con 0x7ff0501600a0 2023-10-01T01:33:49.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/3691247185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500c9ba0 con 0x7ff0501600a0 2023-10-01T01:33:49.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048012600 con 0x7ff0501600a0 2023-10-01T01:33:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.967+0000 7ff0563b7640 1 -- 172.21.15.52:0/3691247185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500ca160 con 0x7ff0501600a0 2023-10-01T01:33:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff028000fd0 con 0x7ff0501600a0 2023-10-01T01:33:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff048007070 con 0x7ff0501600a0 2023-10-01T01:33:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff03c066160 0x7ff03c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff0480833c0 con 0x7ff0501600a0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7ff03c06bfc0 0x7ff03c06e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 --> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff03c06ea90 con 0x7ff03c06bfc0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff048085a80 con 0x7ff0501600a0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04ffff640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff03c066160 0x7ff03c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04f7fe640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7ff03c06bfc0 0x7ff03c06e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04f7fe640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7ff03c06bfc0 0x7ff03c06e3e0 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04ffff640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff03c066160 0x7ff03c068620 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff04000b9f0 tx=0x7ff040008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:49.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.971+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== osd.1 v2:172.21.15.52:6800/2774169000 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff03c06ea90 con 0x7ff03c06bfc0 2023-10-01T01:33:49.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 --> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff028002c60 con 0x7ff03c06bfc0 2023-10-01T01:33:49.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff04cff9640 1 -- 172.21.15.52:0/3691247185 <== osd.1 v2:172.21.15.52:6800/2774169000 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff028002c60 con 0x7ff03c06bfc0 2023-10-01T01:33:49.993 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:49.993 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:49.993 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:49.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7ff03c06bfc0 msgr2=0x7ff03c06e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:6800/2774169000,v1:172.21.15.52:6801/2774169000] conn(0x7ff03c06bfc0 0x7ff03c06e3e0 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff03c066160 msgr2=0x7ff03c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff03c066160 0x7ff03c068620 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff04000b9f0 tx=0x7ff040008040 comp rx=0 tx=0).stop 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0501600a0 msgr2=0x7ff0501f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 --2- 172.21.15.52:0/3691247185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0501600a0 0x7ff0501f29d0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7ff04800ca70 tx=0x7ff04800cf30 comp rx=0 tx=0).stop 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff054954640 1 -- 172.21.15.52:0/3691247185 reap_dead start 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 shutdown_connections 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 >> 172.21.15.52:0/3691247185 conn(0x7ff0500cd310 msgr2=0x7ff05015cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:49.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 shutdown_connections 2023-10-01T01:33:49.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:49.987+0000 7ff0367fc640 1 -- 172.21.15.52:0/3691247185 wait complete. 2023-10-01T01:33:50.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-01T01:33:50.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 Processor -- start 2023-10-01T01:33:50.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 -- start start 2023-10-01T01:33:50.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7404159b70 0x7f74040cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f74040b4f50 0x7f74040ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74040cb700 con 0x7f74040ceb30 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040cefe0 con 0x7f74040b4f50 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f740afac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74040ce290 con 0x7f7404159b70 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f74040b4f50 0x7f74040ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f74040b4f50 0x7f74040ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39882/0 (socket says 172.21.15.52:39882) 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 -- 172.21.15.52:0/3848719958 learned_addr learned my addr 172.21.15.52:0/3848719958 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7408d48640 1 --2- 172.21.15.52:0/3848719958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7404159b70 0x7f74040cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 -- 172.21.15.52:0/3848719958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7404159b70 msgr2=0x7f74040cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 --2- 172.21.15.52:0/3848719958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7404159b70 0x7f74040cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 -- 172.21.15.52:0/3848719958 >> v1:172.21.15.52:6789/0 conn(0x7f74040ceb30 legacy=0x7f740406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f74037fe640 1 -- 172.21.15.52:0/3848719958 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044014345 0 0) 0x7f74040cb700 con 0x7f74040ceb30 2023-10-01T01:33:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 -- 172.21.15.52:0/3848719958 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404159f50 con 0x7f74040b4f50 2023-10-01T01:33:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.111+0000 7f7403fff640 1 --2- 172.21.15.52:0/3848719958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040b4f50 0x7f74040ce5f0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009870 tx=0x7f73f001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b604d66d1832f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f74037fe640 1 -- 172.21.15.52:0/3848719958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a8a30 con 0x7f74040b4f50 2023-10-01T01:33:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f74037fe640 1 -- 172.21.15.52:0/3848719958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00a8b90 con 0x7f74040b4f50 2023-10-01T01:33:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f74037fe640 1 -- 172.21.15.52:0/3848719958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00b0440 con 0x7f74040b4f50 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 -- 172.21.15.52:0/3848719958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040b4f50 msgr2=0x7f74040ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 --2- 172.21.15.52:0/3848719958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040b4f50 0x7f74040ce5f0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009870 tx=0x7f73f001ed30 comp rx=0 tx=0).stop 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 -- 172.21.15.52:0/3848719958 shutdown_connections 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 --2- 172.21.15.52:0/3848719958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040b4f50 0x7f74040ce5f0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 --2- 172.21.15.52:0/3848719958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7404159b70 0x7f74040cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 -- 172.21.15.52:0/3848719958 >> 172.21.15.52:0/3848719958 conn(0x7f740406d320 msgr2=0x7f740406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 -- 172.21.15.52:0/3848719958 shutdown_connections 2023-10-01T01:33:50.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 -- 172.21.15.52:0/3848719958 wait complete. 2023-10-01T01:33:50.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 Processor -- start 2023-10-01T01:33:50.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 -- start start 2023-10-01T01:33:50.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74040ceb30 0x7f74040c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.115+0000 7f740afac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 0x7f74040c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 0x7f74040c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 0x7f74040c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39896/0 (socket says 172.21.15.52:39896) 2023-10-01T01:33:50.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 -- 172.21.15.52:0/1221842858 learned_addr learned my addr 172.21.15.52:0/1221842858 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:50.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7404147330 0x7f740414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040c7bc0 con 0x7f7404159b70 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74040c97c0 con 0x7f7404147330 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74040c9520 con 0x7f74040ceb30 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7408d48640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74040ceb30 0x7f74040c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7409549640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7404147330 0x7f740414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 -- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74040ceb30 msgr2=0x7f74040c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74040ceb30 0x7f74040c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 -- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7404147330 msgr2=0x7f740414bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7404147330 0x7f740414bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00094d0 con 0x7f7404159b70 2023-10-01T01:33:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f7403fff640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 0x7f74040c8fe0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f73f00b3040 tx=0x7f73f001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a8a30 con 0x7f7404159b70 2023-10-01T01:33:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00bb480 con 0x7f7404159b70 2023-10-01T01:33:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74040b24a0 con 0x7f7404159b70 2023-10-01T01:33:50.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00bb850 con 0x7f7404159b70 2023-10-01T01:33:50.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74040b2a60 con 0x7f7404159b70 2023-10-01T01:33:50.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74040740a0 con 0x7f7404159b70 2023-10-01T01:33:50.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.119+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f73f00bb9b0 con 0x7f7404159b70 2023-10-01T01:33:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.123+0000 7f74017fa640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73e8066160 0x7f73e8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.123+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f73f0121e60 con 0x7f7404159b70 2023-10-01T01:33:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.123+0000 7f7408d48640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73e8066160 0x7f73e8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.123+0000 7f7408d48640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73e8066160 0x7f73e8068620 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007a60 tx=0x7f73f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.131+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f73f00ef8a0 con 0x7f7404159b70 2023-10-01T01:33:50.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7404072300 con 0x7f73e8066160 2023-10-01T01:33:50.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f74017fa640 1 -- 172.21.15.52:0/1221842858 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f73f8010990 con 0x7f73e8066160 2023-10-01T01:33:50.290 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73e8066160 msgr2=0x7f73e8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73e8066160 0x7f73e8068620 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007a60 tx=0x7f73f8008040 comp rx=0 tx=0).stop 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 msgr2=0x7f74040c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 0x7f74040c8fe0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f73f00b3040 tx=0x7f73f001bad0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 shutdown_connections 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f73e8066160 0x7f73e8068620 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7404147330 0x7f740414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7404159b70 0x7f74040c8fe0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 --2- 172.21.15.52:0/1221842858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74040ceb30 0x7f74040c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 >> 172.21.15.52:0/1221842858 conn(0x7f740406d320 msgr2=0x7f74041508d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 shutdown_connections 2023-10-01T01:33:50.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.283+0000 7f740afac640 1 -- 172.21.15.52:0/1221842858 wait complete. 2023-10-01T01:33:50.307 INFO:tasks.ceph:Scrubbing osd.2 2023-10-01T01:33:50.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 Processor -- start 2023-10-01T01:33:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 -- start start 2023-10-01T01:33:50.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcd0c06e7e0 0x7fcd0c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fcd0c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c15de20 con 0x7fcd0c0c4cc0 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c06eda0 con 0x7fcd0c06e7e0 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd12936640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c15d060 con 0x7fcd0c0c4770 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd0bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcd0c0c4cc0 0x7fcd0c0c50a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38774/0 (socket says 172.21.15.52:38774) 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd0bfff640 1 -- 172.21.15.52:0/3911126461 learned_addr learned my addr 172.21.15.52:0/3911126461 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:50.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd0b7fe640 1 --2- 172.21.15.52:0/3911126461 >> v2:172.21.15.186:3300/0 conn(0x7fcd0c06e7e0 0x7fcd0c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.431+0000 7fcd10ed3640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fcd0c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009502325 0 0) 0x7fcd0c15de20 con 0x7fcd0c0c4cc0 2023-10-01T01:33:50.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf4003530 con 0x7fcd0c0c4cc0 2023-10-01T01:33:50.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 774367206 0 0) 0x7fccf4003530 con 0x7fcd0c0c4cc0 2023-10-01T01:33:50.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 msgr2=0x7fcd0c0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fcd0c0cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 >> v2:172.21.15.186:3300/0 conn(0x7fcd0c06e7e0 msgr2=0x7fcd0c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 --2- 172.21.15.52:0/3911126461 >> v2:172.21.15.186:3300/0 conn(0x7fcd0c06e7e0 0x7fcd0c0cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c15d340 con 0x7fcd0c0c4cc0 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fccfc001680 con 0x7fcd0c0c4cc0 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 >> v1:172.21.15.52:6789/0 conn(0x7fcd0c0c4cc0 legacy=0x7fcd0c0c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccf4003980 0x7fccf4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fccf40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4004d10 0x7fccf4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c06eda0 con 0x7fccf4003980 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c15d060 con 0x7fccf4004d10 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf400b990 con 0x7fcd0c0c4770 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccf4003980 0x7fccf4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd10ed3640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4004d10 0x7fccf4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0b7fe640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fccf40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0bfff640 1 -- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 msgr2=0x7fccf40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fccf40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0bfff640 1 -- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4004d10 msgr2=0x7fccf4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4004d10 0x7fccf4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0bfff640 1 -- 172.21.15.52:0/3911126461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4003530 con 0x7fccf4003980 2023-10-01T01:33:50.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.435+0000 7fcd0b7fe640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c0c4770 0x7fccf40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:50.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccf4003980 0x7fccf4003da0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00d220 tx=0x7fccfc01de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d693b4631c043a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0a6de0 con 0x7fccf4003980 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc0aa070 con 0x7fccf4003980 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd0affd640 1 -- 172.21.15.52:0/3911126461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc005b00 con 0x7fccf4003980 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 -- 172.21.15.52:0/3911126461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccf4003980 msgr2=0x7fccf4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 --2- 172.21.15.52:0/3911126461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccf4003980 0x7fccf4003da0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00d220 tx=0x7fccfc01de60 comp rx=0 tx=0).stop 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd10ed3640 1 -- 172.21.15.52:0/3911126461 reap_dead start 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 -- 172.21.15.52:0/3911126461 shutdown_connections 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 -- 172.21.15.52:0/3911126461 >> 172.21.15.52:0/3911126461 conn(0x7fcd0c0b0b80 msgr2=0x7fcd0c0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 -- 172.21.15.52:0/3911126461 shutdown_connections 2023-10-01T01:33:50.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 -- 172.21.15.52:0/3911126461 wait complete. 2023-10-01T01:33:50.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 Processor -- start 2023-10-01T01:33:50.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.439+0000 7fcd12936640 1 -- start start 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4003980 0x7fcd0c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c1f4d00 0x7fcd0c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c15a120 0x7fcd0c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c159d00 con 0x7fcd0c15a120 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c159990 con 0x7fccf4003980 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c1f5530 con 0x7fcd0c1f4d00 2023-10-01T01:33:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c15a120 0x7fcd0c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c15a120 0x7fcd0c15ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39912/0 (socket says 172.21.15.52:39912) 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 -- 172.21.15.52:0/3001680741 learned_addr learned my addr 172.21.15.52:0/3001680741 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd0b7fe640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c1f4d00 0x7fcd0c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4003980 0x7fcd0c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 -- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c1f4d00 msgr2=0x7fcd0c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd0c1f4d00 0x7fcd0c0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 -- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4003980 msgr2=0x7fcd0c15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf4003980 0x7fcd0c15e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 -- 172.21.15.52:0/3001680741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c1f5810 con 0x7fcd0c15a120 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd10ed3640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c15a120 0x7fcd0c15ef20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0ccee0 tx=0x7fcd04011730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04003ba0 con 0x7fcd0c15a120 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04003d00 con 0x7fcd0c15a120 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c1f5af0 con 0x7fcd0c15a120 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04004270 con 0x7fcd0c15a120 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c0b41e0 con 0x7fcd0c15a120 2023-10-01T01:33:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd0c0c41b0 con 0x7fcd0c15a120 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fcd040043d0 con 0x7fcd0c15a120 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fccf8066160 0x7fccf8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcd04086580 con 0x7fcd0c15a120 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7fccf806bfc0 0x7fccf806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.443+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 --> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccf806ea90 con 0x7fccf806bfc0 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.447+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd04088c40 con 0x7fcd0c15a120 2023-10-01T01:33:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.447+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fccf8066160 0x7fccf8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.447+0000 7fcd0b7fe640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7fccf806bfc0 0x7fccf806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.447+0000 7fcd0b7fe640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7fccf806bfc0 0x7fccf806e3e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.447+0000 7fcd0bfff640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fccf8066160 0x7fccf8068620 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0ac000 tx=0x7fccfc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.447+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== osd.2 v2:172.21.15.52:6808/2011916612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fccf806ea90 con 0x7fccf806bfc0 2023-10-01T01:33:50.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 --> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcd0c159e40 con 0x7fccf806bfc0 2023-10-01T01:33:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd08ff9640 1 -- 172.21.15.52:0/3001680741 <== osd.2 v2:172.21.15.52:6808/2011916612 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcd0c159e40 con 0x7fccf806bfc0 2023-10-01T01:33:50.467 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:50.467 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:50.467 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:50.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7fccf806bfc0 msgr2=0x7fccf806e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:6808/2011916612,v1:172.21.15.52:6810/2011916612] conn(0x7fccf806bfc0 0x7fccf806e3e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fccf8066160 msgr2=0x7fccf8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fccf8066160 0x7fccf8068620 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0ac000 tx=0x7fccfc009040 comp rx=0 tx=0).stop 2023-10-01T01:33:50.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c15a120 msgr2=0x7fcd0c15ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 --2- 172.21.15.52:0/3001680741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd0c15a120 0x7fcd0c15ef20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0ccee0 tx=0x7fcd04011730 comp rx=0 tx=0).stop 2023-10-01T01:33:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd10ed3640 1 -- 172.21.15.52:0/3001680741 reap_dead start 2023-10-01T01:33:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 shutdown_connections 2023-10-01T01:33:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 >> 172.21.15.52:0/3001680741 conn(0x7fcd0c0b0b80 msgr2=0x7fcd0c157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 shutdown_connections 2023-10-01T01:33:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.459+0000 7fcd12936640 1 -- 172.21.15.52:0/3001680741 wait complete. 2023-10-01T01:33:50.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-01T01:33:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 Processor -- start 2023-10-01T01:33:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 -- start start 2023-10-01T01:33:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015bee0 0x7fe9e00ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9e015ee20 0x7fe9e00cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00ccfe0 con 0x7fe9e015f260 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e00cca20 con 0x7fe9e015ee20 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9e544a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00ccd00 con 0x7fe9e015bee0 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9e015ee20 0x7fe9e00cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe9e015ee20 0x7fe9e00cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39922/0 (socket says 172.21.15.52:39922) 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 -- 172.21.15.52:0/1517052720 learned_addr learned my addr 172.21.15.52:0/1517052720 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9deffd640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015bee0 0x7fe9e00ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 -- 172.21.15.52:0/1517052720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015bee0 msgr2=0x7fe9e00ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015bee0 0x7fe9e00ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 -- 172.21.15.52:0/1517052720 >> v1:172.21.15.186:6789/0 conn(0x7fe9e015f260 legacy=0x7fe9e0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9de7fc640 1 -- 172.21.15.52:0/1517052720 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e015e620 con 0x7fe9e015ee20 2023-10-01T01:33:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.587+0000 7fe9deffd640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015bee0 0x7fe9e00ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9de7fc640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015ee20 0x7fe9e00cc080 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009870 tx=0x7fe9d401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ccaca9ab860106 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9ddffb640 1 -- 172.21.15.52:0/1517052720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40ac630 con 0x7fe9e015ee20 2023-10-01T01:33:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9ddffb640 1 -- 172.21.15.52:0/1517052720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40ac790 con 0x7fe9e015ee20 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9ddffb640 1 -- 172.21.15.52:0/1517052720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40acb20 con 0x7fe9e015ee20 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 -- 172.21.15.52:0/1517052720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015ee20 msgr2=0x7fe9e00cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015ee20 0x7fe9e00cc080 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009870 tx=0x7fe9d401c500 comp rx=0 tx=0).stop 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 -- 172.21.15.52:0/1517052720 shutdown_connections 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015ee20 0x7fe9e00cc080 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 --2- 172.21.15.52:0/1517052720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015bee0 0x7fe9e00ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 -- 172.21.15.52:0/1517052720 >> 172.21.15.52:0/1517052720 conn(0x7fe9e006d320 msgr2=0x7fe9e006d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 -- 172.21.15.52:0/1517052720 shutdown_connections 2023-10-01T01:33:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 -- 172.21.15.52:0/1517052720 wait complete. 2023-10-01T01:33:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 Processor -- start 2023-10-01T01:33:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.591+0000 7fe9e544a640 1 -- start start 2023-10-01T01:33:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 0x7fe9e00cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015ee20 0x7fe9e014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e015f260 0x7fe9e0150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015c480 con 0x7fe9e015bee0 2023-10-01T01:33:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e014e310 con 0x7fe9e015f260 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e014e5f0 con 0x7fe9e015ee20 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 0x7fe9e00cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 0x7fe9e00cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39938/0 (socket says 172.21.15.52:39938) 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 -- 172.21.15.52:0/395729170 learned_addr learned my addr 172.21.15.52:0/395729170 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9df7fe640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e015f260 0x7fe9e0150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9de7fc640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015ee20 0x7fe9e014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 -- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015ee20 msgr2=0x7fe9e014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015ee20 0x7fe9e014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 -- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e015f260 msgr2=0x7fe9e0150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e015f260 0x7fe9e0150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 -- 172.21.15.52:0/395729170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d40094d0 con 0x7fe9e015bee0 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9deffd640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 0x7fe9e00cdbe0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c7c0 tx=0x7fe9d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0007a30 con 0x7fe9e015bee0 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d0007b90 con 0x7fe9e015bee0 2023-10-01T01:33:50.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000ce70 con 0x7fe9e015bee0 2023-10-01T01:33:50.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e014e8d0 con 0x7fe9e015bee0 2023-10-01T01:33:50.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e014df20 con 0x7fe9e015bee0 2023-10-01T01:33:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.595+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e00740a0 con 0x7fe9e015bee0 2023-10-01T01:33:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.599+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fe9d00113f0 con 0x7fe9e015bee0 2023-10-01T01:33:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.599+0000 7fe9c77fe640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe9cc066130 0x7fe9cc0685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.599+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe9d0083c80 con 0x7fe9e015bee0 2023-10-01T01:33:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.599+0000 7fe9de7fc640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe9cc066130 0x7fe9cc0685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.599+0000 7fe9de7fc640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe9cc066130 0x7fe9cc0685f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40ae000 tx=0x7fe9d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.607+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fe9d00517c0 con 0x7fe9e015bee0 2023-10-01T01:33:50.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9e014e760 con 0x7fe9cc066130 2023-10-01T01:33:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9c77fe640 1 -- 172.21.15.52:0/395729170 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe9e014e760 con 0x7fe9cc066130 2023-10-01T01:33:50.770 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2023-10-01T01:33:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe9cc066130 msgr2=0x7fe9cc0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe9cc066130 0x7fe9cc0685f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40ae000 tx=0x7fe9d4008040 comp rx=0 tx=0).stop 2023-10-01T01:33:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 msgr2=0x7fe9e00cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 0x7fe9e00cdbe0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c7c0 tx=0x7fe9d000cc80 comp rx=0 tx=0).stop 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 shutdown_connections 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fe9cc066130 0x7fe9cc0685f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e015f260 0x7fe9e0150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015ee20 0x7fe9e014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 --2- 172.21.15.52:0/395729170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e015bee0 0x7fe9e00cdbe0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 >> 172.21.15.52:0/395729170 conn(0x7fe9e006d320 msgr2=0x7fe9e0152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 shutdown_connections 2023-10-01T01:33:50.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.763+0000 7fe9e544a640 1 -- 172.21.15.52:0/395729170 wait complete. 2023-10-01T01:33:50.789 INFO:tasks.ceph:Scrubbing osd.3 2023-10-01T01:33:50.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63faff640 1 Processor -- start 2023-10-01T01:33:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63faff640 1 -- start start 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63faff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6380b4f50 0x7fd6380cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63faff640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380cb700 con 0x7fd6380ced00 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63faff640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd638159f50 con 0x7fd638159b70 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63faff640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380ce290 con 0x7fd6380b4f50 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63d09a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd6380ced00 0x7fd6380cbb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38778/0 (socket says 172.21.15.52:38778) 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63d09a640 1 -- 172.21.15.52:0/1419558781 learned_addr learned my addr 172.21.15.52:0/1419558781 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:50.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63e09c640 1 --2- 172.21.15.52:0/1419558781 >> v2:172.21.15.52:3300/0 conn(0x7fd6380b4f50 0x7fd6380cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63c899640 1 -- 172.21.15.52:0/1419558781 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808450435 0 0) 0x7fd6380cb700 con 0x7fd6380ced00 2023-10-01T01:33:50.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63c899640 1 -- 172.21.15.52:0/1419558781 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd620003530 con 0x7fd6380ced00 2023-10-01T01:33:50.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63e09c640 1 -- 172.21.15.52:0/1419558781 >> v1:172.21.15.186:6789/0 conn(0x7fd638159b70 legacy=0x7fd6380ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:50.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63e09c640 1 -- 172.21.15.52:0/1419558781 >> v1:172.21.15.52:6789/0 conn(0x7fd6380ced00 legacy=0x7fd6380cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.907+0000 7fd63e09c640 1 -- 172.21.15.52:0/1419558781 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638072020 con 0x7fd6380b4f50 2023-10-01T01:33:50.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63e09c640 1 --2- 172.21.15.52:0/1419558781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380b4f50 0x7fd6380cdd50 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fd628009d90 tx=0x7fd62801f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1b71cdc92f275c server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63c899640 1 -- 172.21.15.52:0/1419558781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280af600 con 0x7fd6380b4f50 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63c899640 1 -- 172.21.15.52:0/1419558781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6280ab050 con 0x7fd6380b4f50 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63c899640 1 -- 172.21.15.52:0/1419558781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280af960 con 0x7fd6380b4f50 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 -- 172.21.15.52:0/1419558781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380b4f50 msgr2=0x7fd6380cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 --2- 172.21.15.52:0/1419558781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380b4f50 0x7fd6380cdd50 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fd628009d90 tx=0x7fd62801f100 comp rx=0 tx=0).stop 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 -- 172.21.15.52:0/1419558781 shutdown_connections 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 --2- 172.21.15.52:0/1419558781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380b4f50 0x7fd6380cdd50 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 -- 172.21.15.52:0/1419558781 >> 172.21.15.52:0/1419558781 conn(0x7fd63806d320 msgr2=0x7fd63806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 -- 172.21.15.52:0/1419558781 shutdown_connections 2023-10-01T01:33:50.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.911+0000 7fd63faff640 1 -- 172.21.15.52:0/1419558781 wait complete. 2023-10-01T01:33:50.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 Processor -- start 2023-10-01T01:33:50.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- start start 2023-10-01T01:33:50.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6380b4f50 0x7fd6380c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380ced00 0x7fd6380ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638159b70 0x7fd63814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380ada30 con 0x7fd6380ced00 2023-10-01T01:33:50.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380adc60 con 0x7fd638159b70 2023-10-01T01:33:50.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380adf40 con 0x7fd6380b4f50 2023-10-01T01:33:50.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380ced00 0x7fd6380ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380ced00 0x7fd6380ad4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39956/0 (socket says 172.21.15.52:39956) 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 -- 172.21.15.52:0/2726068202 learned_addr learned my addr 172.21.15.52:0/2726068202 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63e09c640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638159b70 0x7fd63814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 -- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6380b4f50 msgr2=0x7fd6380c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6380b4f50 0x7fd6380c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 -- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638159b70 msgr2=0x7fd63814dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638159b70 0x7fd63814dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 -- 172.21.15.52:0/2726068202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009a70 con 0x7fd6380ced00 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63d09a640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380ced00 0x7fd6380ad4f0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00c450 tx=0x7fd62c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c005cf0 con 0x7fd6380ced00 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c005e50 con 0x7fd6380ced00 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6380b2390 con 0x7fd6380ced00 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c007290 con 0x7fd6380ced00 2023-10-01T01:33:50.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6380b2950 con 0x7fd6380ced00 2023-10-01T01:33:50.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6380cb390 con 0x7fd6380ced00 2023-10-01T01:33:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fd62c0073f0 con 0x7fd6380ced00 2023-10-01T01:33:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd624066160 0x7fd624068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd62c0834b0 con 0x7fd6380ced00 2023-10-01T01:33:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fd62406bfc0 0x7fd62406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 --> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd62406ea90 con 0x7fd62406bfc0 2023-10-01T01:33:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.915+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd62c083900 con 0x7fd6380ced00 2023-10-01T01:33:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.919+0000 7fd63e09c640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fd62406bfc0 0x7fd62406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.919+0000 7fd63d89b640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd624066160 0x7fd624068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.919+0000 7fd63e09c640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fd62406bfc0 0x7fd62406e3e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.919+0000 7fd63d89b640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd624066160 0x7fd624068620 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd630007fd0 tx=0x7fd6300079a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.919+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== osd.3 v2:172.21.15.52:6809/2535336001 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd62406ea90 con 0x7fd62406bfc0 2023-10-01T01:33:50.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 --> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd638072300 con 0x7fd62406bfc0 2023-10-01T01:33:50.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd6367fc640 1 -- 172.21.15.52:0/2726068202 <== osd.3 v2:172.21.15.52:6809/2535336001 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd628003c40 con 0x7fd62406bfc0 2023-10-01T01:33:50.939 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:50.939 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:50.939 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:50.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fd62406bfc0 msgr2=0x7fd62406e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:6809/2535336001,v1:172.21.15.52:6811/2535336001] conn(0x7fd62406bfc0 0x7fd62406e3e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd624066160 msgr2=0x7fd624068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fd624066160 0x7fd624068620 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd630007fd0 tx=0x7fd6300079a0 comp rx=0 tx=0).stop 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380ced00 msgr2=0x7fd6380ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 --2- 172.21.15.52:0/2726068202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6380ced00 0x7fd6380ad4f0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00c450 tx=0x7fd62c00c910 comp rx=0 tx=0).stop 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63e09c640 1 -- 172.21.15.52:0/2726068202 reap_dead start 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 shutdown_connections 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 >> 172.21.15.52:0/2726068202 conn(0x7fd63806d320 msgr2=0x7fd63814fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 shutdown_connections 2023-10-01T01:33:50.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:50.931+0000 7fd63faff640 1 -- 172.21.15.52:0/2726068202 wait complete. 2023-10-01T01:33:50.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-01T01:33:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 Processor -- start 2023-10-01T01:33:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 -- start start 2023-10-01T01:33:51.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d80ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47d80cd080 0x7f47d80ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80ca8d0 con 0x7f47d8069e00 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d80cd920 con 0x7f47d80cd080 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47e074b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80ca5f0 con 0x7f47d80ccca0 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47d80cd080 0x7f47d80ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47d80cd080 0x7f47d80ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39964/0 (socket says 172.21.15.52:39964) 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 -- 172.21.15.52:0/660100041 learned_addr learned my addr 172.21.15.52:0/660100041 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47de4e7640 1 --2- 172.21.15.52:0/660100041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d80ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 -- 172.21.15.52:0/660100041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 msgr2=0x7f47d80ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 --2- 172.21.15.52:0/660100041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d80ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 -- 172.21.15.52:0/660100041 >> v1:172.21.15.186:6789/0 conn(0x7f47d8069e00 legacy=0x7f47d80afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.063+0000 7f47ddce6640 1 -- 172.21.15.52:0/660100041 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80af010 con 0x7f47d80cd080 2023-10-01T01:33:51.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47ddce6640 1 --2- 172.21.15.52:0/660100041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d80cd080 0x7f47d80ae740 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfe0de4428d057a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47dd4e5640 1 -- 172.21.15.52:0/660100041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab600 con 0x7f47d80cd080 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47dd4e5640 1 -- 172.21.15.52:0/660100041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80a7050 con 0x7f47d80cd080 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47dd4e5640 1 -- 172.21.15.52:0/660100041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab980 con 0x7f47d80cd080 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 -- 172.21.15.52:0/660100041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d80cd080 msgr2=0x7f47d80ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 --2- 172.21.15.52:0/660100041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d80cd080 0x7f47d80ae740 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c3b0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 -- 172.21.15.52:0/660100041 shutdown_connections 2023-10-01T01:33:51.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 --2- 172.21.15.52:0/660100041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d80cd080 0x7f47d80ae740 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 --2- 172.21.15.52:0/660100041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d80ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 -- 172.21.15.52:0/660100041 >> 172.21.15.52:0/660100041 conn(0x7f47d80cb8f0 msgr2=0x7f47d80cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 -- 172.21.15.52:0/660100041 shutdown_connections 2023-10-01T01:33:51.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 -- 172.21.15.52:0/660100041 wait complete. 2023-10-01T01:33:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 Processor -- start 2023-10-01T01:33:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.067+0000 7f47e074b640 1 -- start start 2023-10-01T01:33:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 0x7f47d8147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d8148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47d80cd080 0x7f47d8148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8155100 con 0x7f47d8069e00 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8155350 con 0x7f47d80cd080 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8155630 con 0x7f47d80ccca0 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 0x7f47d8147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 0x7f47d8147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39966/0 (socket says 172.21.15.52:39966) 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 -- 172.21.15.52:0/2873097876 learned_addr learned my addr 172.21.15.52:0/2873097876 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 -- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 msgr2=0x7f47d8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 -- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47d80cd080 msgr2=0x7f47d8148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47d80cd080 0x7f47d8148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 -- 172.21.15.52:0/2873097876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80094d0 con 0x7f47d8069e00 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47de4e7640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 0x7f47d8147ba0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f47d400c7f0 tx=0x7f47d400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004220 con 0x7f47d8069e00 2023-10-01T01:33:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d8155910 con 0x7f47d8069e00 2023-10-01T01:33:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d40043a0 con 0x7f47d8069e00 2023-10-01T01:33:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004510 con 0x7f47d8069e00 2023-10-01T01:33:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d8155ed0 con 0x7f47d8069e00 2023-10-01T01:33:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d8066180 con 0x7f47d8069e00 2023-10-01T01:33:51.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f47d4003a70 con 0x7f47d8069e00 2023-10-01T01:33:51.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ceffd640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47bc066160 0x7f47bc068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f47d4083710 con 0x7f47d8069e00 2023-10-01T01:33:51.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.071+0000 7f47ddce6640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47bc066160 0x7f47bc068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.075+0000 7f47ddce6640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47bc066160 0x7f47bc068620 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ad000 tx=0x7f47c8004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.079+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f47d4051040 con 0x7f47d8069e00 2023-10-01T01:33:51.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.235+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f47d80b0610 con 0x7f47bc066160 2023-10-01T01:33:51.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.235+0000 7f47ceffd640 1 -- 172.21.15.52:0/2873097876 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47c80ac690 con 0x7f47bc066160 2023-10-01T01:33:51.242 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2023-10-01T01:33:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.235+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47bc066160 msgr2=0x7f47bc068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.235+0000 7f47e074b640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47bc066160 0x7f47bc068620 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ad000 tx=0x7f47c8004740 comp rx=0 tx=0).stop 2023-10-01T01:33:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.235+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 msgr2=0x7f47d8147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.235+0000 7f47e074b640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 0x7f47d8147ba0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f47d400c7f0 tx=0x7f47d400ccb0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 shutdown_connections 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f47bc066160 0x7f47bc068620 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47d80cd080 0x7f47d8148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47d80ccca0 0x7f47d8148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 --2- 172.21.15.52:0/2873097876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47d8069e00 0x7f47d8147ba0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 >> 172.21.15.52:0/2873097876 conn(0x7f47d80cb8f0 msgr2=0x7f47d806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 shutdown_connections 2023-10-01T01:33:51.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.239+0000 7f47e074b640 1 -- 172.21.15.52:0/2873097876 wait complete. 2023-10-01T01:33:51.261 INFO:tasks.ceph:Scrubbing osd.4 2023-10-01T01:33:51.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d3bc3640 1 Processor -- start 2023-10-01T01:33:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d3bc3640 1 -- start start 2023-10-01T01:33:51.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d3bc3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44cc0b1b50 0x7f44cc160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d3bc3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc161530 con 0x7f44cc0cda60 2023-10-01T01:33:51.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d3bc3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc0d1700 con 0x7f44cc15c9a0 2023-10-01T01:33:51.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d3bc3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0b2430 con 0x7f44cc0b1b50 2023-10-01T01:33:51.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d2160640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44cc0b1b50 0x7f44cc160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d115e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f44cc0cda60 0x7f44cc0d2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38790/0 (socket says 172.21.15.52:38790) 2023-10-01T01:33:51.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.375+0000 7f44d115e640 1 -- 172.21.15.52:0/3622149799 learned_addr learned my addr 172.21.15.52:0/3622149799 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d2160640 1 -- 172.21.15.52:0/3622149799 >> v1:172.21.15.186:6789/0 conn(0x7f44cc15c9a0 legacy=0x7f44cc0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d2160640 1 -- 172.21.15.52:0/3622149799 >> v1:172.21.15.52:6789/0 conn(0x7f44cc0cda60 legacy=0x7f44cc0d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d095d640 1 -- 172.21.15.52:0/3622149799 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692983580 0 0) 0x7f44c0001120 con 0x7f44cc0cda60 2023-10-01T01:33:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d2160640 1 -- 172.21.15.52:0/3622149799 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0d0af0 con 0x7f44cc0b1b50 2023-10-01T01:33:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d2160640 1 --2- 172.21.15.52:0/3622149799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0b1b50 0x7f44cc160ff0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0097c0 tx=0x7f44bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a69ac2635a3d360 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d095d640 1 -- 172.21.15.52:0/3622149799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0ab650 con 0x7f44cc0b1b50 2023-10-01T01:33:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d095d640 1 -- 172.21.15.52:0/3622149799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc0ab7b0 con 0x7f44cc0b1b50 2023-10-01T01:33:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d095d640 1 -- 172.21.15.52:0/3622149799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0abb40 con 0x7f44cc0b1b50 2023-10-01T01:33:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3622149799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0b1b50 msgr2=0x7f44cc160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 --2- 172.21.15.52:0/3622149799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0b1b50 0x7f44cc160ff0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0097c0 tx=0x7f44bc01c450 comp rx=0 tx=0).stop 2023-10-01T01:33:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3622149799 shutdown_connections 2023-10-01T01:33:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 --2- 172.21.15.52:0/3622149799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0b1b50 0x7f44cc160ff0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3622149799 >> 172.21.15.52:0/3622149799 conn(0x7f44cc071930 msgr2=0x7f44cc071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3622149799 shutdown_connections 2023-10-01T01:33:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.379+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3622149799 wait complete. 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 Processor -- start 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- start start 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44cc0b1b50 0x7f44cc1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0cda60 0x7f44cc158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44cc15c9a0 0x7f44cc1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc15f700 con 0x7f44cc0cda60 2023-10-01T01:33:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc15f9e0 con 0x7f44cc15c9a0 2023-10-01T01:33:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc15fcc0 con 0x7f44cc0b1b50 2023-10-01T01:33:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0cda60 0x7f44cc158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0cda60 0x7f44cc158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39978/0 (socket says 172.21.15.52:39978) 2023-10-01T01:33:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 -- 172.21.15.52:0/3485006445 learned_addr learned my addr 172.21.15.52:0/3485006445 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d195f640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44cc0b1b50 0x7f44cc1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d2160640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44cc15c9a0 0x7f44cc1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 -- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44cc0b1b50 msgr2=0x7f44cc1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44cc0b1b50 0x7f44cc1542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 -- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44cc15c9a0 msgr2=0x7f44cc1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44cc15c9a0 0x7f44cc1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 -- 172.21.15.52:0/3485006445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc009420 con 0x7f44cc0cda60 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d2160640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44cc15c9a0 0x7f44cc1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d115e640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0cda60 0x7f44cc158090 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c780 tx=0x7f44c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00072d0 con 0x7f44cc0cda60 2023-10-01T01:33:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0007430 con 0x7f44cc0cda60 2023-10-01T01:33:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0001d20 con 0x7f44cc0cda60 2023-10-01T01:33:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc15ffa0 con 0x7f44cc0cda60 2023-10-01T01:33:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc1547f0 con 0x7f44cc0cda60 2023-10-01T01:33:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44cc15fb50 con 0x7f44cc0cda60 2023-10-01T01:33:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.383+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f44c00047f0 con 0x7f44cc0cda60 2023-10-01T01:33:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44ca7fc640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f44b8066190 0x7f44b8068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44c0082840 con 0x7f44cc0cda60 2023-10-01T01:33:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44ca7fc640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7f44b806bff0 0x7f44b806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 --> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44b806eac0 con 0x7f44b806bff0 2023-10-01T01:33:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44c00872c0 con 0x7f44cc0cda60 2023-10-01T01:33:51.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44d195f640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f44b8066190 0x7f44b8068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44d2160640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7f44b806bff0 0x7f44b806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44d2160640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7f44b806bff0 0x7f44b806e410 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44d195f640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f44b8066190 0x7f44b8068650 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f44c40012f0 tx=0x7f44c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.387+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== osd.4 v2:172.21.15.186:6800/2180915136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f44b806eac0 con 0x7f44b806bff0 2023-10-01T01:33:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.399+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 --> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f44cc0d1b70 con 0x7f44b806bff0 2023-10-01T01:33:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44ca7fc640 1 -- 172.21.15.52:0/3485006445 <== osd.4 v2:172.21.15.186:6800/2180915136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f44bc0ab5d0 con 0x7f44b806bff0 2023-10-01T01:33:51.410 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:51.410 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:51.410 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:51.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7f44b806bff0 msgr2=0x7f44b806e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6800/2180915136,v1:172.21.15.186:6801/2180915136] conn(0x7f44b806bff0 0x7f44b806e410 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f44b8066190 msgr2=0x7f44b8068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f44b8066190 0x7f44b8068650 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f44c40012f0 tx=0x7f44c4009040 comp rx=0 tx=0).stop 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0cda60 msgr2=0x7f44cc158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 --2- 172.21.15.52:0/3485006445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44cc0cda60 0x7f44cc158090 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c780 tx=0x7f44c000cc40 comp rx=0 tx=0).stop 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d2160640 1 -- 172.21.15.52:0/3485006445 reap_dead start 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 shutdown_connections 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 >> 172.21.15.52:0/3485006445 conn(0x7f44cc071930 msgr2=0x7f44cc0b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 shutdown_connections 2023-10-01T01:33:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.403+0000 7f44d3bc3640 1 -- 172.21.15.52:0/3485006445 wait complete. 2023-10-01T01:33:51.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-01T01:33:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 Processor -- start 2023-10-01T01:33:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 -- start start 2023-10-01T01:33:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f8815ad70 0x7f7f8806e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f88071100 0x7f7f88069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8806b4b0 con 0x7f7f880c3e60 2023-10-01T01:33:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880c4ec0 con 0x7f7f8815ad70 2023-10-01T01:33:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f8d8d9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8806ed70 con 0x7f7f88071100 2023-10-01T01:33:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f8815ad70 0x7f7f8806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f8815ad70 0x7f7f8806e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39992/0 (socket says 172.21.15.52:39992) 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 -- 172.21.15.52:0/1792904917 learned_addr learned my addr 172.21.15.52:0/1792904917 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 -- 172.21.15.52:0/1792904917 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f88071100 msgr2=0x7f7f88069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f877fe640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f88071100 0x7f7f88069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f88071100 0x7f7f88069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 -- 172.21.15.52:0/1792904917 >> v1:172.21.15.52:6789/0 conn(0x7f7f880c3e60 legacy=0x7f7f880709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f86ffd640 1 -- 172.21.15.52:0/1792904917 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880c4900 con 0x7f7f8815ad70 2023-10-01T01:33:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.527+0000 7f7f877fe640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f88071100 0x7f7f88069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f86ffd640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8815ad70 0x7f7f8806e830 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009870 tx=0x7f7f7801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd83677cc5f454d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f867fc640 1 -- 172.21.15.52:0/1792904917 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f780ac600 con 0x7f7f8815ad70 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f867fc640 1 -- 172.21.15.52:0/1792904917 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f780a8050 con 0x7f7f8815ad70 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f867fc640 1 -- 172.21.15.52:0/1792904917 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f780ac980 con 0x7f7f8815ad70 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/1792904917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8815ad70 msgr2=0x7f7f8806e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8815ad70 0x7f7f8806e830 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009870 tx=0x7f7f7801c4b0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/1792904917 shutdown_connections 2023-10-01T01:33:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f88071100 0x7f7f88069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/1792904917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8815ad70 0x7f7f8806e830 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/1792904917 >> 172.21.15.52:0/1792904917 conn(0x7f7f880cbb80 msgr2=0x7f7f880cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/1792904917 shutdown_connections 2023-10-01T01:33:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/1792904917 wait complete. 2023-10-01T01:33:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 Processor -- start 2023-10-01T01:33:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- start start 2023-10-01T01:33:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 0x7f7f8814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f880c3e60 0x7f7f880b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f8815ad70 0x7f7f880b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880c77b0 con 0x7f7f88071100 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b4320 con 0x7f7f880c3e60 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.531+0000 7f7f8d8d9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880c6ba0 con 0x7f7f8815ad70 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 0x7f7f8814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 0x7f7f8814d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40004/0 (socket says 172.21.15.52:40004) 2023-10-01T01:33:51.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 -- 172.21.15.52:0/859031661 learned_addr learned my addr 172.21.15.52:0/859031661 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f877fe640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f8815ad70 0x7f7f880b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f7e7fc640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f880c3e60 0x7f7f880b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 -- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f8815ad70 msgr2=0x7f7f880b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f8815ad70 0x7f7f880b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 -- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f880c3e60 msgr2=0x7f7f880b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f880c3e60 0x7f7f880b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 -- 172.21.15.52:0/859031661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780094d0 con 0x7f7f88071100 2023-10-01T01:33:51.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f877fe640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f8815ad70 0x7f7f880b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f7e7fc640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f880c3e60 0x7f7f880b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f86ffd640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 0x7f7f8814d450 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f7f7801ab60 tx=0x7f7f7801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f780b7630 con 0x7f7f88071100 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f780b7790 con 0x7f7f88071100 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f880c6e80 con 0x7f7f88071100 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f780b7b40 con 0x7f7f88071100 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f880c7440 con 0x7f7f88071100 2023-10-01T01:33:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880740a0 con 0x7f7f88071100 2023-10-01T01:33:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f7f780b3040 con 0x7f7f88071100 2023-10-01T01:33:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f84ff9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f68066160 0x7f7f68068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f7811de90 con 0x7f7f88071100 2023-10-01T01:33:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f7e7fc640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f68066160 0x7f7f68068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.535+0000 7f7f7e7fc640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f68066160 0x7f7f68068620 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7f8815a420 tx=0x7f7f70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.539+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f7f780eb7b0 con 0x7f7f88071100 2023-10-01T01:33:51.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.691+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f880c78f0 con 0x7f7f68066160 2023-10-01T01:33:51.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.691+0000 7f7f84ff9640 1 -- 172.21.15.52:0/859031661 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f70007020 con 0x7f7f68066160 2023-10-01T01:33:51.699 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2023-10-01T01:33:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f68066160 msgr2=0x7f7f68068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f68066160 0x7f7f68068620 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7f8815a420 tx=0x7f7f70009040 comp rx=0 tx=0).stop 2023-10-01T01:33:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 msgr2=0x7f7f8814d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 0x7f7f8814d450 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f7f7801ab60 tx=0x7f7f7801acf0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 shutdown_connections 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f7f68066160 0x7f7f68068620 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f8815ad70 0x7f7f880b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f880c3e60 0x7f7f880b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 --2- 172.21.15.52:0/859031661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88071100 0x7f7f8814d450 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 >> 172.21.15.52:0/859031661 conn(0x7f7f880cbb80 msgr2=0x7f7f88153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 shutdown_connections 2023-10-01T01:33:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.695+0000 7f7f8d8d9640 1 -- 172.21.15.52:0/859031661 wait complete. 2023-10-01T01:33:51.717 INFO:tasks.ceph:Scrubbing osd.5 2023-10-01T01:33:51.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:51.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 Processor -- start 2023-10-01T01:33:51.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 -- start start 2023-10-01T01:33:51.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8abc15e4b0 0x7f8abc0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc06db90 con 0x7f8abc0b00a0 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc15ea50 con 0x7f8abc15e4b0 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac383c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc15ed30 con 0x7f8abc15a8b0 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8abc15e4b0 0x7f8abc0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8abc15e4b0 0x7f8abc0b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40018/0 (socket says 172.21.15.52:40018) 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 -- 172.21.15.52:0/2912476788 learned_addr learned my addr 172.21.15.52:0/2912476788 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac1dd9640 1 --1- 172.21.15.52:0/2912476788 >> v1:172.21.15.52:6789/0 conn(0x7f8abc0b00a0 0x7f8abc06c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38814/0 (socket says 172.21.15.52:38814) 2023-10-01T01:33:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac15d8640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 -- 172.21.15.52:0/2912476788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 msgr2=0x7f8abc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 -- 172.21.15.52:0/2912476788 >> v1:172.21.15.52:6789/0 conn(0x7f8abc0b00a0 legacy=0x7f8abc06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac0dd7640 1 -- 172.21.15.52:0/2912476788 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc15f010 con 0x7f8abc15e4b0 2023-10-01T01:33:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ab3fff640 1 -- 172.21.15.52:0/2912476788 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838640668 0 0) 0x7f8abc06db90 con 0x7f8abc0b00a0 2023-10-01T01:33:51.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.827+0000 7f8ac15d8640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac0dd7640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc15e4b0 0x7f8abc0b1470 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009870 tx=0x7f8ab801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cc470f756b29a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ab3fff640 1 -- 172.21.15.52:0/2912476788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80aa670 con 0x7f8abc15e4b0 2023-10-01T01:33:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ab3fff640 1 -- 172.21.15.52:0/2912476788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80aa7d0 con 0x7f8abc15e4b0 2023-10-01T01:33:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ab3fff640 1 -- 172.21.15.52:0/2912476788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80aab60 con 0x7f8abc15e4b0 2023-10-01T01:33:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- 172.21.15.52:0/2912476788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc15e4b0 msgr2=0x7f8abc0b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc15e4b0 0x7f8abc0b1470 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009870 tx=0x7f8ab801c510 comp rx=0 tx=0).stop 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- 172.21.15.52:0/2912476788 shutdown_connections 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc15e4b0 0x7f8abc0b1470 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 --2- 172.21.15.52:0/2912476788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- 172.21.15.52:0/2912476788 >> 172.21.15.52:0/2912476788 conn(0x7f8abc06a5c0 msgr2=0x7f8abc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- 172.21.15.52:0/2912476788 shutdown_connections 2023-10-01T01:33:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- 172.21.15.52:0/2912476788 wait complete. 2023-10-01T01:33:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 Processor -- start 2023-10-01T01:33:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- start start 2023-10-01T01:33:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc0b00a0 0x7f8abc151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc1644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8abc15e4b0 0x7f8abc0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc152270 con 0x7f8abc0b00a0 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1516f0 con 0x7f8abc15e4b0 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.831+0000 7f8ac383c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1519d0 con 0x7f8abc15a8b0 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc0b00a0 0x7f8abc151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc0b00a0 0x7f8abc151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40030/0 (socket says 172.21.15.52:40030) 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 -- 172.21.15.52:0/2681484556 learned_addr learned my addr 172.21.15.52:0/2681484556 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 -- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 msgr2=0x7f8abc1644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8abc15a8b0 0x7f8abc1644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 -- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8abc15e4b0 msgr2=0x7f8abc0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8abc15e4b0 0x7f8abc0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 -- 172.21.15.52:0/2681484556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80094d0 con 0x7f8abc0b00a0 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac15d8640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc0b00a0 0x7f8abc151110 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c7f0 tx=0x7f8aac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac007820 con 0x7f8abc0b00a0 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac007980 con 0x7f8abc0b00a0 2023-10-01T01:33:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc151cb0 con 0x7f8abc0b00a0 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac007d30 con 0x7f8abc0b00a0 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc150e20 con 0x7f8abc0b00a0 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8abc0b08e0 con 0x7f8abc0b00a0 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f8aac0113f0 con 0x7f8abc0b00a0 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8aa0066160 0x7f8aa0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8aac084070 con 0x7f8abc0b00a0 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7f8aa006bfc0 0x7f8aa006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 --> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8aa006ea90 con 0x7f8aa006bfc0 2023-10-01T01:33:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aac0843e0 con 0x7f8abc0b00a0 2023-10-01T01:33:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac0dd7640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8aa0066160 0x7f8aa0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac1dd9640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7f8aa006bfc0 0x7f8aa006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac1dd9640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7f8aa006bfc0 0x7f8aa006e3e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.835+0000 7f8ac0dd7640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8aa0066160 0x7f8aa0068620 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ae000 tx=0x7f8ab8004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.839+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== osd.5 v2:172.21.15.186:6808/3258999792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8aa006ea90 con 0x7f8aa006bfc0 2023-10-01T01:33:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 --> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8abc0cc1f0 con 0x7f8aa006bfc0 2023-10-01T01:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ab1ffb640 1 -- 172.21.15.52:0/2681484556 <== osd.5 v2:172.21.15.186:6808/3258999792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8abc0cc1f0 con 0x7f8aa006bfc0 2023-10-01T01:33:51.860 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:51.860 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:51.860 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7f8aa006bfc0 msgr2=0x7f8aa006e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6808/3258999792,v1:172.21.15.186:6809/3258999792] conn(0x7f8aa006bfc0 0x7f8aa006e3e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8aa0066160 msgr2=0x7f8aa0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f8aa0066160 0x7f8aa0068620 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ae000 tx=0x7f8ab8004740 comp rx=0 tx=0).stop 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc0b00a0 msgr2=0x7f8abc151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 --2- 172.21.15.52:0/2681484556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8abc0b00a0 0x7f8abc151110 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c7f0 tx=0x7f8aac00ccb0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac1dd9640 1 -- 172.21.15.52:0/2681484556 reap_dead start 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 shutdown_connections 2023-10-01T01:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 >> 172.21.15.52:0/2681484556 conn(0x7f8abc06a5c0 msgr2=0x7f8abc159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 shutdown_connections 2023-10-01T01:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.851+0000 7f8ac383c640 1 -- 172.21.15.52:0/2681484556 wait complete. 2023-10-01T01:33:51.875 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-01T01:33:51.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e08360640 1 Processor -- start 2023-10-01T01:33:51.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e08360640 1 -- start start 2023-10-01T01:33:51.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e08360640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1e000ce8b0 0x7f1e000cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e08360640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000cf950 con 0x7f1e000b2310 2023-10-01T01:33:51.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e08360640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0015af00 con 0x7f1e0015ab20 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e08360640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e000ced40 con 0x7f1e000ce8b0 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e068fd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e000b2310 0x7f1e000b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38824/0 (socket says 172.21.15.52:38824) 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e068fd640 1 -- 172.21.15.52:0/153730543 learned_addr learned my addr 172.21.15.52:0/153730543 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e058fb640 1 --2- 172.21.15.52:0/153730543 >> v2:172.21.15.186:3300/0 conn(0x7f1e000ce8b0 0x7f1e000cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222516273 0 0) 0x7f1e000cf950 con 0x7f1e000b2310 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec003530 con 0x7f1e000b2310 2023-10-01T01:33:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 882740629 0 0) 0x7f1dec003530 con 0x7f1e000b2310 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 >> v2:172.21.15.186:3300/0 conn(0x7f1e000ce8b0 msgr2=0x7f1e000cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 --2- 172.21.15.52:0/153730543 >> v2:172.21.15.186:3300/0 conn(0x7f1e000ce8b0 0x7f1e000cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 >> v1:172.21.15.186:6789/0 conn(0x7f1e0015ab20 legacy=0x7f1e000cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000cf020 con 0x7f1e000b2310 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f1df8001a00 con 0x7f1e000b2310 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 >> v1:172.21.15.52:6789/0 conn(0x7f1e000b2310 legacy=0x7f1e000b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec003980 0x7f1dec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dec0047d0 0x7f1dec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1dec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000ced40 con 0x7f1dec005190 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec010540 con 0x7f1dec003980 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec010700 con 0x7f1dec0047d0 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.979+0000 7f1e068fd640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1dec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e058fb640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dec0047d0 0x7f1dec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e060fc640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec003980 0x7f1dec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 -- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dec0047d0 msgr2=0x7f1dec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dec0047d0 0x7f1dec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 -- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec003980 msgr2=0x7f1dec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:51.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec003980 0x7f1dec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 -- 172.21.15.52:0/153730543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec003530 con 0x7f1dec005190 2023-10-01T01:33:51.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e058fb640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dec0047d0 0x7f1dec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e060fc640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dec003980 0x7f1dec003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:51.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 -- 172.21.15.52:0/153730543 reap_dead start 2023-10-01T01:33:51.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e068fd640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1dec00b990 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f1df800a830 tx=0x7f1df801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317f596ef9945d28 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:51.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80aa6d0 con 0x7f1dec005190 2023-10-01T01:33:51.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df80aa870 con 0x7f1dec005190 2023-10-01T01:33:51.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e050fa640 1 -- 172.21.15.52:0/153730543 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80aac20 con 0x7f1dec005190 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 -- 172.21.15.52:0/153730543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 msgr2=0x7f1dec00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1dec00b990 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f1df800a830 tx=0x7f1df801faa0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 -- 172.21.15.52:0/153730543 shutdown_connections 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 --2- 172.21.15.52:0/153730543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1dec00b990 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 -- 172.21.15.52:0/153730543 >> 172.21.15.52:0/153730543 conn(0x7f1e000cd310 msgr2=0x7f1e000cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 -- 172.21.15.52:0/153730543 shutdown_connections 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.983+0000 7f1e08360640 1 -- 172.21.15.52:0/153730543 wait complete. 2023-10-01T01:33:51.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 Processor -- start 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- start start 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1e00150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e0006c550 0x7f1e0006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e000b46d0 0x7f1e000b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000c4d80 con 0x7f1dec005190 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0006cef0 con 0x7f1e0006c550 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e001f2190 con 0x7f1e000b46d0 2023-10-01T01:33:51.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1e00150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1e00150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40042/0 (socket says 172.21.15.52:40042) 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 -- 172.21.15.52:0/350198462 learned_addr learned my addr 172.21.15.52:0/350198462 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 -- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e000b46d0 msgr2=0x7f1e000b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e000b46d0 0x7f1e000b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 -- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e0006c550 msgr2=0x7f1e0006c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e0006c550 0x7f1e0006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 -- 172.21.15.52:0/350198462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000b5470 con 0x7f1dec005190 2023-10-01T01:33:51.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e060fc640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1e00150af0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00d570 tx=0x7f1dfc00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc005480 con 0x7f1dec005190 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc003620 con 0x7f1dec005190 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0039b0 con 0x7f1dec005190 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e001f13d0 con 0x7f1dec005190 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e001f1990 con 0x7f1dec005190 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e000740a0 con 0x7f1dec005190 2023-10-01T01:33:52.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1dfc003b10 con 0x7f1dec005190 2023-10-01T01:33:52.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.987+0000 7f1df6ffd640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1de4066160 0x7f1de4068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.991+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1dfc083760 con 0x7f1dec005190 2023-10-01T01:33:52.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.991+0000 7f1e058fb640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1de4066160 0x7f1de4068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.991+0000 7f1e058fb640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1de4066160 0x7f1de4068620 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1e00157f00 tx=0x7f1df0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:51.995+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1dfc050fe0 con 0x7f1dec005190 2023-10-01T01:33:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.147+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e000cf5e0 con 0x7f1de4066160 2023-10-01T01:33:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.147+0000 7f1df6ffd640 1 -- 172.21.15.52:0/350198462 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1df00107c0 con 0x7f1de4066160 2023-10-01T01:33:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2023-10-01T01:33:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1de4066160 msgr2=0x7f1de4068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1de4066160 0x7f1de4068620 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1e00157f00 tx=0x7f1df0008040 comp rx=0 tx=0).stop 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 msgr2=0x7f1e00150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1e00150af0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00d570 tx=0x7f1dfc00da30 comp rx=0 tx=0).stop 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 shutdown_connections 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1de4066160 0x7f1de4068620 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e000b46d0 0x7f1e000b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e0006c550 0x7f1e0006c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 --2- 172.21.15.52:0/350198462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dec005190 0x7f1e00150af0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 >> 172.21.15.52:0/350198462 conn(0x7f1e000cd310 msgr2=0x7f1e000b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 shutdown_connections 2023-10-01T01:33:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.151+0000 7f1e08360640 1 -- 172.21.15.52:0/350198462 wait complete. 2023-10-01T01:33:52.177 INFO:tasks.ceph:Scrubbing osd.6 2023-10-01T01:33:52.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:52.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 Processor -- start 2023-10-01T01:33:52.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 -- start start 2023-10-01T01:33:52.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f477815a8b0 0x7f477806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f47780b00a0 0x7f47780b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477806db90 con 0x7f477815e4b0 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47780b1b80 con 0x7f477815a8b0 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477ef47640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47780b09c0 con 0x7f47780b00a0 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f4777fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f477815e4b0 0x7f47780b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38830/0 (socket says 172.21.15.52:38830) 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f4777fff640 1 -- 172.21.15.52:0/1584031692 learned_addr learned my addr 172.21.15.52:0/1584031692 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:52.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477cce3640 1 --2- 172.21.15.52:0/1584031692 >> v2:172.21.15.52:3300/0 conn(0x7f477815a8b0 0x7f477806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477d4e4640 1 --2- 172.21.15.52:0/1584031692 >> v2:172.21.15.186:3300/0 conn(0x7f47780b00a0 0x7f47780b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f47777fe640 1 -- 172.21.15.52:0/1584031692 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537811481 0 0) 0x7f477806db90 con 0x7f477815e4b0 2023-10-01T01:33:52.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f47777fe640 1 -- 172.21.15.52:0/1584031692 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4764003530 con 0x7f477815e4b0 2023-10-01T01:33:52.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477cce3640 1 -- 172.21.15.52:0/1584031692 >> v2:172.21.15.186:3300/0 conn(0x7f47780b00a0 msgr2=0x7f47780b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:52.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477cce3640 1 --2- 172.21.15.52:0/1584031692 >> v2:172.21.15.186:3300/0 conn(0x7f47780b00a0 0x7f47780b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477cce3640 1 -- 172.21.15.52:0/1584031692 >> v1:172.21.15.52:6789/0 conn(0x7f477815e4b0 legacy=0x7f47780b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.291+0000 7f477cce3640 1 -- 172.21.15.52:0/1584031692 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477815ea50 con 0x7f477815a8b0 2023-10-01T01:33:52.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477cce3640 1 --2- 172.21.15.52:0/1584031692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815a8b0 0x7f477806d650 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f477806e3a0 tx=0x7f476001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff86311907ee161d server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f47777fe640 1 -- 172.21.15.52:0/1584031692 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47600a7070 con 0x7f477815a8b0 2023-10-01T01:33:52.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f47777fe640 1 -- 172.21.15.52:0/1584031692 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47600ab430 con 0x7f477815a8b0 2023-10-01T01:33:52.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f47777fe640 1 -- 172.21.15.52:0/1584031692 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47600ab7c0 con 0x7f477815a8b0 2023-10-01T01:33:52.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 -- 172.21.15.52:0/1584031692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815a8b0 msgr2=0x7f477806d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 --2- 172.21.15.52:0/1584031692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815a8b0 0x7f477806d650 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f477806e3a0 tx=0x7f476001c430 comp rx=0 tx=0).stop 2023-10-01T01:33:52.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 -- 172.21.15.52:0/1584031692 shutdown_connections 2023-10-01T01:33:52.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 --2- 172.21.15.52:0/1584031692 >> v2:172.21.15.186:3300/0 conn(0x7f47780b00a0 0x7f47780b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 --2- 172.21.15.52:0/1584031692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815a8b0 0x7f477806d650 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 -- 172.21.15.52:0/1584031692 >> 172.21.15.52:0/1584031692 conn(0x7f477806a5c0 msgr2=0x7f47780ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 -- 172.21.15.52:0/1584031692 shutdown_connections 2023-10-01T01:33:52.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.295+0000 7f477ef47640 1 -- 172.21.15.52:0/1584031692 wait complete. 2023-10-01T01:33:52.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 Processor -- start 2023-10-01T01:33:52.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- start start 2023-10-01T01:33:52.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47780b00a0 0x7f4778153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f477815a8b0 0x7f4778158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815e4b0 0x7f47781594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47780cd630 con 0x7f477815e4b0 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47780c78b0 con 0x7f477815a8b0 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47780c7b90 con 0x7f47780b00a0 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815e4b0 0x7f47781594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815e4b0 0x7f47781594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40058/0 (socket says 172.21.15.52:40058) 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 -- 172.21.15.52:0/3054428542 learned_addr learned my addr 172.21.15.52:0/3054428542 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477cce3640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47780b00a0 0x7f4778153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f4777fff640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f477815a8b0 0x7f4778158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 -- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47780b00a0 msgr2=0x7f4778153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47780b00a0 0x7f4778153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 -- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f477815a8b0 msgr2=0x7f4778158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f477815a8b0 0x7f4778158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 -- 172.21.15.52:0/3054428542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760009420 con 0x7f477815e4b0 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477d4e4640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815e4b0 0x7f47781594f0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f477000e7f0 tx=0x7f477000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770009530 con 0x7f477815e4b0 2023-10-01T01:33:52.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000eea0 con 0x7f477815e4b0 2023-10-01T01:33:52.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47780c7e70 con 0x7f477815e4b0 2023-10-01T01:33:52.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000cb60 con 0x7f477815e4b0 2023-10-01T01:33:52.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47780c8430 con 0x7f477815e4b0 2023-10-01T01:33:52.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f477806c110 con 0x7f477815e4b0 2023-10-01T01:33:52.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f477000ccc0 con 0x7f477815e4b0 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f47757fa640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4758066160 0x7f4758068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.299+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4770083be0 con 0x7f477815e4b0 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f47757fa640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f475806bfc0 0x7f475806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 --> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f475806ea90 con 0x7f475806bfc0 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4770084030 con 0x7f477815e4b0 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f477cce3640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4758066160 0x7f4758068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f4777fff640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f475806bfc0 0x7f475806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f477cce3640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4758066160 0x7f4758068620 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f47600af000 tx=0x7f47600a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f4777fff640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f475806bfc0 0x7f475806e3e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.303+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== osd.6 v2:172.21.15.186:6816/2219583678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f475806ea90 con 0x7f475806bfc0 2023-10-01T01:33:52.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 --> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f477815f2f0 con 0x7f475806bfc0 2023-10-01T01:33:52.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f47757fa640 1 -- 172.21.15.52:0/3054428542 <== osd.6 v2:172.21.15.186:6816/2219583678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f47680070f0 con 0x7f475806bfc0 2023-10-01T01:33:52.326 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:52.326 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:52.326 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:52.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f475806bfc0 msgr2=0x7f475806e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6816/2219583678,v1:172.21.15.186:6818/2219583678] conn(0x7f475806bfc0 0x7f475806e3e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4758066160 msgr2=0x7f4758068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4758066160 0x7f4758068620 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f47600af000 tx=0x7f47600a7000 comp rx=0 tx=0).stop 2023-10-01T01:33:52.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815e4b0 msgr2=0x7f47781594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 --2- 172.21.15.52:0/3054428542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477815e4b0 0x7f47781594f0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f477000e7f0 tx=0x7f477000ecb0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477d4e4640 1 -- 172.21.15.52:0/3054428542 reap_dead start 2023-10-01T01:33:52.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 shutdown_connections 2023-10-01T01:33:52.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 >> 172.21.15.52:0/3054428542 conn(0x7f477806a5c0 msgr2=0x7f477815c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 shutdown_connections 2023-10-01T01:33:52.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.319+0000 7f477ef47640 1 -- 172.21.15.52:0/3054428542 wait complete. 2023-10-01T01:33:52.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-01T01:33:52.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 Processor -- start 2023-10-01T01:33:52.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 -- start start 2023-10-01T01:33:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c8c15ccd0 0x7f1c8c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1c8c06a510 0x7f1c8c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c15d0b0 con 0x7f1c8c06f750 2023-10-01T01:33:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c0cbbc0 con 0x7f1c8c15ccd0 2023-10-01T01:33:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c92094640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c071450 con 0x7f1c8c06a510 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c8c15ccd0 0x7f1c8c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c83fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1c8c06f750 0x7f1c8c069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38834/0 (socket says 172.21.15.52:38834) 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c83fff640 1 -- 172.21.15.52:0/864532995 learned_addr learned my addr 172.21.15.52:0/864532995 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8bfff640 1 --2- 172.21.15.52:0/864532995 >> v2:172.21.15.186:3300/0 conn(0x7f1c8c06a510 0x7f1c8c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8b7fe640 1 -- 172.21.15.52:0/864532995 >> v2:172.21.15.186:3300/0 conn(0x7f1c8c06a510 msgr2=0x7f1c8c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8b7fe640 1 --2- 172.21.15.52:0/864532995 >> v2:172.21.15.186:3300/0 conn(0x7f1c8c06a510 0x7f1c8c0cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8b7fe640 1 -- 172.21.15.52:0/864532995 >> v1:172.21.15.52:6789/0 conn(0x7f1c8c06f750 legacy=0x7f1c8c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8b7fe640 1 -- 172.21.15.52:0/864532995 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c071730 con 0x7f1c8c15ccd0 2023-10-01T01:33:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.459+0000 7f1c8affd640 1 -- 172.21.15.52:0/864532995 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383873315 0 0) 0x7f1c8c15d0b0 con 0x7f1c8c06f750 2023-10-01T01:33:52.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c8b7fe640 1 --2- 172.21.15.52:0/864532995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c15ccd0 0x7f1c8c06ef90 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0af1c0 tx=0x7f1c7c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f772360cfc13a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c8affd640 1 -- 172.21.15.52:0/864532995 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0ab600 con 0x7f1c8c15ccd0 2023-10-01T01:33:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c8affd640 1 -- 172.21.15.52:0/864532995 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0a7050 con 0x7f1c8c15ccd0 2023-10-01T01:33:52.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c8affd640 1 -- 172.21.15.52:0/864532995 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0ab980 con 0x7f1c8c15ccd0 2023-10-01T01:33:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 -- 172.21.15.52:0/864532995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c15ccd0 msgr2=0x7f1c8c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 --2- 172.21.15.52:0/864532995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c15ccd0 0x7f1c8c06ef90 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0af1c0 tx=0x7f1c7c01c3d0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 -- 172.21.15.52:0/864532995 shutdown_connections 2023-10-01T01:33:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 --2- 172.21.15.52:0/864532995 >> v2:172.21.15.186:3300/0 conn(0x7f1c8c06a510 0x7f1c8c0cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 --2- 172.21.15.52:0/864532995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c15ccd0 0x7f1c8c06ef90 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 -- 172.21.15.52:0/864532995 >> 172.21.15.52:0/864532995 conn(0x7f1c8c06d320 msgr2=0x7f1c8c06d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 -- 172.21.15.52:0/864532995 shutdown_connections 2023-10-01T01:33:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 -- 172.21.15.52:0/864532995 wait complete. 2023-10-01T01:33:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 Processor -- start 2023-10-01T01:33:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.463+0000 7f1c92094640 1 -- start start 2023-10-01T01:33:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8c06a510 0x7f1c8c15fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 0x7f1c8c1f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8c15ccd0 0x7f1c8c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c151080 con 0x7f1c8c06f750 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c151320 con 0x7f1c8c06a510 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1f8920 con 0x7f1c8c15ccd0 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 0x7f1c8c1f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 0x7f1c8c1f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40072/0 (socket says 172.21.15.52:40072) 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 -- 172.21.15.52:0/3654115487 learned_addr learned my addr 172.21.15.52:0/3654115487 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c8bfff640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8c15ccd0 0x7f1c8c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c8b7fe640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8c06a510 0x7f1c8c15fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 -- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8c15ccd0 msgr2=0x7f1c8c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8c15ccd0 0x7f1c8c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 -- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8c06a510 msgr2=0x7f1c8c15fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8c06a510 0x7f1c8c15fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 -- 172.21.15.52:0/3654115487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c009420 con 0x7f1c8c06f750 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c83fff640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 0x7f1c8c1f83e0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f1c740011f0 tx=0x7f1c7400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740074e0 con 0x7f1c8c06f750 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74007640 con 0x7f1c8c06f750 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c1f8b80 con 0x7f1c8c06f750 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74004a10 con 0x7f1c8c06f750 2023-10-01T01:33:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c1f9140 con 0x7f1c8c06f750 2023-10-01T01:33:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c1f9360 con 0x7f1c8c06f750 2023-10-01T01:33:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f1c74004b70 con 0x7f1c8c06f750 2023-10-01T01:33:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c88ff9640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1c6c066160 0x7f1c6c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c74082a40 con 0x7f1c8c06f750 2023-10-01T01:33:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.467+0000 7f1c8b7fe640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1c6c066160 0x7f1c6c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.471+0000 7f1c8b7fe640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1c6c066160 0x7f1c6c068620 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0ad000 tx=0x7f1c7c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.475+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f1c74084e60 con 0x7f1c8c06f750 2023-10-01T01:33:52.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c8c071fd0 con 0x7f1c6c066160 2023-10-01T01:33:52.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c88ff9640 1 -- 172.21.15.52:0/3654115487 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c7c006e20 con 0x7f1c6c066160 2023-10-01T01:33:52.638 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2023-10-01T01:33:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1c6c066160 msgr2=0x7f1c6c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1c6c066160 0x7f1c6c068620 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0ad000 tx=0x7f1c7c0a6000 comp rx=0 tx=0).stop 2023-10-01T01:33:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 msgr2=0x7f1c8c1f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 0x7f1c8c1f83e0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f1c740011f0 tx=0x7f1c7400c9b0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 shutdown_connections 2023-10-01T01:33:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f1c6c066160 0x7f1c6c068620 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8c15ccd0 0x7f1c8c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c8c06f750 0x7f1c8c1f83e0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 --2- 172.21.15.52:0/3654115487 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8c06a510 0x7f1c8c15fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.631+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 >> 172.21.15.52:0/3654115487 conn(0x7f1c8c06d320 msgr2=0x7f1c8c0ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.635+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 shutdown_connections 2023-10-01T01:33:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.635+0000 7f1c92094640 1 -- 172.21.15.52:0/3654115487 wait complete. 2023-10-01T01:33:52.659 INFO:tasks.ceph:Scrubbing osd.7 2023-10-01T01:33:52.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-01T01:33:52.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 Processor -- start 2023-10-01T01:33:52.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 -- start start 2023-10-01T01:33:52.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6dc0b00a0 0x7ff6dc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc15ea50 con 0x7ff6dc15a8b0 2023-10-01T01:33:52.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0b0a70 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e45a8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc15ed30 con 0x7ff6dc15e4b0 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2b45640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6dc0b00a0 0x7ff6dc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2344640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff6dc15a8b0 0x7ff6dc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38844/0 (socket says 172.21.15.52:38844) 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2344640 1 -- 172.21.15.52:0/772099145 learned_addr learned my addr 172.21.15.52:0/772099145 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e1b43640 1 --2- 172.21.15.52:0/772099145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2b45640 1 -- 172.21.15.52:0/772099145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 msgr2=0x7ff6dc0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2b45640 1 --2- 172.21.15.52:0/772099145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2b45640 1 -- 172.21.15.52:0/772099145 >> v1:172.21.15.52:6789/0 conn(0x7ff6dc15a8b0 legacy=0x7ff6dc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.775+0000 7ff6e2b45640 1 -- 172.21.15.52:0/772099145 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc15f010 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e2b45640 1 --2- 172.21.15.52:0/772099145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc0b0530 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0097c0 tx=0x7ff6cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bead88eb6b3ce75a server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e1342640 1 -- 172.21.15.52:0/772099145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0ab650 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e1342640 1 -- 172.21.15.52:0/772099145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc0ab7b0 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e1342640 1 -- 172.21.15.52:0/772099145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0abb40 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 -- 172.21.15.52:0/772099145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 msgr2=0x7ff6dc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 --2- 172.21.15.52:0/772099145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc0b0530 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0097c0 tx=0x7ff6cc01c450 comp rx=0 tx=0).stop 2023-10-01T01:33:52.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 -- 172.21.15.52:0/772099145 shutdown_connections 2023-10-01T01:33:52.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 --2- 172.21.15.52:0/772099145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc0b0530 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 --2- 172.21.15.52:0/772099145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 -- 172.21.15.52:0/772099145 >> 172.21.15.52:0/772099145 conn(0x7ff6dc06a5c0 msgr2=0x7ff6dc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 -- 172.21.15.52:0/772099145 shutdown_connections 2023-10-01T01:33:52.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.779+0000 7ff6e45a8640 1 -- 172.21.15.52:0/772099145 wait complete. 2023-10-01T01:33:52.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 Processor -- start 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- start start 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6dc15a8b0 0x7ff6dc1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc153890 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc150320 con 0x7ff6dc15a8b0 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc152c10 con 0x7ff6dc15e4b0 2023-10-01T01:33:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc14fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40088/0 (socket says 172.21.15.52:40088) 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 -- 172.21.15.52:0/4155375325 learned_addr learned my addr 172.21.15.52:0/4155375325 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2b45640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e1b43640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6dc15a8b0 0x7ff6dc1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 -- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 msgr2=0x7ff6dc150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6dc15e4b0 0x7ff6dc150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 -- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6dc15a8b0 msgr2=0x7ff6dc1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6dc15a8b0 0x7ff6dc1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 -- 172.21.15.52:0/4155375325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc009420 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e2344640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc14fde0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400cbf0 tx=0x7ff6d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400aca0 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d400ae00 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc152ef0 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4012600 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc1534b0 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6dc0b19b0 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7ff6d4007070 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff6c8066160 0x7ff6c8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6d40835b0 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.783+0000 7ff6daffd640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7ff6c806bfc0 0x7ff6c806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 --> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6c806ea90 con 0x7ff6c806bfc0 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6d4085b90 con 0x7ff6dc0b00a0 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6e1b43640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff6c8066160 0x7ff6c8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6e2b45640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7ff6c806bfc0 0x7ff6c806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6e1b43640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff6c8066160 0x7ff6c8068620 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0afb80 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6e2b45640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7ff6c806bfc0 0x7ff6c806e3e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.787+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== osd.7 v2:172.21.15.186:6817/1826627445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff6c806ea90 con 0x7ff6c806bfc0 2023-10-01T01:33:52.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.799+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 --> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6dc1539d0 con 0x7ff6c806bfc0 2023-10-01T01:33:52.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6daffd640 1 -- 172.21.15.52:0/4155375325 <== osd.7 v2:172.21.15.186:6817/1826627445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff6dc1539d0 con 0x7ff6c806bfc0 2023-10-01T01:33:52.810 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-10-01T01:33:52.810 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-01T01:33:52.810 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-10-01T01:33:52.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7ff6c806bfc0 msgr2=0x7ff6c806e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6817/1826627445,v1:172.21.15.186:6819/1826627445] conn(0x7ff6c806bfc0 0x7ff6c806e3e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff6c8066160 msgr2=0x7ff6c8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7ff6c8066160 0x7ff6c8068620 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0afb80 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 msgr2=0x7ff6dc14fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 --2- 172.21.15.52:0/4155375325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6dc0b00a0 0x7ff6dc14fde0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400cbf0 tx=0x7ff6d400a060 comp rx=0 tx=0).stop 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e2b45640 1 -- 172.21.15.52:0/4155375325 reap_dead start 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 shutdown_connections 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 >> 172.21.15.52:0/4155375325 conn(0x7ff6dc06a5c0 msgr2=0x7ff6dc0cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 shutdown_connections 2023-10-01T01:33:52.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.803+0000 7ff6e45a8640 1 -- 172.21.15.52:0/4155375325 wait complete. 2023-10-01T01:33:52.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-01T01:33:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61ecb7c640 1 Processor -- start 2023-10-01T01:33:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61ecb7c640 1 -- start start 2023-10-01T01:33:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61ecb7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61e80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61ecb7c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80d04a0 con 0x7f61e80d0040 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61ecb7c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80d39b0 con 0x7f61e80d2780 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61ecb7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e815d040 con 0x7f61e815cc60 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61e5d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f61e80d0040 0x7f61e80d2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38848/0 (socket says 172.21.15.52:38848) 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61e5d9b640 1 -- 172.21.15.52:0/3290617675 learned_addr learned my addr 172.21.15.52:0/3290617675 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61e659c640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61e80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.939+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824023076 0 0) 0x7f61e80d04a0 con 0x7f61e80d0040 2023-10-01T01:33:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d0003530 con 0x7f61e80d0040 2023-10-01T01:33:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3930428851 0 0) 0x7f61d0003530 con 0x7f61e80d0040 2023-10-01T01:33:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 msgr2=0x7f61e80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61e80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 >> v1:172.21.15.186:6789/0 conn(0x7f61e80d2780 legacy=0x7f61e80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80d2da0 con 0x7f61e80d0040 2023-10-01T01:33:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f61dc001680 con 0x7f61e80d0040 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 >> v1:172.21.15.52:6789/0 conn(0x7f61e80d0040 legacy=0x7f61e80d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00039b0 0x7f61d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61d00047d0 0x7f61d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e815d040 con 0x7f61d00047d0 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d000ba70 con 0x7f61d00039b0 2023-10-01T01:33:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d000bc30 con 0x7f61e815cc60 2023-10-01T01:33:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61d00047d0 0x7f61d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e659c640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00039b0 0x7f61d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e6d9d640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 -- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 msgr2=0x7f61d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 -- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00039b0 msgr2=0x7f61d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00039b0 0x7f61d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 -- 172.21.15.52:0/3290617675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0003530 con 0x7f61d00047d0 2023-10-01T01:33:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e6d9d640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e815cc60 0x7f61d0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e5d9b640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61d00047d0 0x7f61d0004c50 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f61dc007fc0 tx=0x7f61dc01f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abae7833e81d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0a8e90 con 0x7f61d00047d0 2023-10-01T01:33:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc0058e0 con 0x7f61d00047d0 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e559a640 1 -- 172.21.15.52:0/3290617675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc005c70 con 0x7f61d00047d0 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61ecb7c640 1 -- 172.21.15.52:0/3290617675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61d00047d0 msgr2=0x7f61d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/3290617675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61d00047d0 0x7f61d0004c50 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f61dc007fc0 tx=0x7f61dc01f270 comp rx=0 tx=0).stop 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61e6d9d640 1 -- 172.21.15.52:0/3290617675 reap_dead start 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61ecb7c640 1 -- 172.21.15.52:0/3290617675 shutdown_connections 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61ecb7c640 1 -- 172.21.15.52:0/3290617675 >> 172.21.15.52:0/3290617675 conn(0x7f61e8071930 msgr2=0x7f61e8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61ecb7c640 1 -- 172.21.15.52:0/3290617675 shutdown_connections 2023-10-01T01:33:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.943+0000 7f61ecb7c640 1 -- 172.21.15.52:0/3290617675 wait complete. 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 Processor -- start 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- start start 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00047d0 0x7f61e81f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e80c5e30 0x7f61e80b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 0x7f61e80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80c7830 con 0x7f61e80c66b0 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80c6bb0 con 0x7f61d00047d0 2023-10-01T01:33:52.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80c6e90 con 0x7f61e80c5e30 2023-10-01T01:33:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 0x7f61e80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 0x7f61e80b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40102/0 (socket says 172.21.15.52:40102) 2023-10-01T01:33:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 -- 172.21.15.52:0/11626914 learned_addr learned my addr 172.21.15.52:0/11626914 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e5d9b640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e80c5e30 0x7f61e80b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e659c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00047d0 0x7f61e81f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 -- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e80c5e30 msgr2=0x7f61e80b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e80c5e30 0x7f61e80b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 -- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00047d0 msgr2=0x7f61e81f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00047d0 0x7f61e81f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 -- 172.21.15.52:0/11626914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80c7170 con 0x7f61e80c66b0 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61e6d9d640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 0x7f61e80b3aa0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f61e80cfad0 tx=0x7f61e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0006d60 con 0x7f61e80c66b0 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0003980 con 0x7f61e80c66b0 2023-10-01T01:33:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e80c7450 con 0x7f61e80c66b0 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0003d30 con 0x7f61e80c66b0 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e80c5790 con 0x7f61e80c66b0 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.947+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e80c7970 con 0x7f61e80c66b0 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.951+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f61e0005070 con 0x7f61e80c66b0 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.951+0000 7f61d6ffd640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f61c8066160 0x7f61c8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.951+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f61e0083650 con 0x7f61e80c66b0 2023-10-01T01:33:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.951+0000 7f61e659c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f61c8066160 0x7f61c8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.951+0000 7f61e659c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f61c8066160 0x7f61c8068620 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f61e80ccdd0 tx=0x7f61d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:52.955+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f61e80c7970 con 0x7f61e80c66b0 2023-10-01T01:33:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.111+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f61e80c7000 con 0x7f61c8066160 2023-10-01T01:33:53.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.115+0000 7f61d6ffd640 1 -- 172.21.15.52:0/11626914 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f61e80c7000 con 0x7f61c8066160 2023-10-01T01:33:53.122 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2023-10-01T01:33:53.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f61c8066160 msgr2=0x7f61c8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f61c8066160 0x7f61c8068620 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f61e80ccdd0 tx=0x7f61d8008040 comp rx=0 tx=0).stop 2023-10-01T01:33:53.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 msgr2=0x7f61e80b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 0x7f61e80b3aa0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f61e80cfad0 tx=0x7f61e000dc00 comp rx=0 tx=0).stop 2023-10-01T01:33:53.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 shutdown_connections 2023-10-01T01:33:53.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f61c8066160 0x7f61c8068620 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e80c66b0 0x7f61e80b3aa0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61e80c5e30 0x7f61e80b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 --2- 172.21.15.52:0/11626914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61d00047d0 0x7f61e81f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 >> 172.21.15.52:0/11626914 conn(0x7f61e8071930 msgr2=0x7f61e80cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:53.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 shutdown_connections 2023-10-01T01:33:53.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.119+0000 7f61ecb7c640 1 -- 172.21.15.52:0/11626914 wait complete. 2023-10-01T01:33:53.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T01:33:53.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.259+0000 7f271de2b640 1 Processor -- start 2023-10-01T01:33:53.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.259+0000 7f271de2b640 1 -- start start 2023-10-01T01:33:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f271de2b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f271815a9d0 0x7f271815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f271de2b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f271806d650 0x7f27180b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f271de2b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271806c240 con 0x7f27180b19b0 2023-10-01T01:33:53.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f271de2b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271815adb0 con 0x7f271806d650 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f271de2b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271815ea90 con 0x7f271815a9d0 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f271806d650 0x7f27180b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f271806d650 0x7f27180b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40104/0 (socket says 172.21.15.52:40104) 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 -- 172.21.15.52:0/387261430 learned_addr learned my addr 172.21.15.52:0/387261430 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f27177fe640 1 --2- 172.21.15.52:0/387261430 >> v2:172.21.15.186:3300/0 conn(0x7f271815a9d0 0x7f271815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 -- 172.21.15.52:0/387261430 >> v2:172.21.15.186:3300/0 conn(0x7f271815a9d0 msgr2=0x7f271815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:53.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 --2- 172.21.15.52:0/387261430 >> v2:172.21.15.186:3300/0 conn(0x7f271815a9d0 0x7f271815e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 -- 172.21.15.52:0/387261430 >> v1:172.21.15.186:6789/0 conn(0x7f27180b19b0 legacy=0x7f27180b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:33:53.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 -- 172.21.15.52:0/387261430 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271815ed70 con 0x7f271806d650 2023-10-01T01:33:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f2716ffd640 1 --2- 172.21.15.52:0/387261430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f271806d650 0x7f27180b1470 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f27180715f0 tx=0x7f270001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b0ed7456a9584f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f27167fc640 1 -- 172.21.15.52:0/387261430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000ac410 con 0x7f271806d650 2023-10-01T01:33:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f27167fc640 1 -- 172.21.15.52:0/387261430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000ac570 con 0x7f271806d650 2023-10-01T01:33:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.263+0000 7f27167fc640 1 -- 172.21.15.52:0/387261430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000ac900 con 0x7f271806d650 2023-10-01T01:33:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/387261430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f271806d650 msgr2=0x7f27180b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 --2- 172.21.15.52:0/387261430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f271806d650 0x7f27180b1470 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f27180715f0 tx=0x7f270001c4c0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/387261430 shutdown_connections 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 --2- 172.21.15.52:0/387261430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f271806d650 0x7f27180b1470 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 --2- 172.21.15.52:0/387261430 >> v2:172.21.15.186:3300/0 conn(0x7f271815a9d0 0x7f271815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/387261430 >> 172.21.15.52:0/387261430 conn(0x7f271806a5f0 msgr2=0x7f27180ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/387261430 shutdown_connections 2023-10-01T01:33:53.274 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/387261430 wait complete. 2023-10-01T01:33:53.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 Processor -- start 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- start start 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f271806d650 0x7f2718151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 0x7f2718149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f271815a9d0 0x7f27181538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718153f90 con 0x7f27180b19b0 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718149b60 con 0x7f271815a9d0 2023-10-01T01:33:53.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27181484a0 con 0x7f271806d650 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 0x7f2718149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 0x7f2718149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40116/0 (socket says 172.21.15.52:40116) 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 -- 172.21.15.52:0/485068433 learned_addr learned my addr 172.21.15.52:0/485068433 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f27177fe640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f271806d650 0x7f2718151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2717fff640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f271815a9d0 0x7f27181538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 -- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f271806d650 msgr2=0x7f2718151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f271806d650 0x7f2718151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 -- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f271815a9d0 msgr2=0x7f27181538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f271815a9d0 0x7f27181538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 -- 172.21.15.52:0/485068433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000094d0 con 0x7f27180b19b0 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2717fff640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f271815a9d0 0x7f27181538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f2716ffd640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 0x7f2718149260 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f2700000c10 tx=0x7f2700019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000ac410 con 0x7f27180b19b0 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000b5640 con 0x7f27180b19b0 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2718148780 con 0x7f27180b19b0 2023-10-01T01:33:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000b59f0 con 0x7f27180b19b0 2023-10-01T01:33:53.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.267+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2718148d40 con 0x7f27180b19b0 2023-10-01T01:33:53.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.271+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718148f60 con 0x7f27180b19b0 2023-10-01T01:33:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.271+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f27000b3040 con 0x7f27180b19b0 2023-10-01T01:33:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.271+0000 7f270ffff640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f26f8066160 0x7f26f8068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:33:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.271+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f270011d6d0 con 0x7f27180b19b0 2023-10-01T01:33:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.271+0000 7f27177fe640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f26f8066160 0x7f26f8068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:33:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.271+0000 7f27177fe640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f26f8066160 0x7f26f8068620 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f27100070b0 tx=0x7f2710007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:33:53.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.275+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f27000eaff0 con 0x7f27180b19b0 2023-10-01T01:33:53.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.431+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2718148610 con 0x7f26f8066160 2023-10-01T01:33:53.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.435+0000 7f270ffff640 1 -- 172.21.15.52:0/485068433 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49557 (secure 0 0 0) 0x7f2718148610 con 0x7f26f8066160 2023-10-01T01:33:53.444 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:33:53.444 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-10-01T01:33:53.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f26f8066160 msgr2=0x7f26f8068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f26f8066160 0x7f26f8068620 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f27100070b0 tx=0x7f2710007040 comp rx=0 tx=0).stop 2023-10-01T01:33:53.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 msgr2=0x7f2718149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:33:53.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 0x7f2718149260 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f2700000c10 tx=0x7f2700019260 comp rx=0 tx=0).stop 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 shutdown_connections 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f26f8066160 0x7f26f8068620 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f271815a9d0 0x7f27181538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27180b19b0 0x7f2718149260 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 --2- 172.21.15.52:0/485068433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f271806d650 0x7f2718151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 >> 172.21.15.52:0/485068433 conn(0x7f271806a5f0 msgr2=0x7f27180b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:33:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 shutdown_connections 2023-10-01T01:33:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:33:53.439+0000 7f271de2b640 1 -- 172.21.15.52:0/485068433 wait complete. 2023-10-01T01:33:53.463 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":15773,"stamp":"2023-10-01T01:33:52.863992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":12746472,"kb_used_data":183784,"kb_used_omap":3673,"kb_used_meta":12558950,"kb_avail":742228248,"statfs":{"total":773094113280,"available":760041725952,"internally_reserved":0,"allocated":188194816,"data_stored":185594654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3761525,"internal_metadata":12860365451},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2600,"apply_latency_ms":2600,"commit_latency_ns":2600000000,"apply_latency_ns":2600000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003041"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":494,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-01T01:33:37.675721+0000","last_change":"2023-09-30T16:49:05.417705+0000","last_active":"2023-10-01T01:33:37.675721+0000","last_peered":"2023-10-01T01:33:37.675721+0000","last_clean":"2023-10-01T01:33:37.675721+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-10-01T01:33:37.675721+0000","last_undegraded":"2023-10-01T01:33:37.675721+0000","last_fullsized":"2023-10-01T01:33:37.675721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T16:49:04.397753+0000","last_clean_scrub_stamp":"2023-09-30T16:49:04.397753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:12:53.536105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129548443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1672780,"kb_used_data":452,"kb_used_omap":564,"kb_used_meta":1671755,"kb_avail":92699060,"statfs":{"total":96636764160,"available":94923837440,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":577944,"internal_metadata":1711877736},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":459,"apply_latency_ms":459,"commit_latency_ns":459000000,"apply_latency_ns":459000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68100000000000005,"15min":0.78700000000000003},"min":{"1min":0.253,"5min":0.248,"15min":0.23100000000000001},"max":{"1min":0.85599999999999998,"5min":5.3360000000000003,"15min":6.6909999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.105,"5min":0.88700000000000001,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.255},"max":{"1min":5.9580000000000002,"5min":5.9580000000000002,"15min":6.109},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.99399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.9039999999999999,"5min":5.2910000000000004,"15min":6.726},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94799999999999995,"15min":1.0740000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":4.8029999999999999,"5min":5.2850000000000001,"15min":9.8680000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.2769999999999999,"15min":1.236},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.6399999999999997,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.1950000000000001,"15min":1.272},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":1.589,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.0569999999999999,"15min":1.29},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6840000000000002,"5min":5.8140000000000001,"15min":10.702},"last":0.505},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.90500000000000003,"15min":1.1339999999999999},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95099999999999996,"5min":8.1370000000000005,"15min":8.1370000000000005},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.68300000000000005,"15min":0.89800000000000002},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.24099999999999999},"max":{"1min":0.95099999999999996,"5min":5.2140000000000004,"15min":6.9770000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.82799999999999996,"15min":1.028},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26400000000000001},"max":{"1min":2.2789999999999999,"5min":5.3579999999999997,"15min":7.9710000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.90200000000000002,"15min":1.0349999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.26800000000000002},"max":{"1min":1.51,"5min":10.757999999999999,"15min":10.757999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.85699999999999998,"15min":0.95999999999999996},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":0.98599999999999999,"5min":5.7300000000000004,"15min":6.8040000000000003},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":5.2590000000000003,"5min":5.9219999999999997,"15min":8.8000000000000007},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":1.071},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":8.8819999999999997},"last":0.59299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129548445,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1669052,"kb_used_data":39092,"kb_used_omap":29,"kb_used_meta":1629922,"kb_avail":92702788,"statfs":{"total":96636764160,"available":94927654912,"internally_reserved":0,"allocated":40030208,"data_stored":39657071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30210,"internal_metadata":1669040638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":266,"apply_latency_ms":266,"commit_latency_ns":266000000,"apply_latency_ns":266000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.014,"15min":0.88500000000000001},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":15.537000000000001,"5min":15.537000000000001,"15min":15.537000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.0900000000000001,"15min":0.96599999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":8.8770000000000007,"5min":8.8770000000000007,"15min":8.8770000000000007},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":1.159,"15min":1.0980000000000001},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":15.608000000000001,"5min":15.608000000000001,"15min":15.608000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.107,"15min":1.1699999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.28799999999999998},"max":{"1min":8.9429999999999996,"5min":8.9429999999999996,"15min":8.9429999999999996},"last":0.70999999999999996}]},{"osd":2,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2130000000000001,"15min":1.234},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":5.0049999999999999,"5min":6.1950000000000003,"15min":11.847},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.901,"5min":1.3999999999999999,"15min":1.2529999999999999},"min":{"1min":0.32300000000000001,"5min":0.313,"15min":0.26800000000000002},"max":{"1min":15.951000000000001,"5min":15.951000000000001,"15min":15.951000000000001},"last":1.048}]},{"osd":3,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":1.3759999999999999,"15min":1.3640000000000001},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":16.318000000000001,"5min":16.318000000000001,"15min":16.318000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.0469999999999999,"15min":1.1379999999999999},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":4.4139999999999997,"5min":6.2750000000000004,"15min":7.5469999999999997},"last":0.51000000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.119,"15min":0.94999999999999996},"min":{"1min":0.28199999999999997,"5min":0.253,"15min":0.253},"max":{"1min":16.077999999999999,"5min":16.077999999999999,"15min":16.077999999999999},"last":1.018},{"interface":"front","average":{"1min":1.516,"5min":1.0169999999999999,"15min":0.998},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.9160000000000004,"5min":8.9160000000000004,"15min":8.9160000000000004},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.87,"15min":0.997},"min":{"1min":0.33700000000000002,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":4.4909999999999997,"5min":6.1390000000000002,"15min":8.6799999999999997},"last":0.443},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.2270000000000001,"15min":1.0129999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":15.640000000000001,"5min":15.640000000000001,"15min":15.640000000000001},"last":1.077}]},{"osd":7,"last update":"Sun Oct 1 01:32:48 2023","interfaces":[{"interface":"back","average":{"1min":1.946,"5min":1.117,"15min":1.103},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":16.129000000000001,"5min":16.129000000000001,"15min":16.129000000000001},"last":1.113},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0900000000000001,"15min":1.034},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":4.4509999999999996,"5min":6.2370000000000001,"15min":7.516},"last":0.72499999999999998}]}]},{"osd":5,"up_from":14,"seq":60129548444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1781904,"kb_used_data":1032,"kb_used_omap":864,"kb_used_meta":1779999,"kb_avail":92589936,"statfs":{"total":96636764160,"available":94812094464,"internally_reserved":0,"allocated":1056768,"data_stored":775696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":884917,"internal_metadata":1822719819},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":209,"apply_latency_ms":209,"commit_latency_ns":209000000,"apply_latency_ns":209000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6339999999999999,"5min":5.6829999999999998,"15min":10.228999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.2789999999999999,"5min":0.77800000000000002,"15min":1.073},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":12.055},"last":0.91100000000000003}]},{"osd":1,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.754,"15min":1.1559999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":2.7829999999999999,"5min":4.6180000000000003,"15min":10.068},"last":0.873},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.94999999999999996,"15min":0.88800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.3609999999999998,"5min":5.3609999999999998,"15min":9.4689999999999994},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.98899999999999999,"15min":1.0920000000000001},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.7669999999999999,"5min":7.5780000000000003,"15min":12.086},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.97099999999999997,"15min":1.2949999999999999},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.8340000000000001,"5min":11.26,"15min":11.26},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.4910000000000001,"5min":1.482,"15min":1.399},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":50.969000000000001,"5min":50.969000000000001,"15min":50.969000000000001},"last":1.03},{"interface":"front","average":{"1min":4.093,"5min":1.7789999999999999,"15min":1.5840000000000001},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":50.537999999999997,"5min":50.537999999999997,"15min":50.537999999999997},"last":0.93799999999999994}]},{"osd":4,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.84899999999999998,"15min":0.71199999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8799999999999999,"5min":5.7119999999999997,"15min":5.7149999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65600000000000003,"15min":0.98799999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":2.9089999999999998,"5min":4.4489999999999998,"15min":12.852},"last":1.0609999999999999}]},{"osd":6,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.91300000000000003,"15min":1.1160000000000001},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.26700000000000002},"max":{"1min":2.2210000000000001,"5min":15.307,"15min":15.307},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9710000000000001,"5min":5.1429999999999998,"15min":10.548999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":1.101},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":3.5129999999999999,"5min":6.149,"15min":12.805999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":2.0899999999999999,"5min":1.181,"15min":1.226},"min":{"1min":0.439,"5min":0.312,"15min":0.312},"max":{"1min":26.960000000000001,"5min":26.960000000000001,"15min":26.960000000000001},"last":0.83399999999999996}]}]},{"osd":4,"up_from":14,"seq":60129548443,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1581088,"kb_used_data":26520,"kb_used_omap":488,"kb_used_meta":1554071,"kb_avail":92790752,"statfs":{"total":96636764160,"available":95017730048,"internally_reserved":0,"allocated":27156480,"data_stored":26805154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":499847,"internal_metadata":1591369593},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":227,"apply_latency_ms":227,"commit_latency_ns":227000000,"apply_latency_ns":227000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.77500000000000002,"15min":0.86299999999999999},"min":{"1min":0.24399999999999999,"5min":0.221,"15min":0.20499999999999999},"max":{"1min":4.2590000000000003,"5min":8.5519999999999996,"15min":10.225},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.133,"15min":1.008},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.245},"max":{"1min":2.9670000000000001,"5min":8.5649999999999995,"15min":10.241},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.82899999999999996,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.3490000000000002,"5min":4.7050000000000001,"15min":7.0179999999999998},"last":0.879},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.206,"15min":1.044},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.847,"5min":5.5259999999999998,"15min":8.266},"last":0.434}]},{"osd":2,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.121,"15min":1.1799999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.577,"5min":5.8330000000000002,"15min":23.491},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.133,"15min":1.202},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3170000000000002,"5min":7.2759999999999998,"15min":23.311},"last":0.78300000000000003}]},{"osd":3,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":3.3780000000000001,"5min":1.748,"15min":1.29},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":32.417000000000002,"5min":32.417000000000002,"15min":32.417000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6930000000000001,"15min":1.3460000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.75,"5min":34.75,"15min":34.75},"last":0.81599999999999995}]},{"osd":5,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":0.89400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":3.032,"5min":5.4059999999999997,"15min":6.1600000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.1339999999999999,"15min":0.99199999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89800000000000002,"15min":0.93899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":4.375,"5min":4.7789999999999999,"15min":6.1470000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":1.2749999999999999,"15min":1.0700000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.0579999999999998,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.52000000000000002}]},{"osd":7,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.222,"15min":1.071},"min":{"1min":0.34599999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.109,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.96899999999999997},"min":{"1min":0.42099999999999999,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":4.4210000000000003,"5min":4.7610000000000001,"15min":6.1840000000000002},"last":0.73699999999999999}]}]},{"osd":3,"up_from":14,"seq":60129548427,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1620940,"kb_used_data":452,"kb_used_omap":438,"kb_used_meta":1620041,"kb_avail":92750900,"statfs":{"total":96636764160,"available":94976921600,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":448887,"internal_metadata":1658922633},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":5.032,"5min":5.032,"15min":9.8320000000000007},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.728,"5min":1.3759999999999999,"15min":1.155},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":6.6559999999999997,"5min":11.756,"15min":11.756},"last":0.40999999999999998}]},{"osd":1,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":1.8220000000000001,"15min":1.2150000000000001},"min":{"1min":0.28000000000000003,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":22.338000000000001,"5min":22.338000000000001,"15min":22.338000000000001},"last":0.439},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.127,"15min":0.92000000000000004},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.24199999999999999},"max":{"1min":15.903,"5min":15.903,"15min":15.903},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.7250000000000001,"5min":1.891,"15min":1.3440000000000001},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.859,"5min":1.25,"15min":1.044},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":12.17,"5min":12.17,"15min":12.17},"last":0.629}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":1.5009999999999999,"15min":1.2110000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":10.407,"5min":12.07,"15min":12.07},"last":0.76000000000000001},{"interface":"front","average":{"1min":2.9710000000000001,"5min":1.7490000000000001,"15min":1.3129999999999999},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":22.370000000000001,"5min":22.370000000000001,"15min":22.370000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0730000000000004,"5min":1.9359999999999999,"15min":1.417},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":22.25,"5min":22.25,"15min":22.25},"last":0.64200000000000002},{"interface":"front","average":{"1min":3.552,"5min":1.6040000000000001,"15min":1.1639999999999999},"min":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"max":{"1min":22.183,"5min":22.183,"15min":22.183},"last":0.94599999999999995}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":1.1679999999999999,"15min":1.165},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":17.276,"5min":17.276,"15min":17.276},"last":0.81999999999999995},{"interface":"front","average":{"1min":5.306,"5min":2.5070000000000001,"15min":1.764},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":42.237000000000002,"5min":42.237000000000002,"15min":42.237000000000002},"last":0.83799999999999997}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":2.1850000000000001,"15min":1.667},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.38900000000000001},"max":{"1min":12.103,"5min":12.103,"15min":12.103},"last":0.70799999999999996},{"interface":"front","average":{"1min":3.6669999999999998,"5min":2.0230000000000001,"15min":1.6020000000000001},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":22.300000000000001,"5min":22.300000000000001,"15min":22.300000000000001},"last":0.60099999999999998}]}]},{"osd":2,"up_from":14,"seq":60129548430,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1565260,"kb_used_data":452,"kb_used_omap":399,"kb_used_meta":1564400,"kb_avail":92806580,"statfs":{"total":96636764160,"available":95033937920,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":408784,"internal_metadata":1601946416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1023,"apply_latency_ms":1023,"commit_latency_ns":1023000000,"apply_latency_ns":1023000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.65000000000000002,"15min":0.84499999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":5.9470000000000001,"5min":6.1310000000000002,"15min":9.6829999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":3.206,"5min":1.5009999999999999,"15min":1.153},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":23.140999999999998,"5min":23.140999999999998,"15min":23.140999999999998},"last":0.68300000000000005}]},{"osd":1,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":0.82899999999999996,"15min":0.88700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":5.891,"5min":8.0410000000000004,"15min":9.4350000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":3.5219999999999998,"5min":1.605,"15min":1.234},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":23.184000000000001,"5min":23.184000000000001,"15min":23.184000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":7.1260000000000003,"5min":2.3109999999999999,"15min":1.4710000000000001},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":55.256,"5min":55.256,"15min":55.256},"last":0.623},{"interface":"front","average":{"1min":2.8109999999999999,"5min":1.3120000000000001,"15min":1.1619999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":13.315,"5min":15.095000000000001,"15min":15.095000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":0.95399999999999996,"15min":1.014},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":6.7039999999999997,"5min":6.7039999999999997,"15min":9.4789999999999992},"last":0.98199999999999998},{"interface":"front","average":{"1min":4.6459999999999999,"5min":1.7549999999999999,"15min":1.401},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":54.752000000000002,"5min":54.752000000000002,"15min":54.752000000000002},"last":0.71999999999999997}]},{"osd":5,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1800000000000002,"5min":1.7290000000000001,"15min":1.3440000000000001},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"max":{"1min":23.219000000000001,"5min":23.219000000000001,"15min":23.219000000000001},"last":1.01},{"interface":"front","average":{"1min":5.6079999999999997,"5min":2.1269999999999998,"15min":1.5449999999999999},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":35.106999999999999,"5min":35.106999999999999,"15min":35.106999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":4.6109999999999998,"5min":1.948,"15min":1.524},"min":{"1min":0.46999999999999997,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":35.173000000000002,"5min":35.173000000000002,"15min":35.173000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.109,"15min":1.1259999999999999},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":8.1660000000000004,"5min":8.1660000000000004,"15min":9.5090000000000003},"last":1.0189999999999999}]},{"osd":7,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":1.7769999999999999,"15min":1.4730000000000001},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":23.312999999999999,"5min":23.312999999999999,"15min":23.312999999999999},"last":1.093},{"interface":"front","average":{"1min":4.4859999999999998,"5min":2.0089999999999999,"15min":1.5669999999999999},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":35.240000000000002,"5min":35.240000000000002,"15min":35.240000000000002},"last":0.96499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129548433,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1194376,"kb_used_data":114752,"kb_used_omap":349,"kb_used_meta":1079266,"kb_avail":93177464,"statfs":{"total":96636764160,"available":95413723136,"internally_reserved":0,"allocated":117506048,"data_stored":117025053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":358162,"internal_metadata":1105168622},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":239,"apply_latency_ms":239,"commit_latency_ns":239000000,"apply_latency_ns":239000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.8210000000000002,"5min":7.6159999999999997,"15min":19.224},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.105,"5min":0.93400000000000005,"15min":1.01},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":8.2219999999999995,"5min":10.795,"15min":19.341000000000001},"last":0.436}]},{"osd":2,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":14.928000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.492,"5min":0.86199999999999999,"15min":1.042},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":15.393000000000001},"last":0.495}]},{"osd":3,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":11.157,"5min":11.157,"15min":11.157},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.94199999999999995,"15min":0.98599999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.6389999999999993,"5min":8.6389999999999993,"15min":8.6389999999999993},"last":0.57499999999999996}]},{"osd":4,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.311},"max":{"1min":8.6760000000000002,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.893,"5min":1.147,"15min":1.0469999999999999},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32400000000000001},"max":{"1min":8.5429999999999993,"5min":9.8000000000000007,"15min":9.8000000000000007},"last":0.73899999999999999}]},{"osd":5,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.115,"15min":1.194},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":8.3689999999999998,"5min":12.773999999999999,"15min":12.773999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.038,"15min":1.1950000000000001},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":8.7690000000000001,"5min":8.7690000000000001,"15min":8.7690000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.151,"15min":1.0880000000000001},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":8.4969999999999999,"5min":8.4969999999999999,"15min":8.4969999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.52,"5min":1.1459999999999999,"15min":1.2330000000000001},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":8.3399999999999999,"5min":12.821999999999999,"15min":12.821999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.3420000000000001,"15min":1.288},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.2870000000000008,"5min":12.859,"15min":12.859},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.897,"5min":1.3819999999999999,"15min":1.369},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":8.7040000000000006,"5min":8.7040000000000006,"15min":8.7040000000000006},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834581137,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1661072,"kb_used_data":1032,"kb_used_omap":539,"kb_used_meta":1659492,"kb_avail":92710768,"statfs":{"total":96636764160,"available":94935826432,"internally_reserved":0,"allocated":1056768,"data_stored":775696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":552774,"internal_metadata":1699319994},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":177,"apply_latency_ms":177,"commit_latency_ns":177000000,"apply_latency_ns":177000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.748,"15min":0.85299999999999998},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20100000000000001},"max":{"1min":2.48,"5min":5.7999999999999998,"15min":7.9189999999999996},"last":1.2589999999999999},{"interface":"front","average":{"1min":3.0489999999999999,"5min":1.3120000000000001,"15min":0.98299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":38.442,"5min":38.442,"15min":38.442},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":1.3859999999999999,"15min":1.2629999999999999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":22.739999999999998,"5min":22.739999999999998,"15min":22.739999999999998},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.80700000000000005,"15min":0.89100000000000001},"min":{"1min":0.31900000000000001,"5min":0.22700000000000001,"15min":0.22},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":7.9889999999999999},"last":1.119}]},{"osd":3,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0449999999999999,"15min":1.077},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.1840000000000002,"5min":6.1840000000000002,"15min":8.9390000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.1160000000000001,"15min":1.0589999999999999},"min":{"1min":0.28499999999999998,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":5.1180000000000003,"5min":8.8919999999999995,"15min":8.8919999999999995},"last":1.214}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":1.383,"15min":1.2929999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29699999999999999},"max":{"1min":22.84,"5min":22.84,"15min":22.84},"last":0.98399999999999999},{"interface":"front","average":{"1min":2.4529999999999998,"5min":1.3280000000000001,"15min":1.2330000000000001},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":25.719000000000001,"5min":25.719000000000001,"15min":25.719000000000001},"last":1.619}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":1.1579999999999999,"15min":1.01},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.9060000000000006,"5min":8.9060000000000006,"15min":8.9060000000000006},"last":0.999},{"interface":"front","average":{"1min":1.514,"5min":1.196,"15min":1.3220000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32900000000000001},"max":{"1min":10.329000000000001,"5min":10.329000000000001,"15min":10.329000000000001},"last":1.1910000000000001}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.3500000000000001,"15min":1.1830000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.5940000000000003,"5min":6.1379999999999999,"15min":6.1379999999999999},"last":1.165},{"interface":"front","average":{"1min":1.446,"5min":1.1859999999999999,"15min":1.3},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.375},"max":{"1min":10.364000000000001,"5min":10.364000000000001,"15min":10.364000000000001},"last":1.1000000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.1559999999999999,"15min":1.137},"min":{"1min":0.49099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.1219999999999999,"5min":6.1219999999999999,"15min":8.0549999999999997},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4830000000000001,"15min":1.26},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.6230000000000002,"5min":6.149,"15min":6.1689999999999996},"last":1.0640000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T01:33:53.467 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-30T16:49:04.397753+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=16, tm_min=49, tm_sec=4, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=1, tm_hour=1, tm_min=33, tm_sec=46, tm_wday=6, tm_yday=274, tm_isdst=0) 2023-10-01T01:33:53.467 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-01T01:34:13.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-01T01:34:13.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 Processor -- start 2023-10-01T01:34:13.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 -- start start 2023-10-01T01:34:13.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4f0415ce10 0x7f4f040b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 0x7f4f040cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040b7570 con 0x7f4f040d0fa0 2023-10-01T01:34:13.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040b7850 con 0x7f4f0415ce10 2023-10-01T01:34:13.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f095ba640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040b7b30 con 0x7f4f040cd870 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 0x7f4f040cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 0x7f4f040cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.52:57690/0 (socket says 172.21.15.52:57690) 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f02ffd640 1 --2- 172.21.15.52:0/387309307 >> v2:172.21.15.186:3300/0 conn(0x7f4f0415ce10 0x7f4f040b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 -- 172.21.15.52:0/387309307 learned_addr learned my addr 172.21.15.52:0/387309307 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 -- 172.21.15.52:0/387309307 >> v2:172.21.15.186:3300/0 conn(0x7f4f0415ce10 msgr2=0x7f4f040b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 --2- 172.21.15.52:0/387309307 >> v2:172.21.15.186:3300/0 conn(0x7f4f0415ce10 0x7f4f040b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 -- 172.21.15.52:0/387309307 >> v1:172.21.15.186:6789/0 conn(0x7f4f040d0fa0 legacy=0x7f4f040d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.599+0000 7f4f027fc640 1 -- 172.21.15.52:0/387309307 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f040b7e10 con 0x7f4f040cd870 2023-10-01T01:34:13.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f027fc640 1 --2- 172.21.15.52:0/387309307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 0x7f4f040cdcb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009870 tx=0x7f4ef801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=491303475a2d9913 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:13.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f01ffb640 1 -- 172.21.15.52:0/387309307 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef80aa5f0 con 0x7f4f040cd870 2023-10-01T01:34:13.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f01ffb640 1 -- 172.21.15.52:0/387309307 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef80aa750 con 0x7f4f040cd870 2023-10-01T01:34:13.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f01ffb640 1 -- 172.21.15.52:0/387309307 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef80aaae0 con 0x7f4f040cd870 2023-10-01T01:34:13.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 -- 172.21.15.52:0/387309307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 msgr2=0x7f4f040cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 --2- 172.21.15.52:0/387309307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 0x7f4f040cdcb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009870 tx=0x7f4ef801c4b0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 -- 172.21.15.52:0/387309307 shutdown_connections 2023-10-01T01:34:13.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 --2- 172.21.15.52:0/387309307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040cd870 0x7f4f040cdcb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 --2- 172.21.15.52:0/387309307 >> v2:172.21.15.186:3300/0 conn(0x7f4f0415ce10 0x7f4f040b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 -- 172.21.15.52:0/387309307 >> 172.21.15.52:0/387309307 conn(0x7f4f04071930 msgr2=0x7f4f04071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:34:13.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 -- 172.21.15.52:0/387309307 shutdown_connections 2023-10-01T01:34:13.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 -- 172.21.15.52:0/387309307 wait complete. 2023-10-01T01:34:13.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 Processor -- start 2023-10-01T01:34:13.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.603+0000 7f4f095ba640 1 -- start start 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 0x7f4f04152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f040d0fa0 0x7f4f04151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040c6230 0x7f4f0415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04152370 con 0x7f4f040cd870 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040c90c0 con 0x7f4f040d0fa0 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04152c00 con 0x7f4f040c6230 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 0x7f4f04152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 0x7f4f04152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34904/0 (socket says 172.21.15.52:34904) 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 -- 172.21.15.52:0/940713962 learned_addr learned my addr 172.21.15.52:0/940713962 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f037fe640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040c6230 0x7f4f0415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f027fc640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f040d0fa0 0x7f4f04151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 -- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040c6230 msgr2=0x7f4f0415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040c6230 0x7f4f0415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 -- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f040d0fa0 msgr2=0x7f4f04151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f040d0fa0 0x7f4f04151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 -- 172.21.15.52:0/940713962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80094d0 con 0x7f4f040cd870 2023-10-01T01:34:13.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f02ffd640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 0x7f4f04152500 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400e870 tx=0x7f4ef400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:13.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4009510 con 0x7f4f040cd870 2023-10-01T01:34:13.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef400eec0 con 0x7f4f040cd870 2023-10-01T01:34:13.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f04152ee0 con 0x7f4f040cd870 2023-10-01T01:34:13.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400cae0 con 0x7f4f040cd870 2023-10-01T01:34:13.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f041534a0 con 0x7f4f040cd870 2023-10-01T01:34:13.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f040740a0 con 0x7f4f040cd870 2023-10-01T01:34:13.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f4ef400cc40 con 0x7f4f040cd870 2023-10-01T01:34:13.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4eeb7fe640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ef0066160 0x7f4ef0068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4ef40838e0 con 0x7f4f040cd870 2023-10-01T01:34:13.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.607+0000 7f4f027fc640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ef0066160 0x7f4ef0068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.611+0000 7f4f027fc640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ef0066160 0x7f4ef0068620 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80ae000 tx=0x7f4ef8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:13.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.615+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f4ef4051190 con 0x7f4f040cd870 2023-10-01T01:34:13.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.767+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 --> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f040b30f0 con 0x7f4ef0066160 2023-10-01T01:34:13.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.771+0000 7f4eeb7fe640 1 -- 172.21.15.52:0/940713962 <== mgr.4108 v2:172.21.15.186:6832/1582402253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49171 (secure 0 0 0) 0x7f4f040b30f0 con 0x7f4ef0066160 2023-10-01T01:34:13.781 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:34:13.783 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-10-01T01:34:13.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ef0066160 msgr2=0x7f4ef0068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ef0066160 0x7f4ef0068620 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80ae000 tx=0x7f4ef8008040 comp rx=0 tx=0).stop 2023-10-01T01:34:13.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 msgr2=0x7f4f04152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 0x7f4f04152500 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400e870 tx=0x7f4ef400ec70 comp rx=0 tx=0).stop 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 shutdown_connections 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f4ef0066160 0x7f4ef0068620 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f040c6230 0x7f4f0415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f040d0fa0 0x7f4f04151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 --2- 172.21.15.52:0/940713962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f040cd870 0x7f4f04152500 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 >> 172.21.15.52:0/940713962 conn(0x7f4f04071930 msgr2=0x7f4f0415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:34:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 shutdown_connections 2023-10-01T01:34:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.775+0000 7f4f095ba640 1 -- 172.21.15.52:0/940713962 wait complete. 2023-10-01T01:34:13.800 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":15783,"stamp":"2023-10-01T01:34:12.869136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12639656,"kb_used_data":4776,"kb_used_omap":3673,"kb_used_meta":12631142,"kb_avail":742335064,"statfs":{"total":773094113280,"available":760151105536,"internally_reserved":0,"allocated":4890624,"data_stored":2663360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3761525,"internal_metadata":12934290059},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003139"},"pg_stats":[{"pgid":"1.0","version":"40'163","reported_seq":506,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-01T01:33:59.670470+0000","last_change":"2023-10-01T01:33:59.670470+0000","last_active":"2023-10-01T01:33:59.670470+0000","last_peered":"2023-10-01T01:33:59.670470+0000","last_clean":"2023-10-01T01:33:59.670470+0000","last_became_active":"2023-09-30T16:49:05.417402+0000","last_became_peered":"2023-09-30T16:49:05.417402+0000","last_unstale":"2023-10-01T01:33:59.670470+0000","last_undegraded":"2023-10-01T01:33:59.670470+0000","last_fullsized":"2023-10-01T01:33:59.670470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'163","last_scrub_stamp":"2023-10-01T01:33:59.670051+0000","last_deep_scrub":"40'163","last_deep_scrub_stamp":"2023-10-01T01:33:59.670051+0000","last_clean_scrub_stamp":"2023-10-01T01:33:59.670051+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T09:42:55.907604+0000","scrub_duration":1.8050973049999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129548447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1690828,"kb_used_data":452,"kb_used_omap":564,"kb_used_meta":1689803,"kb_avail":92681012,"statfs":{"total":96636764160,"available":94905356288,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":577944,"internal_metadata":1730358888},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.68100000000000005,"15min":0.78700000000000003},"min":{"1min":0.253,"5min":0.248,"15min":0.23100000000000001},"max":{"1min":0.85599999999999998,"5min":5.3360000000000003,"15min":6.6909999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.105,"5min":0.88700000000000001,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.255},"max":{"1min":5.9580000000000002,"5min":5.9580000000000002,"15min":6.109},"last":1.2769999999999999}]},{"osd":1,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81299999999999994,"15min":0.99399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.9039999999999999,"5min":5.2910000000000004,"15min":6.726},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.94799999999999995,"15min":1.0740000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.27900000000000003},"max":{"1min":4.8029999999999999,"5min":5.2850000000000001,"15min":9.8680000000000003},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.2769999999999999,"15min":1.236},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.6399999999999997,"5min":32.707000000000001,"15min":32.707000000000001},"last":1.109},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.1950000000000001,"15min":1.272},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":1.589,"5min":32.853000000000002,"15min":32.853000000000002},"last":1.2150000000000001}]},{"osd":3,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.0569999999999999,"15min":1.29},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6840000000000002,"5min":5.8140000000000001,"15min":10.702},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.90500000000000003,"15min":1.1339999999999999},"min":{"1min":0.33800000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.95099999999999996,"5min":8.1370000000000005,"15min":8.1370000000000005},"last":1.075}]},{"osd":4,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.68300000000000005,"15min":0.89800000000000002},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.24099999999999999},"max":{"1min":0.95099999999999996,"5min":5.2140000000000004,"15min":6.9770000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.82799999999999996,"15min":1.028},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26400000000000001},"max":{"1min":2.2789999999999999,"5min":5.3579999999999997,"15min":7.9710000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.90200000000000002,"15min":1.0349999999999999},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.26800000000000002},"max":{"1min":1.51,"5min":10.757999999999999,"15min":10.757999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.85699999999999998,"15min":0.95999999999999996},"min":{"1min":0.33300000000000002,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":0.98599999999999999,"5min":5.7300000000000004,"15min":6.8040000000000003},"last":1.165}]},{"osd":6,"last update":"Sun Oct 1 01:33:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.32300000000000001},"max":{"1min":5.2590000000000003,"5min":5.9219999999999997,"15min":8.8000000000000007},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.071,"5min":0.95499999999999996,"15min":1.071},"min":{"1min":0.437,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":8.8819999999999997},"last":1.0409999999999999}]}]},{"osd":6,"up_from":14,"seq":60129548449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1648460,"kb_used_data":452,"kb_used_omap":29,"kb_used_meta":1647970,"kb_avail":92723380,"statfs":{"total":96636764160,"available":94948741120,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30210,"internal_metadata":1687521790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.2390000000000001,"15min":0.95099999999999996},"min":{"1min":0.23999999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.69,"5min":15.537000000000001,"15min":15.537000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.3220000000000001,"15min":1.0069999999999999},"min":{"1min":0.34200000000000003,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":10.746,"5min":10.746,"15min":10.746},"last":1.0389999999999999}]},{"osd":1,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.2849999999999999,"15min":1.1060000000000001},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":4.6799999999999997,"5min":15.608000000000001,"15min":15.608000000000001},"last":1.294},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.2809999999999999,"15min":1.181},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.2489999999999997,"5min":8.9429999999999996,"15min":8.9429999999999996},"last":0.876}]},{"osd":2,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":1.28,"15min":1.198},"min":{"1min":0.309,"5min":0.29399999999999998,"15min":0.27400000000000002},"max":{"1min":14.789999999999999,"5min":14.789999999999999,"15min":14.789999999999999},"last":1.216},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.478,"15min":1.26},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.26800000000000002},"max":{"1min":4.6420000000000003,"5min":15.951000000000001,"15min":15.951000000000001},"last":0.99199999999999999}]},{"osd":3,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.603,"15min":1.385},"min":{"1min":0.41799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":17.786000000000001,"5min":17.786000000000001,"15min":17.786000000000001},"last":1.262},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.151,"15min":1.1639999999999999},"min":{"1min":0.35499999999999998,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":15.087999999999999,"5min":15.087999999999999,"15min":15.087999999999999},"last":1.0760000000000001}]},{"osd":4,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.319,"15min":1.0149999999999999},"min":{"1min":0.29199999999999998,"5min":0.253,"15min":0.253},"max":{"1min":11.936,"5min":16.077999999999999,"15min":16.077999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.157,"15min":1.034},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":12.196999999999999,"5min":12.196999999999999,"15min":12.196999999999999},"last":0.752}]},{"osd":5,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.014,"15min":1.016},"min":{"1min":0.434,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":14.734999999999999,"5min":14.734999999999999,"15min":14.734999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":1.202,"15min":1.024},"min":{"1min":0.39100000000000001,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":2.2250000000000001,"5min":15.640000000000001,"15min":15.640000000000001},"last":1.1140000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:51 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.1479999999999999,"15min":1.089},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":3.3450000000000002,"5min":16.129000000000001,"15min":16.129000000000001},"last":1.161},{"interface":"front","average":{"1min":1.9179999999999999,"5min":1.28,"15min":1.099},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.309},"max":{"1min":22.548999999999999,"5min":22.548999999999999,"15min":22.548999999999999},"last":1.321}]}]},{"osd":5,"up_from":14,"seq":60129548448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1781904,"kb_used_data":1032,"kb_used_omap":864,"kb_used_meta":1779999,"kb_avail":92589936,"statfs":{"total":96636764160,"available":94812094464,"internally_reserved":0,"allocated":1056768,"data_stored":775696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":884917,"internal_metadata":1822719819},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.58799999999999997,"15min":0.71799999999999997},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.6339999999999999,"5min":5.6829999999999998,"15min":10.228999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.2789999999999999,"5min":0.77800000000000002,"15min":1.073},"min":{"1min":0.36599999999999999,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":12.055},"last":1.294}]},{"osd":1,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.754,"15min":1.1559999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":2.7829999999999999,"5min":4.6180000000000003,"15min":10.068},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.94999999999999996,"15min":0.88800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":5.3609999999999998,"5min":5.3609999999999998,"15min":9.4689999999999994},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.98899999999999999,"15min":1.0920000000000001},"min":{"1min":0.31,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.7669999999999999,"5min":7.5780000000000003,"15min":12.086},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.97099999999999997,"15min":1.2949999999999999},"min":{"1min":0.34499999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.8340000000000001,"5min":11.26,"15min":11.26},"last":1.2130000000000001}]},{"osd":3,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.4910000000000001,"5min":1.482,"15min":1.399},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":50.969000000000001,"5min":50.969000000000001,"15min":50.969000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":4.093,"5min":1.7789999999999999,"15min":1.5840000000000001},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":50.537999999999997,"5min":50.537999999999997,"15min":50.537999999999997},"last":1.141}]},{"osd":4,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.84899999999999998,"15min":0.71199999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.8799999999999999,"5min":5.7119999999999997,"15min":5.7149999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.65600000000000003,"15min":0.98799999999999999},"min":{"1min":0.318,"5min":0.314,"15min":0.28999999999999998},"max":{"1min":2.9089999999999998,"5min":4.4489999999999998,"15min":12.852},"last":1.0369999999999999}]},{"osd":6,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.91300000000000003,"15min":1.1160000000000001},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.26700000000000002},"max":{"1min":2.2210000000000001,"5min":15.307,"15min":15.307},"last":0.997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.9710000000000001,"5min":5.1429999999999998,"15min":10.548999999999999},"last":1.071}]},{"osd":7,"last update":"Sun Oct 1 01:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.95499999999999996,"15min":1.101},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":3.5129999999999999,"5min":6.149,"15min":12.805999999999999},"last":1.238},{"interface":"front","average":{"1min":2.0899999999999999,"5min":1.181,"15min":1.226},"min":{"1min":0.439,"5min":0.312,"15min":0.312},"max":{"1min":26.960000000000001,"5min":26.960000000000001,"15min":26.960000000000001},"last":1.2689999999999999}]}]},{"osd":4,"up_from":14,"seq":60129548447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1555020,"kb_used_data":452,"kb_used_omap":488,"kb_used_meta":1554071,"kb_avail":92816820,"statfs":{"total":96636764160,"available":95044423680,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":499847,"internal_metadata":1591369593},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.77500000000000002,"15min":0.86299999999999999},"min":{"1min":0.24399999999999999,"5min":0.221,"15min":0.20499999999999999},"max":{"1min":4.2590000000000003,"5min":8.5519999999999996,"15min":10.225},"last":1.044},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.133,"15min":1.008},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.245},"max":{"1min":2.9670000000000001,"5min":8.5649999999999995,"15min":10.241},"last":0.98699999999999999}]},{"osd":1,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.82899999999999996,"15min":0.95699999999999996},"min":{"1min":0.29599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.3490000000000002,"5min":4.7050000000000001,"15min":7.0179999999999998},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.206,"15min":1.044},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.847,"5min":5.5259999999999998,"15min":8.266},"last":0.90800000000000003}]},{"osd":2,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.121,"15min":1.1799999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.577,"5min":5.8330000000000002,"15min":23.491},"last":1.018},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.133,"15min":1.202},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3170000000000002,"5min":7.2759999999999998,"15min":23.311},"last":0.77400000000000002}]},{"osd":3,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":3.3780000000000001,"5min":1.748,"15min":1.29},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":32.417000000000002,"5min":32.417000000000002,"15min":32.417000000000002},"last":0.86299999999999999},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6930000000000001,"15min":1.3460000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.75,"5min":34.75,"15min":34.75},"last":1.151}]},{"osd":5,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":0.89400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.24399999999999999},"max":{"1min":3.032,"5min":5.4059999999999997,"15min":6.1600000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.1339999999999999,"15min":0.99199999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":8.5109999999999992,"15min":8.5109999999999992},"last":1.1339999999999999}]},{"osd":6,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89800000000000002,"15min":0.93899999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":4.375,"5min":4.7789999999999999,"15min":6.1470000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":1.2749999999999999,"15min":1.0700000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.0579999999999998,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.80900000000000005}]},{"osd":7,"last update":"Sun Oct 1 01:33:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.222,"15min":1.071},"min":{"1min":0.34599999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.109,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.96899999999999997},"min":{"1min":0.42099999999999999,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":4.4210000000000003,"5min":4.7610000000000001,"15min":6.1840000000000002},"last":0.94099999999999995}]}]},{"osd":3,"up_from":14,"seq":60129548431,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1620940,"kb_used_data":452,"kb_used_omap":438,"kb_used_meta":1620041,"kb_avail":92750900,"statfs":{"total":96636764160,"available":94976921600,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":448887,"internal_metadata":1658922633},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":5.032,"5min":5.032,"15min":9.8320000000000007},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.728,"5min":1.3759999999999999,"15min":1.155},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":6.6559999999999997,"5min":11.756,"15min":11.756},"last":0.97199999999999998}]},{"osd":1,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":1.8220000000000001,"15min":1.2150000000000001},"min":{"1min":0.28000000000000003,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":22.338000000000001,"5min":22.338000000000001,"15min":22.338000000000001},"last":1.044},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.127,"15min":0.92000000000000004},"min":{"1min":0.25800000000000001,"5min":0.252,"15min":0.24199999999999999},"max":{"1min":15.903,"5min":15.903,"15min":15.903},"last":1.129}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.7250000000000001,"5min":1.891,"15min":1.3440000000000001},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":1.244},{"interface":"front","average":{"1min":1.859,"5min":1.25,"15min":1.044},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":12.17,"5min":12.17,"15min":12.17},"last":1.321}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":1.5009999999999999,"15min":1.2110000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":10.407,"5min":12.07,"15min":12.07},"last":1.0940000000000001},{"interface":"front","average":{"1min":2.9710000000000001,"5min":1.7490000000000001,"15min":1.3129999999999999},"min":{"1min":0.35299999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":22.370000000000001,"5min":22.370000000000001,"15min":22.370000000000001},"last":1.361}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":4.0730000000000004,"5min":1.9359999999999999,"15min":1.417},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":22.25,"5min":22.25,"15min":22.25},"last":1.4550000000000001},{"interface":"front","average":{"1min":3.552,"5min":1.6040000000000001,"15min":1.1639999999999999},"min":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"max":{"1min":22.183,"5min":22.183,"15min":22.183},"last":1.7130000000000001}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":1.1679999999999999,"15min":1.165},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":17.276,"5min":17.276,"15min":17.276},"last":1.609},{"interface":"front","average":{"1min":5.306,"5min":2.5070000000000001,"15min":1.764},"min":{"1min":0.438,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":42.237000000000002,"5min":42.237000000000002,"15min":42.237000000000002},"last":1.1759999999999999}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":2.1850000000000001,"15min":1.667},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.38900000000000001},"max":{"1min":12.103,"5min":12.103,"15min":12.103},"last":1.2909999999999999},{"interface":"front","average":{"1min":3.6669999999999998,"5min":2.0230000000000001,"15min":1.6020000000000001},"min":{"1min":0.40899999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":22.300000000000001,"5min":22.300000000000001,"15min":22.300000000000001},"last":1.5489999999999999}]}]},{"osd":2,"up_from":14,"seq":60129548434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1565260,"kb_used_data":452,"kb_used_omap":399,"kb_used_meta":1564400,"kb_avail":92806580,"statfs":{"total":96636764160,"available":95033937920,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":408784,"internal_metadata":1601946416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.65000000000000002,"15min":0.84499999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":5.9470000000000001,"5min":6.1310000000000002,"15min":9.6829999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":3.206,"5min":1.5009999999999999,"15min":1.153},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":23.140999999999998,"5min":23.140999999999998,"15min":23.140999999999998},"last":0.91500000000000004}]},{"osd":1,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":0.82899999999999996,"15min":0.88700000000000001},"min":{"1min":0.252,"5min":0.22900000000000001,"15min":0.20200000000000001},"max":{"1min":5.891,"5min":8.0410000000000004,"15min":9.4350000000000005},"last":0.82799999999999996},{"interface":"front","average":{"1min":3.5219999999999998,"5min":1.605,"15min":1.234},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":23.184000000000001,"5min":23.184000000000001,"15min":23.184000000000001},"last":1.1639999999999999}]},{"osd":3,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":7.1260000000000003,"5min":2.3109999999999999,"15min":1.4710000000000001},"min":{"1min":0.29599999999999999,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":55.256,"5min":55.256,"15min":55.256},"last":0.99399999999999999},{"interface":"front","average":{"1min":2.8109999999999999,"5min":1.3120000000000001,"15min":1.1619999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":13.315,"5min":15.095000000000001,"15min":15.095000000000001},"last":1.083}]},{"osd":4,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":1.7829999999999999,"5min":0.95399999999999996,"15min":1.014},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":6.7039999999999997,"5min":6.7039999999999997,"15min":9.4789999999999992},"last":1.2090000000000001},{"interface":"front","average":{"1min":4.6459999999999999,"5min":1.7549999999999999,"15min":1.401},"min":{"1min":0.35399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":54.752000000000002,"5min":54.752000000000002,"15min":54.752000000000002},"last":1.2929999999999999}]},{"osd":5,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1800000000000002,"5min":1.7290000000000001,"15min":1.3440000000000001},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.33800000000000002},"max":{"1min":23.219000000000001,"5min":23.219000000000001,"15min":23.219000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":5.6079999999999997,"5min":2.1269999999999998,"15min":1.5449999999999999},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":35.106999999999999,"5min":35.106999999999999,"15min":35.106999999999999},"last":1.133}]},{"osd":6,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":4.6109999999999998,"5min":1.948,"15min":1.524},"min":{"1min":0.46999999999999997,"5min":0.36099999999999999,"15min":0.33500000000000002},"max":{"1min":35.173000000000002,"5min":35.173000000000002,"15min":35.173000000000002},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.109,"15min":1.1259999999999999},"min":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38600000000000001},"max":{"1min":8.1660000000000004,"5min":8.1660000000000004,"15min":9.5090000000000003},"last":1.3560000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:19 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":1.7769999999999999,"15min":1.4730000000000001},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":23.312999999999999,"5min":23.312999999999999,"15min":23.312999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":4.4859999999999998,"5min":2.0089999999999999,"15min":1.5669999999999999},"min":{"1min":0.434,"5min":0.40999999999999998,"15min":0.38600000000000001},"max":{"1min":35.240000000000002,"5min":35.240000000000002,"15min":35.240000000000002},"last":1.242}]}]},{"osd":0,"up_from":14,"seq":60129548437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1098124,"kb_used_data":452,"kb_used_omap":349,"kb_used_meta":1097314,"kb_avail":93273716,"statfs":{"total":96636764160,"available":95512285184,"internally_reserved":0,"allocated":462848,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":358162,"internal_metadata":1123649774},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.8210000000000002,"5min":7.6159999999999997,"15min":19.224},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.105,"5min":0.93400000000000005,"15min":1.01},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":8.2219999999999995,"5min":10.795,"15min":19.341000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":14.928000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.492,"5min":0.86199999999999999,"15min":1.042},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.219},"max":{"1min":8.1720000000000006,"5min":8.1720000000000006,"15min":15.393000000000001},"last":0.94799999999999995}]},{"osd":3,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.157,"15min":1.0609999999999999},"min":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":11.157,"5min":11.157,"15min":11.157},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":0.94199999999999995,"15min":0.98599999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.6389999999999993,"5min":8.6389999999999993,"15min":8.6389999999999993},"last":1.0429999999999999}]},{"osd":4,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.1579999999999999,"15min":1.079},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.311},"max":{"1min":8.6760000000000002,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.893,"5min":1.147,"15min":1.0469999999999999},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32400000000000001},"max":{"1min":8.5429999999999993,"5min":9.8000000000000007,"15min":9.8000000000000007},"last":1.1850000000000001}]},{"osd":5,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.115,"15min":1.194},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.34899999999999998},"max":{"1min":8.3689999999999998,"5min":12.773999999999999,"15min":12.773999999999999},"last":1.111},{"interface":"front","average":{"1min":1.21,"5min":1.038,"15min":1.1950000000000001},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":8.7690000000000001,"5min":8.7690000000000001,"15min":8.7690000000000001},"last":1.149}]},{"osd":6,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.151,"15min":1.0880000000000001},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":8.4969999999999999,"5min":8.4969999999999999,"15min":8.4969999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.1459999999999999,"15min":1.2330000000000001},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":8.3399999999999999,"5min":12.821999999999999,"15min":12.821999999999999},"last":1.2310000000000001}]},{"osd":7,"last update":"Sun Oct 1 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.3420000000000001,"15min":1.288},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.2870000000000008,"5min":12.859,"15min":12.859},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.897,"5min":1.3819999999999999,"15min":1.369},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":8.7040000000000006,"5min":8.7040000000000006,"15min":8.7040000000000006},"last":1.2749999999999999}]}]},{"osd":1,"up_from":13,"seq":55834581141,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1679120,"kb_used_data":1032,"kb_used_omap":539,"kb_used_meta":1677540,"kb_avail":92692720,"statfs":{"total":96636764160,"available":94917345280,"internally_reserved":0,"allocated":1056768,"data_stored":775696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":552774,"internal_metadata":1717801146},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.748,"15min":0.85299999999999998},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20100000000000001},"max":{"1min":2.48,"5min":5.7999999999999998,"15min":7.9189999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":3.0489999999999999,"5min":1.3120000000000001,"15min":0.98299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":38.442,"5min":38.442,"15min":38.442},"last":0.748}]},{"osd":2,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":1.3859999999999999,"15min":1.2629999999999999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":22.739999999999998,"5min":22.739999999999998,"15min":22.739999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.80700000000000005,"15min":0.89100000000000001},"min":{"1min":0.31900000000000001,"5min":0.22700000000000001,"15min":0.22},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":7.9889999999999999},"last":1.1319999999999999}]},{"osd":3,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.0449999999999999,"15min":1.077},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.25900000000000001},"max":{"1min":6.1840000000000002,"5min":6.1840000000000002,"15min":8.9390000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.1160000000000001,"15min":1.0589999999999999},"min":{"1min":0.28499999999999998,"5min":0.27000000000000002,"15min":0.245},"max":{"1min":5.1180000000000003,"5min":8.8919999999999995,"15min":8.8919999999999995},"last":0.95999999999999996}]},{"osd":4,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":2.411,"5min":1.383,"15min":1.2929999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29699999999999999},"max":{"1min":22.84,"5min":22.84,"15min":22.84},"last":1.6839999999999999},{"interface":"front","average":{"1min":2.4529999999999998,"5min":1.3280000000000001,"15min":1.2330000000000001},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":25.719000000000001,"5min":25.719000000000001,"15min":25.719000000000001},"last":1.5409999999999999}]},{"osd":5,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":1.1579999999999999,"15min":1.01},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.9060000000000006,"5min":8.9060000000000006,"15min":8.9060000000000006},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.196,"15min":1.3220000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32900000000000001},"max":{"1min":10.329000000000001,"5min":10.329000000000001,"15min":10.329000000000001},"last":1.6080000000000001}]},{"osd":6,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.3500000000000001,"15min":1.1830000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.5940000000000003,"5min":6.1379999999999999,"15min":6.1379999999999999},"last":1.337},{"interface":"front","average":{"1min":1.446,"5min":1.1859999999999999,"15min":1.3},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.375},"max":{"1min":10.364000000000001,"5min":10.364000000000001,"15min":10.364000000000001},"last":1.8129999999999999}]},{"osd":7,"last update":"Sun Oct 1 01:33:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.1559999999999999,"15min":1.137},"min":{"1min":0.49099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.1219999999999999,"5min":6.1219999999999999,"15min":8.0549999999999997},"last":1.385},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4830000000000001,"15min":1.26},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.6230000000000002,"5min":6.149,"15min":6.1689999999999996},"last":1.4670000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-01T01:34:13.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-01T01:34:13.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5f5c2640 1 Processor -- start 2023-10-01T01:34:13.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5f5c2640 1 -- start start 2023-10-01T01:34:13.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5f5c2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbd5815a8b0 0x7fbd5806d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5f5c2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5806db90 con 0x7fbd580b00a0 2023-10-01T01:34:13.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5f5c2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5815ea50 con 0x7fbd5815e4b0 2023-10-01T01:34:13.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5f5c2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580b1b80 con 0x7fbd5815a8b0 2023-10-01T01:34:13.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbd580b00a0 0x7fbd580b0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47010/0 (socket says 172.21.15.52:47010) 2023-10-01T01:34:13.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 -- 172.21.15.52:0/5475418 learned_addr learned my addr 172.21.15.52:0/5475418 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:34:13.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5d35e640 1 --2- 172.21.15.52:0/5475418 >> v2:172.21.15.186:3300/0 conn(0x7fbd5815a8b0 0x7fbd5806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816156913 0 0) 0x7fbd5806db90 con 0x7fbd580b00a0 2023-10-01T01:34:13.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd40003530 con 0x7fbd580b00a0 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3592296802 0 0) 0x7fbd40003530 con 0x7fbd580b00a0 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 >> v2:172.21.15.186:3300/0 conn(0x7fbd5815a8b0 msgr2=0x7fbd5806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 --2- 172.21.15.52:0/5475418 >> v2:172.21.15.186:3300/0 conn(0x7fbd5815a8b0 0x7fbd5806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 >> v1:172.21.15.186:6789/0 conn(0x7fbd5815e4b0 legacy=0x7fbd580b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5815ed30 con 0x7fbd580b00a0 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7fbd50001680 con 0x7fbd580b00a0 2023-10-01T01:34:13.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 >> v1:172.21.15.52:6789/0 conn(0x7fbd580b00a0 legacy=0x7fbd580b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40003980 0x7fbd40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd400047d0 0x7fbd40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd40005190 0x7fbd4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580b1b80 con 0x7fbd40005190 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4000c030 con 0x7fbd40003980 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4000c1f0 con 0x7fbd400047d0 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd40005190 0x7fbd4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5cb5d640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd400047d0 0x7fbd40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 -- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd400047d0 msgr2=0x7fbd40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd400047d0 0x7fbd40004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 -- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40003980 msgr2=0x7fbd40003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5d35e640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40003980 0x7fbd40003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40003980 0x7fbd40003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5db5f640 1 -- 172.21.15.52:0/5475418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40003530 con 0x7fbd40005190 2023-10-01T01:34:13.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.923+0000 7fbd5cb5d640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd400047d0 0x7fbd40004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-01T01:34:13.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5db5f640 1 -- 172.21.15.52:0/5475418 reap_dead start 2023-10-01T01:34:13.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5db5f640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd40005190 0x7fbd4000b990 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fbd50001060 tx=0x7fbd5001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73941dfbb42a5da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:13.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500a5b00 con 0x7fbd40005190 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd500a5c60 con 0x7fbd40005190 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd57fff640 1 -- 172.21.15.52:0/5475418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500058e0 con 0x7fbd40005190 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/5475418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd40005190 msgr2=0x7fbd4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd40005190 0x7fbd4000b990 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fbd50001060 tx=0x7fbd5001cc00 comp rx=0 tx=0).stop 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/5475418 shutdown_connections 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/5475418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd40005190 0x7fbd4000b990 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/5475418 >> 172.21.15.52:0/5475418 conn(0x7fbd5806a5c0 msgr2=0x7fbd580ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/5475418 shutdown_connections 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/5475418 wait complete. 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 Processor -- start 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.927+0000 7fbd5f5c2640 1 -- start start 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40005190 0x7fbd580ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 0x7fbd580b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd580b3090 0x7fbd580cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580b3510 con 0x7fbd5814a9e0 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580ac800 con 0x7fbd40005190 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580cd0b0 con 0x7fbd580b3090 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 0x7fbd580b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 0x7fbd580b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34932/0 (socket says 172.21.15.52:34932) 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 -- 172.21.15.52:0/389971403 learned_addr learned my addr 172.21.15.52:0/389971403 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 -- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd580b3090 msgr2=0x7fbd580cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd580b3090 0x7fbd580cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5d35e640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40005190 0x7fbd580ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 -- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40005190 msgr2=0x7fbd580ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40005190 0x7fbd580ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 -- 172.21.15.52:0/389971403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580abbf0 con 0x7fbd5814a9e0 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5cb5d640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 0x7fbd580b2b50 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00e4b0 tx=0x7fbd4c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0052e0 con 0x7fbd5814a9e0 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c005440 con 0x7fbd5814a9e0 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580abed0 con 0x7fbd5814a9e0 2023-10-01T01:34:13.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c003820 con 0x7fbd5814a9e0 2023-10-01T01:34:13.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd580ac490 con 0x7fbd5814a9e0 2023-10-01T01:34:13.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd58073890 con 0x7fbd5814a9e0 2023-10-01T01:34:13.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7fbd4c003980 con 0x7fbd5814a9e0 2023-10-01T01:34:13.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd55ffb640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbd44066190 0x7fbd44068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:13.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.931+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd4c083420 con 0x7fbd5814a9e0 2023-10-01T01:34:13.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.935+0000 7fbd5d35e640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbd44066190 0x7fbd44068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:13.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.935+0000 7fbd5d35e640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbd44066190 0x7fbd44068650 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbd480099c0 tx=0x7fbd4800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:13.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:13.935+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7fbd4c050d40 con 0x7fbd5814a9e0 2023-10-01T01:34:14.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.095+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbd5806c090 con 0x7fbd5814a9e0 2023-10-01T01:34:14.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.099+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbd4c054360 con 0x7fbd5814a9e0 2023-10-01T01:34:14.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd55ffb640 1 -- 172.21.15.52:0/389971403 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd4c050d40 con 0x7fbd5814a9e0 2023-10-01T01:34:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbd44066190 msgr2=0x7fbd44068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbd44066190 0x7fbd44068650 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbd480099c0 tx=0x7fbd4800b040 comp rx=0 tx=0).stop 2023-10-01T01:34:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 msgr2=0x7fbd580b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 0x7fbd580b2b50 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00e4b0 tx=0x7fbd4c00e970 comp rx=0 tx=0).stop 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 shutdown_connections 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7fbd44066190 0x7fbd44068650 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd580b3090 0x7fbd580cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd5814a9e0 0x7fbd580b2b50 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 --2- 172.21.15.52:0/389971403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd40005190 0x7fbd580ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 >> 172.21.15.52:0/389971403 conn(0x7fbd5806a5c0 msgr2=0x7fbd5806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 shutdown_connections 2023-10-01T01:34:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.103+0000 7fbd5f5c2640 1 -- 172.21.15.52:0/389971403 wait complete. 2023-10-01T01:34:14.130 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-01T01:34:14.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-01T01:34:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d87e35640 1 Processor -- start 2023-10-01T01:34:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d87e35640 1 -- start start 2023-10-01T01:34:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d87e35640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0d8015d930 0x7f0d8006a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d87e35640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8015dda0 con 0x7f0d800c40e0 2023-10-01T01:34:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d87e35640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8006ad20 con 0x7f0d800c4ba0 2023-10-01T01:34:14.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d87e35640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8015cec0 con 0x7f0d8015d930 2023-10-01T01:34:14.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d853d0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0d800c40e0 0x7f0d800cd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47026/0 (socket says 172.21.15.52:47026) 2023-10-01T01:34:14.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d853d0640 1 -- 172.21.15.52:0/1001108907 learned_addr learned my addr 172.21.15.52:0/1001108907 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-10-01T01:34:14.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.247+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586442106 0 0) 0x7f0d8015dda0 con 0x7f0d800c40e0 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d68003450 con 0x7f0d800c40e0 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247238724 0 0) 0x7f0d68003450 con 0x7f0d800c40e0 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 >> v2:172.21.15.186:3300/0 conn(0x7f0d8015d930 msgr2=0x7f0d8006a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 --2- 172.21.15.52:0/1001108907 >> v2:172.21.15.186:3300/0 conn(0x7f0d8015d930 0x7f0d8006a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 >> v1:172.21.15.186:6789/0 conn(0x7f0d800c4ba0 legacy=0x7f0d800c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8006b2a0 con 0x7f0d800c40e0 2023-10-01T01:34:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2961087350 0 0) 0x7f0d74001680 con 0x7f0d800c40e0 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 >> v1:172.21.15.52:6789/0 conn(0x7f0d800c40e0 legacy=0x7f0d800cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68003ae0 0x7f0d68003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d680089f0 0x7f0d6800ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6800b6d0 0x7f0d6800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015cec0 con 0x7f0d6800b6d0 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6800e470 con 0x7f0d68003ae0 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6800e630 con 0x7f0d680089f0 2023-10-01T01:34:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6800b6d0 0x7f0d6800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d85bd1640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68003ae0 0x7f0d68003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d853d0640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d680089f0 0x7f0d6800ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 -- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d680089f0 msgr2=0x7f0d6800ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d680089f0 0x7f0d6800ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 -- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68003ae0 msgr2=0x7f0d68003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68003ae0 0x7f0d68003ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 -- 172.21.15.52:0/1001108907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68003450 con 0x7f0d6800b6d0 2023-10-01T01:34:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 -- 172.21.15.52:0/1001108907 reap_dead start 2023-10-01T01:34:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d863d2640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6800b6d0 0x7f0d6800db90 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009890 tx=0x7f0d7001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c1e8352de18d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70004220 con 0x7f0d6800b6d0 2023-10-01T01:34:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0d700a7050 con 0x7f0d6800b6d0 2023-10-01T01:34:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d84bcf640 1 -- 172.21.15.52:0/1001108907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70003620 con 0x7f0d6800b6d0 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 -- 172.21.15.52:0/1001108907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6800b6d0 msgr2=0x7f0d6800db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6800b6d0 0x7f0d6800db90 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009890 tx=0x7f0d7001c3a0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 -- 172.21.15.52:0/1001108907 shutdown_connections 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 --2- 172.21.15.52:0/1001108907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d6800b6d0 0x7f0d6800db90 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 -- 172.21.15.52:0/1001108907 >> 172.21.15.52:0/1001108907 conn(0x7f0d800b0b80 msgr2=0x7f0d800b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 -- 172.21.15.52:0/1001108907 shutdown_connections 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.251+0000 7f0d87e35640 1 -- 172.21.15.52:0/1001108907 wait complete. 2023-10-01T01:34:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 Processor -- start 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 -- start start 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d6800b6d0 0x7f0d80148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 0x7f0d80154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d800b3330 0x7f0d800b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80154790 con 0x7f0d80153df0 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800b3cf0 con 0x7f0d800b3330 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800b3fa0 con 0x7f0d6800b6d0 2023-10-01T01:34:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 0x7f0d80154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 0x7f0d80154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34950/0 (socket says 172.21.15.52:34950) 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 -- 172.21.15.52:0/3682594968 learned_addr learned my addr 172.21.15.52:0/3682594968 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d863d2640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d800b3330 0x7f0d800b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d85bd1640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d6800b6d0 0x7f0d80148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 -- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d6800b6d0 msgr2=0x7f0d80148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d6800b6d0 0x7f0d80148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 -- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d800b3330 msgr2=0x7f0d800b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d800b3330 0x7f0d800b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 -- 172.21.15.52:0/3682594968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800b4280 con 0x7f0d80153df0 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d853d0640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 0x7f0d80154250 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400d770 tx=0x7f0d7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d740074e0 con 0x7f0d80153df0 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0d74007640 con 0x7f0d80153df0 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74004a50 con 0x7f0d80153df0 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d800b4560 con 0x7f0d80153df0 2023-10-01T01:34:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.255+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d80148e40 con 0x7f0d80153df0 2023-10-01T01:34:14.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.259+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d800740a0 con 0x7f0d80153df0 2023-10-01T01:34:14.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.259+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 85676+0+0 (secure 0 0 0) 0x7f0d74004bb0 con 0x7f0d80153df0 2023-10-01T01:34:14.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.259+0000 7f0d7e7fc640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d6c066160 0x7f0d6c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-01T01:34:14.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.259+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0d74083050 con 0x7f0d80153df0 2023-10-01T01:34:14.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.259+0000 7f0d85bd1640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d6c066160 0x7f0d6c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-01T01:34:14.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.259+0000 7f0d85bd1640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d6c066160 0x7f0d6c068620 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0d78001d70 tx=0x7f0d78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-01T01:34:14.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.263+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171698 (secure 0 0 0) 0x7f0d740508e0 con 0x7f0d80153df0 2023-10-01T01:34:14.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.451+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d800ced10 con 0x7f0d80153df0 2023-10-01T01:34:14.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.451+0000 7f0d7e7fc640 1 -- 172.21.15.52:0/3682594968 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f0d74019090 con 0x7f0d80153df0 2023-10-01T01:34:14.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-10-01T01:34:14.460 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3610773708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3610773708},{"type":"v1","addr":"172.21.15.52:6833","nonce":3610773708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2089160892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2089160892},{"type":"v1","addr":"172.21.15.52:6835","nonce":2089160892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3942127741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3942127741},{"type":"v1","addr":"172.21.15.186:6835","nonce":3942127741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":8326,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1332908103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1332908103},{"type":"v1","addr":"172.21.15.186:6837","nonce":1332908103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2023-10-01T01:34:14.461 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 16 2023-10-01T01:34:14.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d6c066160 msgr2=0x7f0d6c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d6c066160 0x7f0d6c068620 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0d78001d70 tx=0x7f0d78009040 comp rx=0 tx=0).stop 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 msgr2=0x7f0d80154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 0x7f0d80154250 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400d770 tx=0x7f0d7400dc30 comp rx=0 tx=0).stop 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 shutdown_connections 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:6832/1582402253,v1:172.21.15.186:6833/1582402253] conn(0x7f0d6c066160 0x7f0d6c068620 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d800b3330 0x7f0d800b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d80153df0 0x7f0d80154250 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 --2- 172.21.15.52:0/3682594968 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d6800b6d0 0x7f0d80148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-01T01:34:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 >> 172.21.15.52:0/3682594968 conn(0x7f0d800b0b80 msgr2=0x7f0d8006eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-01T01:34:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 shutdown_connections 2023-10-01T01:34:14.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-10-01T01:34:14.455+0000 7f0d87e35640 1 -- 172.21.15.52:0/3682594968 wait complete. 2023-10-01T01:34:14.480 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-01T01:34:14.480 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-01T01:34:14.480 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-01T01:34:14.481 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:14.511 INFO:tasks.ceph.mds.a:Stopped 2023-10-01T01:34:14.511 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-01T01:34:14.511 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:14.565 INFO:tasks.ceph.mds.c:Stopped 2023-10-01T01:34:14.566 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-01T01:34:14.566 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:14.592 INFO:tasks.ceph.mds.b:Stopped 2023-10-01T01:34:14.592 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-01T01:34:14.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:14.653 INFO:tasks.ceph.mds.d:Stopped 2023-10-01T01:34:14.653 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-01T01:34:14.654 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-01T01:34:14.654 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:15.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-01T01:34:20.756 INFO:tasks.ceph.osd.0:Stopped 2023-10-01T01:34:20.756 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-01T01:34:20.757 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:22.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-01T01:34:22.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-01T01:34:26.858 INFO:tasks.ceph.osd.1:Stopped 2023-10-01T01:34:26.859 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-01T01:34:26.859 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:28.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-01T01:34:28.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-01T01:34:32.961 INFO:tasks.ceph.osd.2:Stopped 2023-10-01T01:34:32.961 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-01T01:34:32.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:33.058 INFO:tasks.ceph.osd.3:Stopped 2023-10-01T01:34:33.058 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-01T01:34:33.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:34.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-01T01:34:39.160 INFO:tasks.ceph.osd.4:Stopped 2023-10-01T01:34:39.161 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-01T01:34:39.161 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:39.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-01T01:34:45.262 INFO:tasks.ceph.osd.5:Stopped 2023-10-01T01:34:45.263 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-01T01:34:45.263 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:45.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-01T01:34:45.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-01T01:34:51.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-01T01:34:51.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-01T01:34:51.364 INFO:tasks.ceph.osd.6:Stopped 2023-10-01T01:34:51.365 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-01T01:34:51.365 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:56.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-01T01:34:56.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-01T01:34:57.467 INFO:tasks.ceph.osd.7:Stopped 2023-10-01T01:34:57.467 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-01T01:34:57.468 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-01T01:34:57.468 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:34:57.512 INFO:tasks.ceph.mgr.y:Stopped 2023-10-01T01:34:57.512 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-01T01:34:57.512 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:35:01.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-01T01:35:01.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-01T01:35:03.614 INFO:tasks.ceph.mgr.x:Stopped 2023-10-01T01:35:03.929 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-01T01:35:03.929 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-01T01:35:03.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:35:04.002 INFO:tasks.ceph.mon.a:Stopped 2023-10-01T01:35:04.003 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-01T01:35:04.003 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:35:07.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-01T01:35:07.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-10-01T01:35:10.104 INFO:tasks.ceph.mon.b:Stopped 2023-10-01T01:35:10.105 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-01T01:35:10.105 INFO:teuthology.orchestra.run:waiting for 300 2023-10-01T01:35:12.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-01T01:35:12.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-01T01:35:16.206 INFO:tasks.ceph.mon.c:Stopped 2023-10-01T01:35:16.207 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-01T01:35:16.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-01T01:35:16.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:35:16.319 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-01T01:35:16.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:35:16.589 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-01T01:35:16.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:35:16.836 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-01T01:35:17.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-01T01:35:17.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:35:17.084 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-01T01:35:17.323 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:35:17.323 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-01T01:35:17.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:35:17.563 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-01T01:35:17.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:35:17.735 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-01T01:35:17.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:35:17.927 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-01T01:35:18.118 INFO:tasks.ceph:Archiving mon data... 2023-10-01T01:35:18.120 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/data/mon.a.tgz 2023-10-01T01:35:18.120 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2023-10-01T01:35:18.127 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.S17QEiYfeX 2023-10-01T01:35:18.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.S17QEiYfeX 2023-10-01T01:35:18.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.S17QEiYfeX 2023-10-01T01:35:18.438 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.S17QEiYfeX is 538KB 2023-10-01T01:35:18.503 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.S17QEiYfeX 2023-10-01T01:35:18.508 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/data/mon.b.tgz 2023-10-01T01:35:18.508 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2023-10-01T01:35:18.515 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.b1J2OAzjav 2023-10-01T01:35:18.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.b1J2OAzjav 2023-10-01T01:35:18.677 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.b1J2OAzjav 2023-10-01T01:35:18.760 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.b1J2OAzjav is 538KB 2023-10-01T01:35:18.824 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.b1J2OAzjav 2023-10-01T01:35:18.829 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/data/mon.c.tgz 2023-10-01T01:35:18.829 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2023-10-01T01:35:18.878 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.GvPQbaQCDz 2023-10-01T01:35:18.878 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.GvPQbaQCDz 2023-10-01T01:35:19.022 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.GvPQbaQCDz 2023-10-01T01:35:19.085 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.GvPQbaQCDz is 538KB 2023-10-01T01:35:19.148 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.GvPQbaQCDz 2023-10-01T01:35:19.154 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-01T01:35:19.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-01T01:35:19.157 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-01T01:35:19.240 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-01T01:35:19.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-01T01:35:19.243 DEBUG:teuthology.orchestra.run.smithi186:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-01T01:35:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-01T01:35:19.463 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-01T01:35:19.463 INFO:tasks.ceph:Archiving crash dumps... 2023-10-01T01:35:19.465 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/remote/smithi052/crash 2023-10-01T01:35:19.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-01T01:35:19.519 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/remote/smithi186/crash 2023-10-01T01:35:19.520 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-01T01:35:19.534 INFO:tasks.ceph:Shutting down logrotate 2023-10-01T01:35:19.535 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-01T01:35:19.583 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-01T01:35:19.593 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-01T01:35:19.596 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-01T01:35:19.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-01T01:35:19.612 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-01T01:35:19.714 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-01T01:35:19.726 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-01T01:35:19.726 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-01T01:35:19.729 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-01T01:35:19.778 INFO:teuthology.orchestra.run.smithi186.stdout: remote refid st t when poll reach delay offset jitter 2023-10-01T01:35:19.778 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================== 2023-10-01T01:35:19.779 INFO:teuthology.orchestra.run.smithi186.stdout:*hv01.front.sepi 44.4.53.2 2 u 686 1024 377 0.164 +1.475 2.750 2023-10-01T01:35:19.779 INFO:teuthology.orchestra.run.smithi186.stdout:+hv02.front.sepi 63.231.80.2 3 u 822 1024 377 0.130 +3.537 2.862 2023-10-01T01:35:19.779 INFO:teuthology.orchestra.run.smithi186.stdout:+hv03.front.sepi 74.6.168.72 3 u 87 1024 377 0.133 +2.316 2.378 2023-10-01T01:35:19.779 INFO:teuthology.orchestra.run.smithi186.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-10-01T01:35:19.781 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2023-10-01T01:35:19.781 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2023-10-01T01:35:19.781 INFO:teuthology.orchestra.run.smithi052.stdout:*hv01.front.sepi 44.4.53.2 2 u 391 1024 377 0.147 +0.897 1.983 2023-10-01T01:35:19.782 INFO:teuthology.orchestra.run.smithi052.stdout:+hv02.front.sepi 63.231.80.2 3 u 397 1024 377 0.140 +3.316 2.447 2023-10-01T01:35:19.782 INFO:teuthology.orchestra.run.smithi052.stdout:+hv03.front.sepi 74.6.168.72 3 u 458 1024 377 0.126 +1.416 1.575 2023-10-01T01:35:19.782 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-10-01T01:35:19.783 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-01T01:35:19.796 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-01T01:35:19.797 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-01T01:35:19.811 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-01T01:35:19.825 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-01T01:35:19.845 INFO:teuthology.task.internal:Duration was 32257.806802 seconds 2023-10-01T01:35:19.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-01T01:35:19.861 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-01T01:35:19.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-01T01:35:19.864 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-01T01:35:20.043 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-01T01:35:20.043 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2023-10-01T01:35:20.043 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-01T01:35:20.061 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2023-10-01T01:35:20.061 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-01T01:35:20.072 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-01T01:35:20.072 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-01T01:35:20.110 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-01T01:35:20.205 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-01T01:35:20.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-01T01:35:20.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-01T01:35:21.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-01T01:35:21.095 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-01T01:35:21.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-01T01:35:21.119 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-01T01:35:21.167 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-01T01:35:21.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-01T01:35:21.183 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-01T01:35:21.203 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2023-10-01T01:35:21.209 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2023-10-01T01:35:21.228 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-01T01:35:21.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T01:35:21.273 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-01T01:35:21.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-01T01:35:21.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-01T01:35:21.290 INFO:teuthology.task.internal:Transferring archived files... 2023-10-01T01:35:21.291 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/remote/smithi052 2023-10-01T01:35:21.291 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-01T01:35:21.339 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730/remote/smithi186 2023-10-01T01:35:21.339 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-01T01:35:21.357 INFO:teuthology.task.internal:Removing archive directory... 2023-10-01T01:35:21.358 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-01T01:35:21.378 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-01T01:35:21.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-01T01:35:21.419 INFO:teuthology.task.internal:Not uploading archives. 2023-10-01T01:35:21.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-01T01:35:21.434 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-01T01:35:21.434 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-01T01:35:21.436 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-01T01:35:21.439 INFO:teuthology.orchestra.run.smithi052.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 1 01:35 /home/ubuntu/cephtest 2023-10-01T01:35:21.454 INFO:teuthology.orchestra.run.smithi186.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 1 01:35 /home/ubuntu/cephtest 2023-10-01T01:35:21.466 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-01T01:35:21.479 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-01T01:35:21.494 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi052 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-01T01:35:21.495 INFO:teuthology.nuke:Checking targets against current locks 2023-10-01T01:35:21.518 DEBUG:teuthology.nuke:shortname: smithi052 2023-10-01T01:35:21.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T01:35:21.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:27:55.605929', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGD436M5Ty9dDMIwQ7esDJkIQCZqPlzlGNDRUlgFNRa8D++SsX2sM3edKHZ/rVVXVSYtTTQgN7ZWXFbrLSD5XKM='} 2023-10-01T01:35:21.543 DEBUG:teuthology.nuke:shortname: smithi186 2023-10-01T01:35:21.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-01T01:35:21.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:27:55.603973', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDn7UywDQ3uhw9l7ZD9Zdso+5lkx1klRS/WKecYsEZmvSmu4ZcGJuleqa0STMMV42lZn/Q7210K6VMk9PNaFbTo='} 2023-10-01T01:35:21.589 INFO:teuthology.orchestra.console.smithi052:Power off 2023-10-01T01:35:21.590 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T01:35:21.616 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-10-01T01:35:21.617 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:21.631 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-01T01:35:21.631 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-01T01:35:21.641 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-10-01T01:35:21.653 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-01T01:35:21.653 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:21.678 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-01T01:35:25.642 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:25.679 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:25.753 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-10-01T01:35:25.789 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-01T01:35:29.754 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:29.790 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:29.864 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-10-01T01:35:29.899 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-01T01:35:33.866 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:34.092 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-01T01:35:34.194 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-10-01T01:35:34.211 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-01T01:35:34.298 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-10-01T01:35:34.312 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-01T01:35:34.434 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 32257.80680179596 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bb109f41092d42c8bafd7279a4497732 status: fail success: false 2023-10-01T01:35:34.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-01T01:35:34.518 INFO:teuthology.run:FAIL